Free entryWin a DualSense + Razer headset, drawn Black FridayEnter free
Skip to content
AI, How-To Guides 3 min read

Want your own AI server? Here’s where to actually start

Dark neon graphic with the headline Want your own AI server? Start here, and a Read the full UK guide panel

If you have been staring at GPU shopping tabs thinking you need a “proper AI server” before you can try any of this, you can close them for a minute. You probably already have a computer. Start there. The long, careful version — tools, official memory figures, electricity maths, the lot — is in our guide: How to build your own AI server: beginner to expert (UK).

Dark neon graphic with the headline Want your own AI server? Start here, and a Read the full UK guide panel

Here is the short version, with no romance in it.

Start on the machine in front of you

Ollama’s own Quickstart has you run a local first model, gemma4:e2b, on macOS, Windows or Linux, with ollama run gemma4:e2b. They say the download is about 7.2GB and they recommend 8GB of available VRAM, or unified memory on a Mac. If you have less VRAM, they say it can use system RAM, but it may be slower. That is their wording, not a test I have sat through with a stopwatch.

If you would rather have a desktop app with a chat box, LM Studio is the other official starting point. They recommend 16GB of RAM, and on Windows at least 4GB of dedicated VRAM. Apple Silicon only on a Mac — Intel Macs are not supported. Again, that is from their system requirements, checked 17 November 2026.

If that first official small model runs at all, you have a local AI setup. It is not a data centre, and it does not need to be.

Do not buy a beast because a forum said so

There is no single official RAM or VRAM number that covers every model. Anyone quoting a magic figure without pointing at a vendor page or a tool’s own docs is guessing. Confirm the VRAM on the manufacturer’s spec sheet. Use the tool’s own first-model advice. If you later want a machine that stays on, or you want to reach it from your phone, that is the intermediate chapter in the guide — Docker, a web UI, and Tailscale or a VPN rather than opening a port on the router like it is 2009.

The electricity question is in the expert section too, with the current Ofgem cap unit rate and the sums written out. We have not measured a wall-draw, so we have not invented a monthly bill for you.

The full guide

If you want the jump menu, the official citations, the planning tiers and the security list, it is all in How to build your own AI server: beginner to expert (UK). Start at beginner. Move up only when you have a reason.

WIN a controller + gaming headset

Free UK prize draw. No purchase needed. Drawn on Black Friday, 27 Nov.

Choose:

UK 18+. See terms at truenorthtechx.com/giveaway-terms

Enjoyed this? Follow along for more guides and deals. More guidesXInstagramFacebookTelegram

0 0 votes
Article Rating
guest
0 Comments
Oldest
Newest Most Voted