localLLMrig

Your prompt picks the LLM. The LLM picks the hardware.

Test the AI first. Buy the hardware after.

Compare local LLMs against Claude, GPT, Gemini and Grok on your own prompts.

1 · Prompt
Example

“Write a Python function that removes duplicate rows from a CSV”

11 words · ~21 tokens

Read asCoding

Goes to 4 LLMs

  • Gemma 4 31B
  • Recursive Flint
  • Nemotron 3.5 Super VL
  • Nemotron 3.5 Lightning
2 · Local LLM

After a test, cheapest to run first

Example Your own test ranks the answers with stars from a free AI judge.

Q4: about 21 GB of memory.

3 · Hardware

The cheapest graphics card on our list that runs it (it still needs the rest of a PC): GeForce RTX 3090 24GB, $1,395€1,246, used (median of sold listings).

Fast~37 tok/s

A complete machine that runs it at least as fast as you read: Mac Studio M4 Max 36GB, about $2,116€1,890 (used).

Or rent a GPU: RTX 4090 at Vast.ai, $0.55 an hour.

Or online, pay per use: its API on OpenRouter.

Every machine for Gemma 4 31B →
Try an example:

Choose LLMs

or4 ticked, up to 8 at the same time

Split by the hardware you need to run each model yourself. Groups in dollars, machine prices in euros. Free: tick 2 to 8 per question. 65 more with credits.

Tick the free models to test

Hardware under $1,5006 free · 18 with credits

Small PC, desktop or Mac. From the Mac mini M4 16GB ($615€549) up to the Mac mini M6 32GB ($1,416€1,530) for the largest.

Hardware $1,500–5,0002 free · 11 with credits

Workstation or a large Mac. From the Mac Studio M4 Max 36GB ($2,116€1,890) up to the Mac Studio M4 Max 128GB ($3,683€3,290) for the largest.

Hardware over $5,0002 free · 18 with credits

Pro workstation or company server. From the Mac Studio M5 Ultra 256GB ($11,565€12,500) up to the 8× NVIDIA H200 server, about $370,000 (estimate, source) for the largest.

Online only18 with credits

GPT, Claude, Gemini, Grok and the largest open models. At most 3 of these per question: they cost the most to run, and one question on credits may cost at most a few cents.

Free needs no credits; a model without a tag uses credits. Cannot read images cannot read images.

Choose LLMs

Split by the hardware you need to run each model yourself. Groups in dollars, machine prices in euros. Free: tick 2 to 8 per question. 65 more with credits.

Tick the free models to test

Hardware under $1,5006 free · 18 with credits

Small PC, desktop or Mac. From the Mac mini M4 16GB ($615€549) up to the Mac mini M6 32GB ($1,416€1,530) for the largest.

Hardware $1,500–5,0002 free · 11 with credits

Workstation or a large Mac. From the Mac Studio M4 Max 36GB ($2,116€1,890) up to the Mac Studio M4 Max 128GB ($3,683€3,290) for the largest.

Hardware over $5,0002 free · 18 with credits

Pro workstation or company server. From the Mac Studio M5 Ultra 256GB ($11,565€12,500) up to the 8× NVIDIA H200 server, about $370,000 (estimate, source) for the largest.

Online only18 with credits

GPT, Claude, Gemini, Grok and the largest open models. At most 3 of these per question: they cost the most to run, and one question on credits may cost at most a few cents.

Free needs no credits; a model without a tag uses credits. Cannot read images cannot read images.

Every model with a lock needs credits

Test the big open models, up to a company server, and GPT, Claude and Gemini before you buy hardware or pay for an API. Test 20 models on 10 of your own tasks. 1 credit = 1 question to up to 8 models at once, GPT, Claude and Gemini included. Free models never use credits. Credits never expire. Tap a locked model, or get credits.

Paid through Stripe. Credit terms.

Test credits · €9

€9: test 20 models on 10 of your own tasks. Credits never expire.

1 credit = 1 question to up to 8 models at once, GPT, Claude and Gemini included. Free models never use credits.

What you can do with credits

  • Compare GPT, Claude, Gemini and the big open models on your own prompts
  • Test the model you plan to run before you buy hardware
  • Ask up to 8 models at once
  • See the cost per answer

Test credits €9: 50 credits (50 questions to up to 8 models at once), never expire.

Checking your account…