Hardware
Heliast runs on hardware you own, rent or already have. Hardware is always priced separately from Heliast, and Heliast does not resell it. This page says what each size of estate needs, what it can serve, and what has and has not been measured.
Every price here is indicative, in NZD, excluding GST, freight and installation, and must be re-quoted when a proposal is written. GPU and memory prices have moved by tens of percent within a single quarter. The figures below were last reviewed on 2026-10-13, at about 1.72 NZD to the US dollar.
The tiers below are sized for a team using models interactively. If your workload is one automated process, or a small team, you may need much less: see sizing for your workload.
The five tiers at a glance
| Tier | For | Compute | Indicative hardware (NZD) | Status |
|---|---|---|---|---|
| 0 | One person or one team evaluating, or an air-gapped desk unit | 128GB unified-memory mini PC or workstation | 4,000 to 12,500 | Evaluation only. Not a production tier. |
| 1 | 50 to 100 staff, one primary model, standard retrieval | 1 x NVIDIA RTX PRO 6000 Blackwell (96GB) | 41,000 to 46,000 | Reference design. Not yet measured on this hardware. |
| 2 | 100 to 500 staff, several models, Compare | 2 x RTX PRO 6000 Blackwell Server Edition (96GB each) | 84,500 to 94,000 | Design only. |
| 3 | 500 to 2,000 staff, high availability | 4 x RTX PRO 6000 Blackwell Server Edition, or pooled-memory cards (quote) | 170,000 to 189,000 | Design only. |
| Pooled | Models too large for one card, or fine-tuning at scale | H200 NVL or B200 cards, or a GB300 workstation | quote | Quote at proposal. |
Data-centre and RTX PRO cards only. GeForce cards are cheaper per gigabyte but the driver licence restricts data-centre use, so Heliast refuses them at hardware acceptance.
What each tier is built from
Indicative NZD. GPU lines use US$13,250 (the June 2026 NVIDIA listing) for the low end and US$16,000 (NVIDIA's marketplace, October 2026) for the high end.
| Part | Tier 1 | Tier 2 | Tier 3 |
|---|---|---|---|
| GPU | 22,800 to 27,500 | 45,600 to 55,000 | 91,200 to 110,000 |
| CPU | AMD EPYC 9354, 4,500 | 2 x EPYC 9454, 12,000 | 2 x EPYC 9654, 20,000 |
| Host memory (DDR5 ECC) | 128GB, 7,000 | 256GB, 14,000 | 512GB, 28,000 |
| Storage (NVMe) | 4TB x 2, 2,000 | 8TB x 4, 6,000 | 16TB x 8, 16,000 |
| Network | 2 x 25GbE, 1,000 | 2 x 25GbE, 1,000 | 2 x 100GbE, 3,000 |
| Chassis, power, cooling | 4U, 2000W redundant, 4,000 | 4U, 3000W redundant, 6,000 | 2 x 4U, 12,000 |
| Total | 41,300 to 46,000 | 84,500 to 94,000 | 170,100 to 189,000 |
Host memory is sized for serving, not for the model. Weights and the context cache live on the card. Server memory now costs several times what the original design budgeted (about NZ$3,500 for one 64GB module against NZ$625 implied by the original line), so the earlier reference (256GB, 512GB, 1TB) is no longer the default. Use those larger sizes only if you plan to offload to the CPU or run large ingestion jobs on the same host. With the earlier sizes the totals are about NZ$7,000 (Tier 1), NZ$14,000 (Tier 2) and NZ$28,000 (Tier 3) higher.
Not re-checked in this review: CPU, storage, network and chassis lines, which are carried over from the original design. Treat them as older than the GPU and memory lines.
Tier 2 and 3 cards do not pool memory: the RTX PRO 6000 has no NVLink, so a model that must span cards runs over PCIe, and a model larger than one card's memory needs pooled hardware instead.
Tier 0 in detail
| Option | Memory | Indicative (NZD) | Note |
|---|---|---|---|
| AMD Ryzen AI Max+ 395 mini PC | 128GB | 3,800 to 7,300 | Often out of stock. No CUDA. |
| NVIDIA DGX Spark | 128GB | 8,500 to 12,400 | Reported prices conflict (US$4,699 to about US$6,950). |
| NVIDIA DGX Spark, 64GB model | 64GB | about 8,600 | Announced for 23 October 2026. Too small for a 70B model at 4-bit with usable context. |
Both 128GB options move data at roughly 273GB/s, about a seventh of the Tier 1 card. That is fine for one person exploring and for showing the compliance workflow. It will not hold latency targets under concurrent load.
What a tier can hold
Memory a model needs is its weights, plus a context cache for every conversation in flight. The weights figure is on each model's verdict page. The cache grows with context length and with how many conversations run at once, so it is the part that runs out first.
A worked case, as an estimate and not a measurement: a 70B-class model at FP8 takes about 70GB, which leaves about 26GB on a 96GB card. With the 8-bit cache that such a model typically uses, one 32,000-token conversation needs about 5GB, so a single card holds on the order of four or five such conversations at once. A 27B-class model at FP8 takes about 27GB and leaves room for many more. This is why a well-chosen smaller model is usually a cheaper capacity increase than more hardware, and why Compare exists.
Sizing note. "Concurrent users" and "conversations in flight" are different numbers, because most users are idle most of the time. How the two relate depends on how your staff work. Agentic and long-context workloads need much more cache and are sized separately.
Performance targets
| Tier | Concurrent users | P95 latency | Status |
|---|---|---|---|
| 1 | 50 to 100 | under 2s | Design target. No result has been measured on Tier 1 hardware. |
| 2 | 100 to 500 | under 1.5s | Design target. |
| 3 | 500 to 2,000 | under 1s | Design target. |
Targets assume FP8 serving at 32,000 tokens of context and a model sized to the tier. Until a Tier 1 run exists, latency is a target to be measured at deployment and re-measured after any model change. It is not a guarantee.
What the console means by "one card", "one server" and "cluster"
Each verdict page and the Admission filters describe a model by how much memory its smallest published weights need:
| Console term | Weights up to | Typical home |
|---|---|---|
| one card | 24GB | any tier, including a smaller card |
| one server | 128GB | one Tier 1 card up to about 70GB of weights, a Tier 2 server beyond that |
| cluster | more than 128GB | Tier 3 or pooled hardware |
These describe a model, not a customer's estate. The tier a model fits is shown on its "Use this model" panel.