Plain English, visible limits
Private AI server questions answered.
If an answer depends on the exact build or buyer, we say so. No invented certainty.
Questions answered
Fit and performance
How many users can one AI server support?
There is no honest universal number. Model, context, response length, batching, latency target and simultaneous active requests determine capacity. We benchmark a disclosed workload.
Does 128GB aggregate VRAM mean one model can use 128GB?
Not automatically. Four 32GB GPUs remain four memory devices. The runtime must support dividing the workload, or the GPUs run independent services.
Can a local model replace ChatGPT or an API?
It can replace accepted workloads when the exact local model passes quality, latency and integration tests. Hosted access may remain sensible for difficult exceptions.
Questions answered
Security and privacy
Will data stay on the server?
It can, when the agreed architecture has no external connectors, telemetry or fallback routes. We document the data route; the customer owns ongoing configuration after handover.
Is private AI automatically secure or UK GDPR compliant?
No. Local hosting can support control, but identity, network, retention, rights, accuracy, backup, updates and governance still require named owners.
Can the server operate offline?
A system can be prepared for offline or tightly restricted operation. Models, licences, dependencies, updates and support procedures must be designed for that state.
Questions answered
Buying and operating
Are prices fixed?
No. Current prices are proposed, indicative and ex VAT. A final quote depends on exact components, availability, warranty, currency, delivery and workload acceptance.
Do you install the rack and electrics?
Not in the initial baseline. The proposal covers source configuration, testing, collection or pallet delivery and remote onboarding. Racks, circuits, HVAC and onsite integration need separate scope.
Can we lease the equipment?
Potentially through an approved finance route. Compare total amount payable, ownership, security, tax and exit terms with the cash purchase.
Questions answered
Tax and spare capacity
Is there a capital-gains advantage?
No generic capital-gains benefit is claimed. Qualifying plant may attract capital allowances, and input VAT may be recoverable subject to the buyer and current rules. Ask the organisation’s accountant.
Can the GPUs earn money while idle?
Possibly through an isolated marketplace pilot, but demand, acceptance, rates and uptime are not guaranteed. Revenue is excluded from the base business case.
Is marketplace mode enabled by default?
No. It is off by default and requires a security, workload-priority, warranty, insurance, tax and contribution review.
Privacy is an operating model, not a sealed box.
Hardware location matters, but so do identity, updates, model sources, recovery and administrator access. Treat the complete boundary as the system.
