Engineering building blocks of AI infrastructure

AI infrastructure for local, private and hybrid systems.

Nodes are compute nodes for models and tasks. Additional or specialised nodes can expand computing power. This may require further components, testing and adjustments.

In brief: An AI node is a compute node with models that receives tasks from Swiss AI Factory. The architecture is designed for additional or specialised nodes. How far it is expanded depends on tasks, models and load.

Nodes

What a node does.

Computing power

GPU or CPU, sized for the models that are to run on it.

Models

A node can host one or more models – local, specialised, depending on the task.

Specialisation

One node for transcription, one for documents, one for knowledge search – Factory distributes the work accordingly.

Location

On-premise, Swiss private cloud or a mix – the data class decides.

Building blocks

What the infrastructure includes.

Building blockTaskWho is responsible
NodesRun modelsYou / IT partner / Swiss AI Labs
NetworkConnection between application, platform and nodesYour IT
StorageDocuments, indexes, statesYour IT / private cloud
BackupRecoverability of data and configurationYour IT / private cloud
AccessWho may access nodes and Studioshared
OperationMonitoring, updates, supportAI Operations
Expansion

Plan additional computing power.

With higher usage or new tasks, an additional or specialised compute node can be planned. We test the impact on application, interfaces and operation in the project.

How many nodes a company needs depends on tasks, models and load; we size the setup in the project.

Horizontal scaling via nodes
Frequently asked questions

Frequently asked questions about AI infrastructure

What hardware do we need?

That depends on models and load. We size the setup by task – without blanket figures.

Do you show your node topology?

No. The number, locations and hardware of real nodes stay internal (Blueprint §16).

Do you show internal details?

Publicly, we show the principle, layers and data flow at a high level. Internal topology, routing rules, security rules and version states stay internal.

Is it already in production?

We state the maturity of each building block openly. Phrases such as “is designed to” describe the architecture, not a client deployment. Studio, Agents and parts of Factory run in our own development and operating environment and are continuously extended. Further operating models, multiple nodes and private and local installations will follow step by step.

Next step

The right size for your infrastructure.

We size nodes according to tasks, models and data classes.