Oracle makes Positron Atlas inference platform available
·

Oracle makes Positron Atlas inference platform available

Oracle Cloud Infrastructure now offers Positron Atlas inference instances, adding a specialised accelerator platform designed to improve memory efficiency and the economics of running production AI models.

Oracle makes Positron Atlas inference platform available
Summary
  • Positron Atlas inference instances are generally available on OCI.
  • The platform uses specialised accelerator hardware with a focus on memory bandwidth and inference throughput.
  • Oracle integrates the systems with Acceleron networking, including 200Gbps connectivity.

Oracle has made Positron Atlas inference instances generally available through Oracle Cloud Infrastructure, adding a specialised accelerator architecture to its portfolio of computing systems for production AI workloads.

The offering combines Positron’s inference hardware with OCI’s infrastructure and Acceleron networking. The systems are designed to process requests using transformer-based models, with an emphasis on memory efficiency, throughput, and operating cost.

Atlas is intended for organisations deploying models that must respond to large numbers of requests while maintaining acceptable latency and service availability.

Inference differs from the initial training of a model. Instead of repeatedly adjusting model parameters through extensive training operations, inference uses an established model to process inputs and generate results.

Those workloads can place substantial demands on memory capacity and bandwidth. Large models require information to be retrieved quickly, while the system must also manage the data associated with multiple requests and longer processing sequences.

Processor arithmetic capability alone may not determine throughput when memory transfers limit the rate at which calculations can be completed.

Positron’s architecture is designed around these constraints. The company reports benchmarked memory-bandwidth efficiency of 93% and claims a threefold to fivefold total cost of ownership advantage for targeted workloads.

Those figures reflect supplier comparisons and should not be interpreted as independently established savings across all inference applications. The outcome will depend on the models used, workload characteristics, utilisation, pricing, and supporting infrastructure.

Oracle integrates Atlas with its Acceleron networking architecture, providing connectivity rated at up to 200Gbps for supported deployments.

The network connection supports communication with other infrastructure services and the exchange of data required by distributed workloads. Its contribution to overall performance depends on whether the application is constrained by networking, memory, or processing.

Atlas supports popular open-weight model families and is intended to provide a specialised platform for applications where production inference economics are more important than maintaining a general-purpose accelerator environment.

Using a dedicated inference architecture may reduce some hardware requirements for suitably optimised workloads. However, the practical choice of processor also depends on model support, available software tools, and the engineering effort required to move applications between systems.

Cloud operators offering multiple accelerator architectures must maintain separate software and infrastructure configurations. Scheduling, monitoring, network integration, equipment maintenance, and customer support become more complex as the number of supported hardware types increases.

Physical data centre requirements also vary by configuration. Positron says Atlas can operate in air-cooled or liquid-cooled environments, depending on rack density and the installation design.

Neither cooling arrangement removes the need to verify electrical demand, heat rejection requirements, equipment loading, and maintenance access before deployment.

Positron is developing a subsequent architecture named Asimov, intended to support its Titan inference platform. The company expects production during the second half of 2027, subject to completion of development and manufacturing.

Asimov and Titan remain future products, separate from the Atlas systems currently available through OCI.

Oracle identifies smaller frequently used models, including GPT-OSS, Qwen 3.5 and Gemma 4, among the applications suited to the Atlas offering. Compatibility with those model families is more informative than a generic claim of universal acceleration, because each model has distinct memory and execution requirements.

The vendor’s total cost of ownership comparison depends on request completion times and energy use as well as processor efficiency. A faster system can reduce the number of servers needed for a given workload, but only when the surrounding software and network can keep the accelerators sufficiently busy.

Positron’s commercial proposition therefore depends on developers choosing a supported inference stack. Model operators must assess the cost of porting applications, available performance tools, supported numerical formats and the behaviour of the system at the concurrency levels encountered in production.

Oracle is deploying the platform within a cloud service, so the physical cost of the Atlas hardware is not the only customer consideration. Instance pricing, service availability and the latency associated with moving requests or data between regions also influence the practical economics.

A specialist inference instance may also serve a different range of models from a general-purpose GPU service. Pricing comparisons need to specify the exact model, batch size, response-time requirement and level of continuous utilisation.

The commercial availability of Atlas provides another accelerator choice for customers evaluating production inference workloads. Actual costs and performance will depend on the supported deployment configuration, model requirements, and available infrastructure services.


Stay updated with the latest insights and trends in the data centre industry by subscribing to our newsletter.

← Back

Thank you for your response. ✨