NVIDIA Axera AX8860P targets Nvidia DGX Spark with 256 TOPS AI accelerator for under $2,000 AMD Microsoft weighs spec cuts for cheaper Surface as Apple MacBook Neo pricing pressures margins DLSS NCSoft Cinder City Trailer Reveals Tactical MMO Shooter Set in Post-Apocalyptic Seoul CONSOLES 98.6% of Gears of War: E-Day sales in Spain were physical copies GAMES Xbox Manager Deletes X Account After Backlash Over AI Game Development Claims GAMES CD Projekt delays The Witcher 4 details to ensure Ciri is not a copy of Geralt GAMES Assetto Corsa EVO update 0.10 adds 1:1 German Eifel map and off-road driving on December 9 GAMES Games Workshop Unveils Seven New Warhammer 40,000 Battleforce Boxes GEFORCE RTX RTX 5090 power limit jumps to 800W with new open-source VBIOS override tool GAMES Unofficial Bully: Scholarship Edition port runs on Unreal Engine 5.8 NVIDIA DDR2 Gaming PC with Xeon X5460 and Titan V hits 44 FPS in GTA V at 4K GAMES Disney courts EA and Bungie for Star Wars Battlefront 3 as sequel moves from fantasy to planning PC HARDWARE Dell monitor prices to rise 3-5% in October 2026 as cost absorption ends INTEL Intel Core i5-4670K hits 6.3GHz, breaks Cinebench R11.5 record held since 2014

Axera AX8860P targets Nvidia DGX Spark with 256 TOPS AI accelerator for under $2,000

Daniel Cross 0 comments 2 min read

Axera AX8860P SoC offers 256 TOPS AI compute for under $2,000. Sipeed MaixStation claims to outperform Nvidia DGX Spark in LLM inference benchmarks.

Axera AX8860P targets Nvidia DGX Spark with 256 TOPS AI accelerator for under $2,000
PC HARDWARE

Axera's AX8860P SoC aims to compete with high-end AI inference accelerators. The announcement is significant as it potentially gives an alternative for developers and small-scale users to proprietary expensive hardware. The SoC is positioned to cater to the increasing need for affordable large language model (LLM) inference.

Sipeed MaixStation promises LLM benchmark gains

AX8860P forms the backbone for Sipeed's forthcoming MaixStation. The hardware manufacturer is developing the surrounding system based on Axera's SoC. The goal is to build a complete AI inference system with Axera's silicon. This collaboration aims to showcase the SoC's potential in a user-friendly package.

Specifications

  • CPU: 16 Arm Cortex-A55 cores
  • NPU Performance: 256 TOPS FP4
  • Process Node: 6 nm
  • Memory Support: Up to 128 GB LPDDR5X
  • Memory Bandwidth: 273 GB/s

The SoC consists of 16 Arm Cortex-A55 CPU cores along with a specialized neural processing unit (NPU). The NPU provides up to 256 TOPS of FP4 computation, leveraging Axera's proprietary AXNeutron architecture. The silicon is built on a 6nm process to address power efficiency.

The SoC can support up to 128GB of LPDDR5X memory with a 256-bit interface. This configuration can support a peak bandwidth of 273GB/s to feed the NPU. Additionally, it features PCIe 5.0 for high-speed connectivity to other devices.

Sipeed asserts that the MaixStation can exceed 's DGX Spark on certain LLM inference benchmarks. They credit the performance gains to the native dense FP4 acceleration and optimal memory bandwidth utilization. Entry-level models are expected to cost less than $2,000 while higher-end models could be under $4,000.

MaixStation will launch through Kickstarter campaign likely at the end of 2026. The performance claims haven't yet been independently verified. The advertised 256 TOPS performance isn't confirmed for sustained real-world usage without 3rd party verification.

Axera's AX8860P claims to offer a cost-effective alternative to existing AI acceleration hardware. Sipeed's model should attract users looking for budget-friendly options for LLM inference. It remains to be seen how well they perform and become available based on the forthcoming Kickstarter success.

Source: NotebookCheck

Discussion

0 comments

Leave a comment