You ever felt stuck between wanting the brute power of cloud AI and the control of having everything right there on your desk? Well, here comes Acrab, shaking up the scene with their G?LIX 1 SoC and Agent Box—a blend of brawn and local brains that could change the game for AI computing.
A New Dawn for Personal AI
Acrab sees a future where AI isn't chugging away in some shadowy cloud server farm. Nope, it's right there, parked on your desk, as close as that stubborn coffee stain you can't quite scrub off. With their new G?LIX 1 chip, built on a 5-nanometer process, they aim to run models with a whopping 100 billion parameters locally. This advances the shift from cloud-based AI to owning your own tech genie that actually hears what you're asking.
Agent Box: The Personal AI Hub
Enter the Agent Box — Acrab's shot at making AI more personal and less of an "occasionally useful" tool. This edge AI system is no impractical dream. It's built for every day, sitting on your desk, processing demands with a pace that leaves those token-heavy cloud processes in its dust.
As Dr. Ken Phua, CEO of Acrab, puts it best, "Generative AI helped people find answers. Agentic AI will help them get things done." There's a clever thought—AI directly in your line of sight helping you tick off your endless to-do list efficiently.
G?LIX 1: The Beat Within the Box
Here's the brains behind the Box—G?LIX 1 isn't your run-of-the-mill processing unit. This SoC has a 20-core Arm CPU coupled with multicore NPU acceleration, fanning out tasks across its CPU, GPU, and NPU resources like a master conductor. And it runs large models locally, which usually crawl through cloud systems, offering performance that traditional systems can only dream of.
When it comes to specifications and numbers, we see major leaps. During testing, inside the Gemma 26B A4B setup, G?LIX 1 hit a prefill rate of 1416.8 tokens per second, a fascinatingly thick packet of prowess compared to a Mac Mini M4 Pro's 188.9 tokens per second.
Full-Stack AI Vision
This isn't just smart silicon. Acrab crafts the entire deal: silicon, software, and even development tools—it's like they're the IKEA of AI if IKEA had a knack for crafting intelligent systems instead of flat-packed furniture. Their runtime environments and developer toolchains are streamlined to make sure agent AI is more than just a pipedream.
"Our goal is to give device makers and developers the foundation to bring agentic intelligence into many different products and environments," remarked Phua, hinting at a larger canvas beyond just one fancy box.
Through their full-stack setup, edge AI could pop up just about anywhere—from smart vehicles to sophisticated robots on the factory floor, potentially cutting drone-like reliance on cloud dependency by a wild margin.
Aiming for a Broad AI Ecosystem
Acrab isn't aiming to be a one-hit wonder with the Agent Box. They're laying down roots for a wide AI ecosystem, joining forces with partners to transform vehicles, computers, and more into action-ready AI devices.
With a neat $350 million in backing from venture capital and strategic industry investors, Acrab's playing the long game here, bringing the Agent Box's benefits beyond today's market. They’ve got their eyes on transforming industry wide norms, making agentic intelligence something you can carry in your backpack, not dream about from afar.
What we’re witnessing is an evolution in compute architecture that works faster, wants less power, and ultimately fits as comfortably into personal lives as into heavy-duty industrial applications. Acrab's Agent Box just might be the herald of this new wave of AI integration, and their silicon to application full-stack narrative is changing the flow of personal and industry interactions with tech as we know it.
