Andes Technology Collaborates with Fractile for AI Advancement
In the ever-evolving world of artificial intelligence (AI), a remarkable partnership has emerged, uniting two pioneering companies: Andes Technology and Fractile. Andes Technology, known for its cutting-edge RISC-V processor cores, has joined hands with Fractile, a firm dedicated to crafting innovative chips and systems meant to significantly enhance AI performance.
Fractile's Ambitious Goal for AI Inference
Fractile is on a mission to create AI inference accelerators that utilize in-memory compute technology. This approach aims to execute complex AI models—such as large language, vision, and audio models—at exponentially faster speeds compared to traditional hardware, all while achieving a drastic reduction in costs. By pushing the boundaries of performance, Fractile is determined to set new standards in AI compute efficiency.
Transforming Data Center AI Needs
With the likes of OpenAI's ChatGPT and the notable Llama model series, large language models (LLMs) are not just trends; they are transforming data center AI compute demands. Serving these massive models—known as model inference—has become a significant part of computational costs, often exceeding former training costs. To address this growing demand, Fractile has secured a licensing agreement for the Andes AX45MPV RISC-V vector processor, integrating its capabilities into their upcoming AI inference accelerator.
Innovative Circuitry for Enhanced Efficiency
What sets Fractile apart is its revolutionary approach to processing. By utilizing novel circuitry, the company is able to perform an astounding 99.99% of necessary operations directly in on-chip memory. This innovation drastically reduces the need for data transfers between memory and processor chips, allowing for computations to occur more efficiently. As a result, their design not only enhances energy efficiency (TOPS/W) but also significantly lowers latency during inference tasks—crucial for applications involving complex models like LLMs.
A Groundbreaking Partnership
The collaboration between Andes Technology and Fractile merges their cutting-edge technologies and expertise. By integrating Andes' RISC-V vector processor with Fractile's outstanding in-memory computing system, they seek to create an AI inference system that is both incredibly fast and cost-effective. This partnership aims to eliminate the bottlenecks present in conventional computing frameworks, paving the way for groundbreaking advancements in AI.
Leadership Voices in the Collaboration
Dr. Charlie Su, the President and CTO of Andes Technology, spoke enthusiastically about this partnership, noting that the AX45MPV—renowned for its strong compute capacity and high memory bandwidth—has been enthusiastically adopted by a variety of AI companies since its launch. He expressed confidence that the fusion of Fractile's in-memory computing with Andes' RISC-V vector processing technologies would lead to unprecedented success in the AI arena.
Responding to AI's Evolving Challenges
Fractile's CEO and proficient AI researcher, Dr. Walter Goodwin, further articulated the challenges posed by existing hardware, stating that overcoming these barriers is crucial for the progress and adoption of AI technologies. He emphasized the importance of software-programmable vector processors like those produced by Andes, citing their adaptability to rapid changes in AI models as necessary for remaining competitive in a fast-paced tech environment.
About Andes Technology
Founded nearly two decades ago, Andes Technology has established itself as a pivotal player in the embedded processor market. As a publicly listed company (TAI: 6533.TW), it continues to drive RISC-V technology into mainstream adoption. By the close of 2023, the cumulative volume of Andes-Embedded™ SoCs has surpassed an impressive 14 billion units.
About Fractile
Founded in 2022, Fractile has quickly emerged as a trailblazer in AI hardware. With aspirations to deliver AI chips that outperform existing technologies by significant margins—up to 100 times faster and 10 times more cost-effective—they are committed to pushing the frontiers of AI computing. Backed by prominent investors, including the NATO Innovation Fund and various angel investors, Fractile is well-positioned to make a transformative impact in the AI domain.
Frequently Asked Questions
What is the main focus of the Andes and Fractile partnership?
The partnership aims to develop an advanced AI inference accelerator that enhances AI model performance and efficiency through innovative RISC-V processing technology.
How does Fractile's technology improve AI inference?
Fractile's technology allows for 99.99% of operations needed for model inference to be executed in on-chip memory, drastically improving energy efficiency and reducing latency.
Who are the key leaders in Andes Technology and Fractile?
Dr. Charlie Su serves as the President and CTO of Andes Technology, while Dr. Walter Goodwin is the CEO and founder of Fractile, each bringing significant expertise to the collaboration.
What benefits do RISC-V vector processors offer for AI?
RISC-V vector processors, like the Andes AX45MPV, provide high compute capabilities and flexibility, crucial for adapting to the rapidly evolving requirements of AI models.
How has Fractile been funded in its journey?
Fractile has raised a total of $17.5 million from reputable investors including the NATO Innovation Fund, and has garnered support from various angel investors in technology.
