Moreh and SGLang Collaboration Highlights Distributed Inference System
Introducing distributed inference systems on AMD with high efficiency, and unveiling collaborations with Tenstorrent and SGLang
At the recent AI Infra Summit 2025, Moreh, an AI infrastructure software company, proudly showcased its innovative distributed inference system developed on AMD technology. The event took place in Santa Clara, bringing together thought leaders and institutions from various sectors within the AI landscape.
Key Updates from the AI Infra Summit
The AI Infra Summit stands as the premier event focused on the infrastructure underpinning AI and machine learning advancements. Originally conceived as the AI Hardware Summit in 2018, it has since evolved, attracting over 3,500 attendees this year, highlighting the significant growth and interest in AI infrastructure solutions.
Throughout the summit, Moreh engaged with over 100 partners, addressing the pressing needs of hardware providers and enterprise IT, all while emphasizing their commitment to developing fast, efficient, and cost-effective AI solutions.
Dynamic Presentations and Key Announcements
During the Enterprise AI session, Moreh's CEO, Gangwon Jo, delivered an engaging presentation introducing the company's advanced distributed inference system. He celebrated the benchmark results showcasing the system's superiority in optimizing the latest deep learning models like DeepSeek, surpassing traditional benchmarks set by NVIDIA.
Additionally, a major highlight was the collaboration with Tenstorrent, where the fusion of Moreh’s software with Tenstorrent's advanced hardware was unveiled. This combined effort stands to provide businesses with affordable, competitive alternatives in AI computing, potentially reshaping the market landscape.
Strengthening Partnerships with SGLang
A significant aspect of the summit was the collaborative effort between Moreh and SGLang, a recognized leader in deep learning inference software. Together, they co-hosted discussions and organized networking opportunities aimed at amplifying their presence within the North American AI market. This partnership signifies Moreh’s strategy to expand its innovative distributed inference system based on AMD technology.
Future Aspirations and Market Positioning
Gangwon Jo articulated Moreh’s vision, explaining that the company boasts robust technical capabilities in partnership with AMD, continuously pushing the boundaries through proof-of-concept projects with major large language model (LLM) companies. This approach is key to establishing Moreh as a formidable player in the global AI landscape.
Moreover, the development of their proprietary AI infrastructure engine reflects their commitment to creating comprehensive technological solutions. With Motif Technologies, their LLM subsidiary, Moreh is making strides across various model domains to expand their market reach relentlessly.
Conclusion and Upcoming Endeavors
Overall, the AI Infra Summit 2025 served as an essential platform for Moreh to unveil their cutting-edge innovations and collaborations. Their strategic partnership with SGLang and Tenstorrent not only reinforces their commitment to evolving the AI infrastructure but also positions them at the forefront of AI advancements. There is much anticipation surrounding their future projects, especially in deep learning inference systems that align with industry needs.
Frequently Asked Questions
What is Moreh's recent achievement at the AI Infra Summit?
Moreh showcased its advanced distributed inference system on AMD and highlighted collaborations with Tenstorrent and SGLang.
Who is the CEO of Moreh?
The CEO of Moreh is Gangwon Jo, who presented the company's innovations at the summit.
When did the AI Infra Summit take place?
The AI Infra Summit took place in September, attracting thousands of attendees from various sectors of the AI industry.
What future collaborations is Moreh pursuing?
Moreh plans to jointly develop an AMD-based distributed inference system with SGLang to boost their market expansion.
How is Moreh positioning itself in the AI infrastructure market?
Moreh aims to leverage partnerships to establish itself as a leader, providing diverse and competitive AI computing alternatives globally.
