Moreh Launches Distributed Inference System at AI Infra Summit
Moreh, a leading AI infrastructure software company, recently showcased its innovative distributed inference system at a prominent tech event. This system runs on AMD technology and signifies a major milestone for Moreh, highlighting its collaborations with notable partners such as SGLang and Tenstorrent. This presentation took place during the much-anticipated AI Infra Summit 2025, a gathering that attracts professionals from around the world in the fields of artificial intelligence and machine learning.
The Significance of the AI Infra Summit
The AI Infra Summit stands as the largest global conference dedicated to the vital infrastructure that supports AI and machine learning technologies. Initially started as the AI Hardware Summit in 2018, it has grown to encompass all aspects of AI infrastructure, providing a comprehensive platform for discussions, innovations, and networking.
Highlights from AI Infra Summit 2025
This year’s summit welcomed an impressive audience of 3,500 participants, including over 100 partners, all sharing insights tailored for hardware providers and enterprise IT specialists eager to build efficient AI systems. Moreh's participation included a pivotal presentation from CEO Gangwon Jo, who introduced their new distributed inference system. Jo discussed significant benchmark results which demonstrated the system's efficiency in running advanced deep learning models, outperforming competitors such as NVIDIA.
Collaboration with SGLang
During the summit, Moreh co-hosted an influential presentation alongside SGLang, a key player in deep learning inference software. Their joint efforts aimed to not only showcase their advanced technologies but to also foster networking opportunities within the global AI ecosystem, particularly concentrating on expanding their presence in the North American market.
Forward-Looking Developments
Moreh is setting the stage for future projects by collaborating closely with SGLang to develop an AMD-based distributed inference system. This initiative aims to expedite their entry into the burgeoning deep learning inference market. Jo expressed confidence in Moreh’s technical expertise, stating, "We have the strongest technical capabilities among AMD's global software partners and are executing proof-of-concept (PoC) projects with various leading AI companies."
The Road Ahead for Moreh
Moreh is not merely aiming to keep pace with advances in AI technology but is determined to lead the way by building its own core AI infrastructure engine. In partnership with its LLM subsidiary, Motif Technologies, Moreh is developing comprehensive technological solutions that cater to the complexities of various AI models. Collaborations with industry giants like AMD, Tenstorrent, and SGLang are integral to their strategy of securing a prominent position in the global market.
Frequently Asked Questions
What is Moreh's new distributed inference system?
Moreh's distributed inference system is an innovative software solution designed to enhance the efficiency of deep learning models using AMD technology.
Who presented at the AI Infra Summit?
Moreh's CEO, Gangwon Jo, presented at the summit, emphasizing the capabilities and benchmarks of their distributed inference system.
What are the benefits of Moreh's collaboration with SGLang?
This collaboration aims to strengthen Moreh's presence in the deep learning software ecosystem and develop an advanced AMD-based inference system.
How has the AI Infra Summit evolved over the years?
The AI Infra Summit started as a hardware-focused event and has since evolved into a comprehensive conference that covers all aspects of AI infrastructure.
What are Moreh's future plans in AI technology?
Moreh plans to continue developing its core AI infrastructure engine and expand its technological partnerships while enhancing its AI computing solutions globally.
