Zoho Corporation's Strategic Move Towards LLMs
Zoho Corporation, renowned for its comprehensive technology solutions, is taking a significant step in the artificial intelligence landscape by integrating NVIDIA's NeMo. This platform is pivotal for building and deploying large language models (LLMs) across their SaaS applications. With a mission to serve over 700,000 customers globally, Zoho ensures that its offerings are robust and tailored to meet diverse business needs.
Investment in NVIDIA AI Technology
In the past year, Zoho has committed more than USD 10 million to leverage NVIDIA's cutting-edge AI technology and GPUs. The company is set to invest an additional USD 10 million, signaling its dedication to enhancing its technological capabilities. This investment not only boosts their own AI infrastructure but reinforces their commitment to providing superior services to businesses.
Developing Contextually Relevant LLMs
Ramprakash Ramamoorthy, Zoho's Director of AI, explains their vision for LLMs. Unlike many existing models that cater primarily to consumer needs, Zoho aims to create LLMs that are intimately tailored to address specific business challenges. By owning their entire tech stack, including a diverse range of products, Zoho can effectively integrate contextual features that enhance the overall effectiveness of the AI.
Privacy at the Core of AI Development
Prioritizing user privacy is a fundamental aspect of Zoho’s AI strategy. The company emphasizes compliance with privacy regulations right from the model-building phase. This proactive approach is designed to ensure that businesses can harness the power of AI without compromising data security or privacy. By utilizing NVIDIA’s advanced AI systems, Zoho aims to create models that deliver quick returns on investment while maintaining the highest standards of privacy.
The Foundation of Zoho's AI Technology
Building on over a decade of AI innovation, Zoho has constructed a portfolio that includes more than 100 products under their ManageEngine and Zoho brands. Their approach to AI is characterized by its multi-modal nature, which focuses on deriving contextual intelligence for informed business decision-making. This breadth of experience positions Zoho uniquely in delivering AI solutions that resonate with various customer needs.
Enhancing AI Model Accessibility
Zoho is committed to developing narrow, small, and medium language models alongside traditional LLMs, offering businesses flexibility in choosing the right size model that fits their needs. This diversified approach enables organizations with limited data resources to still benefit from sophisticated AI capabilities. Importantly, customer data is not utilized in training these models, reaffirming Zoho’s commitment to privacy and security.
Collaborative Efforts with NVIDIA
Through their partnership with NVIDIA, Zoho is enhancing its LLM capabilities on NVIDIA’s accelerated computing platform, particularly utilizing the NVIDIA Hopper GPUs. This partnership facilitates the development of custom generative AI, including various modalities like vision and speech. Moreover, Zoho is currently testing NVIDIA TensorRT-LLM to optimize LLM deployment, achieving remarkable results that include a 60% increase in throughput and a 35% reduction in latency over previously employed frameworks.
About Zoho Corporation
Founded in 1996 and headquartered in Chennai, India, Zoho Corporation is a privately-held, profitable technology enterprise. With a workforce exceeding 15,000 worldwide, Zoho is distinguished by its innovative products that address diverse business needs. Key brands under its umbrella include ManageEngine, Zoho, TrainerCentral, Qntrl, and Zakya, all contributing to its reputation as a leading technology provider.
Frequently Asked Questions
What is Zoho Corporation's main goal with LLMs?
Zoho aims to develop LLMs that are specifically tailored for various business applications, enhancing their existing SaaS services and providing relevant solutions.
How much has Zoho invested in NVIDIA technology?
Zoho has invested over USD 10 million in NVIDIA's AI technology and plans to invest an additional USD 10 million in the coming year.
What is the significance of user privacy in Zoho's AI models?
Zoho emphasizes user privacy by ensuring that their models are compliant with regulations from the start, avoiding retrofitting privacy features later.
How does Zoho's AI technology differentiate from others?
Zoho’s AI technology focuses on contextual intelligence and includes a variety of model sizes, accommodating businesses with different needs and data resources.
What advancements are being made with NVIDIA's collaboration?
Zoho is improving its LLM capabilities through NVIDIA's accelerated computing infrastructure, improving performance metrics significantly while optimizing their AI functionalities.
