The energy-centric AI inference acceleration firm Untether AI partners Ola-Krutrim to offer AI acceleration solutions for its India data centers. This multi-faceted partnership includes performance demonstration with speedAI-based acceleration solutions and co-development of Untether AI’s next generation datacenter solutions, which will be used for inference deployment and fine-tuning of Krutrim’s generative AI models.
Krutrim selected Untether AI for its energy-efficient At-Memory compute ideally suited for the high-performance, high-scalability required for the Indian market.
At Ola Electric’s Sankalp 2024 event, the two companies demonstrated an implementation using an Arm-based host CPU and the single-chip Untether AI speedAI® acceleration card, providing higher throughput, better energy efficiency, and significantly lower cost compared to current GPU-based solutions.
“The announcement and demonstration begins our partnership with Ola-Krutrim to build upon the world-class performance and energy efficiency in AI inference that Untether AI provides,” said Chris Walker, CEO of Untether AI. “We are gratified to be working in close collaboration with Ola-Krutrim’s hardware and software engineering teams to develop next generation AI acceleration solutions utilizing the capability of our At-Memory speedAI architecture.”
“Amidst rapidly changing technology paradigms, India has a unique opportunity to become a global superpower in technologies of the future such as AI. India being the source for 20% of the world’s data and home to one of the largest tech talent pool, is fully equipped to lead the AI wave,” said Bhavish Aggarwal, Founder and CEO of Ola Krutrim. “With Krutrim, we are focused on making India technologically independent and are making rapid progress in developing full-stack AI capabilities, silicon upwards.”
With this announcement, Untether AI extends the speedAI architecture from the edge to the cloud enabling scalable AI performance. This also expands Untether AI’s capabilities in delivering innovative solutions in collaboration with other industry leaders.
