IIT-Madras Collaborates with Ziroh Labs to Launch 'Kompact AI', a CPU-Based Platform Aimed at Democratizing AI Access.
Economy Business
In April 2025, Chennai (Tamil Nadu)-based Indian Institute of Technology Madras (IIT Madras) and California (USA)-based Ziroh Labs, in collaboration with IIT-M Pravartak Technologies Foundation, launched āKompact AIā, a CPU-based AI platform. This platform allows for the development and deployment of Artificial Intelligence (AI) models on Central Processing Units (CPUs) without the need for Graphics Processing Units (GPUs), supporting Indiaās āAI for Allā initiative to bridge the digital divide.
- The collaboration also established the Centre of AI Research (CoAIR) to overcome compute accessibility barriers in India.
- The centre is focused on developing practical AI solutions optimized for CPU and edge device inferencing, benefiting startups, Micro, Small, and Medium Enterprises (MSMEs), and government bodies.
- āKompact AIā empowers users to deploy AI models directly on conventional Central Processing Units (CPUs), significantly reducing reliance on costly Graphics Processing Units (GPUs). Additionally, it is designed to function effectively without a constant internet connection, making it highly suitable for deployment in remote and underserved areas with limited digital infrastructure.
Main Point :- (i) The platform has achieved successful optimization of 17 AI modelsāincluding notable ones like DeepSeek, Qwen, and Llamaāfor CPU-based inference. These optimizations are backed by benchmarking support from IIT Madras, ensuring reliable performance even on low-resource hardware.
(ii) By minimizing infrastructure costs, Kompact AI makes artificial intelligence more accessible to startups, researchers, and Micro, Small, and Medium Enterprises (MSMEs). This cost-efficient approach supports broader adoption of AI across various sectors and helps democratize technology for wider societal impact.
____________________________
