AI Infrastructure

Generative AI, as we know, uses the computational power of Graphics Processing Units (GPUs). Unlike the traditional central processing units (CPUs), GPUs can process multiple calculations simultaneously (parallel processing) and are therefore optimal for training AI and deep learning models. Previously, GPUs were used for image processing.

There is demand for GPUs from established firms as well as startups. There is scarcity of GPUs, as both the business enterprises as well as startups are trying to leverage AI.

By global comparison, India’s requirement for GPUs is small. The US AND China have big demands.

Companies can access GPUs from cloud service providers. Here too those with big demands for GPUs get priority in getting access as they can pay faster. Alternatively, we should get the GPU chips directly from the GPU makers such as Nvidia. There is a waiting time involved that runs into months.

Scarcity also makes GPUs expensive. Big firms receive their supplies directly from the makers. They are hesitant to ship GPUs to India, since the ticket sizes are small and the payment capacity correspondingly smaller. Such big firms include Amazon Web Services (AWS), Microsoft Azure and Google Cloud.

Governments acquire GPUs by committing large finance. Governments make available GPUs for research purposes and for commercial use. The UK has acquired GPUs from Nvidia and vital components from Nvidia, AMD and Intel. Saudi Arabia has acquired 3000 H100 Nvidia chips (at $40000 a piece) to run a supercomputer at a science university. The UAE too acquires Nvidia chips through state-funded business. Chinese companies buy 1 lac high performance A800 GPUs, and have contracted for further purchases in 2024.

India should seriously think about having sovereign AI capability. The government can also persuade GPU making firms to set up plants in India. CDAC in India is providing controlled access to GPUs to AI startups.

TCS, Infosys and Jio are having tie-ups with Nvidia, the Santa Clara-based company.

India requires almost a million experts to develop AI and generative AI systems. India requires 20-30 million domain experts who can use AI and generate AI tools. India must train most of its population to become AI-literate. The government must also draft regulatory framework so as to make AI ethical and responsible. IT companies must build safeguarding features in the AI systems. AI systems should be classified according to the risks they pose to users. There should be some algorithmic accountability including bias.

AI laws must not stifle innovation. There should be deliberations among policy makers, regulators and technologists.

print

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *