Generative AI Search on Smart Phones

India is a mobile first country. Generative AI is progressing at a rapid pace. At present, a generative AI query, say on ChatGPT runs on the cloud. However, this is not cost effective. The query can be handled by the processor of the smart phone, and the processor can generate a response. It all depends on the capability of the processor and the complexity of the query. The cost of running a query on a cloud is 10 times costlier than to have it handled on the processor.

Of course, in future a smart phone would be a hybrid AI device that co-exists with cloud so as to leverage the generative AI technology.

The query too remains confined to the device, and makes the users comfortable about the privacy and safety.

Qualcomm, a San Diego-based mobile chip maker is working on these lines. It has demonstrated this capability on its Snapdragon 8 Gen 2 platform.

Stable Diffusion has been tested on smart phones. It takes a text query and generates images based on it.

Currently, smart phones have a chipset block that supports AI. In future, the block size may increase to leverage generative AI type tasks.

print

Leave a Reply

Your email address will not be published. Required fields are marked *