How LLMs Could Change Smartphones

It remains unclear how generative artificial intelligence (large language models) will change our notions of “smartphone” capabilities. One reason is that LLMs might be likened to platforms, operating systems, applications, features or “simply” interfaces between humans and computer resources. 

Though operating systems typically have been considered to manage and control computer resources and interactions, sitting between the hardware and the applications, LLMs might structurally provide similar functions, mediating between the machines and their users. 

That is a role closely related in some ways to the human-to-machine interface, but is much more pervasive in terms of anticipating needs. 

On the other hand, sometimes LLMs might function almost like an app, as when used to support image processing and editing for smartphone cameras or providing on-the-fly translation. In most cases, LLMs might support the features and operation of almost any other software. In such cases the LLM will appear to be a feature or capability. 

Role	Function	Example Use Cases
Operating System	Personalizes and adapts to user behavior and preferences.	- Proactive suggestions for apps, settings, and actions based on context and usage patterns. - Personalized notifications and reminders tailored to individual needs. - Adaptive user interface elements that adjust to user preferences and accessibility needs.
Application	Generates content, automates tasks, and offers creative tools within specific apps.	- Social media: AI-powered content creation (captions, images, even videos) based on user input or prompts. - Productivity: Generating reports, summarizing documents, and drafting emails based on user instructions. - Education: Personalized learning content and practice exercises tailored to individual learning styles and knowledge gaps. - Entertainment: Creating short stories, music, or games based on user preferences and prompts.
Computer-to-Human Interface	Enables natural language interaction and voice control with devices.	- Conversational virtual assistants that understand complex queries and requests, providing relevant information and completing tasks. - Real-time language translation for spoken and written communication, facilitating cross-cultural interactions. - Voice-controlled interfaces that interpret natural language commands and execute actions effortlessly.
Platform	Provides foundational tools and frameworks for developers to integrate generative AI into their apps.	- APIs for tasks like text generation, image creation, and voice synthesis, accessible to developers for app integration. - Pre-trained AI models for specific domains (e.g., healthcare, finance) that developers can leverage in their apps. - Standardized security and ethical frameworks for responsible development and deployment of generative AI on smartphones.
Capability	Enhances existing smartphone features and adds new functionalities using generative AI.	- AI-powered image and video editing tools with filters, effects, and automatic enhancements. - Personalized fitness coaching with workout plans generated based on individual goals and capabilities. - Real-time language translation during phone calls and video conferences, breaking down language barriers. - Smart assistants that manage personal finances, automate repetitive tasks, and optimize daily routines.

All of that will eventually come into play in creating the market for “AI smartphones.” What we do not yet know is how consumers will come to understand what an “AI smartphone” must be capable of doing.