Over the 35 years I’ve worked in the mobile chip industry, artificial intelligence (AI) has evolved from science fiction to reality. It was brought to life by cloud servers, then moved from the background to the forefront of consumer experiences. Today, breakthroughs in large language models (LLMs) are bringing AI to billions of users, leveraging powerful processors inside smartphones, laptops, and connected vehicles.
Businesses will benefit from this shift. Processing intelligence directly on devices rather than remote servers offers business users access to fast, private, and always available AI. In addition to unlocking personalized experiences that adapt to individual behavior, on-device AI empowers businesses, developers, and workers to innovate more freely, with greater control over latency and their data. From helping designers generate ideas to enabling sales teams to forecast demand, it’s already becoming a trusted partner in everyday life, and will redefine what’s possible across every personal device category.
THE EVOLUTION OF AI: FROM CLOUD TO EDGE
Historically, AI leaned heavily on the cloud—powerful remote computers capable of training and running large models. While that infrastructure remains important, real-time AI decisions can now be made directly on devices, also known as “the edge.” On-device AI offers strategic and technical advantages, delivering sub-second responsiveness, preserving privacy by keeping data local, and reducing reliance on connectivity. Users experience faster, smarter, and more secure computing.
Next-generation chips are at the core of this transformation. Mobile and PC platforms now include high-performance neural processing units (NPUs), which execute trillions of operations per second. Integrated NPUs enable PCs to run LLMs with over 13 billion parameters—enough for generative AI tools to operate without cloud connections—while discrete NPUs (separate chips near the main device processor) can support full enterprise-grade LLMs. Future AI won’t depend solely on the cloud; it will be enhanced by running on desks, in pockets, and always on.
AI software is evolving quickly. LLMs can now be compressed without sacrificing performance, so even consumer devices can deliver high-quality generative AI. Optimizations developed or tested by my team enable even mid-tier mobile devices to run Microsoft’s Phi-2, OpenAI’s gpt-oss-2b, and Stable Diffusion. Meanwhile, the AI model ecosystem is expanding rapidly, bringing real-time translation, summarization, and code generation directly to devices. These achievements are reshaping how people engage with their favorite devices.
By converging advanced hardware and software, on-device AI learns from user behavior, adapts to preferences, and delivers personalized experiences in real time. Consequently, AI assistants are becoming more popular and powerful, anticipating user intent and operating with near-zero latency. Behind the scenes, AI agents will coordinate across apps and devices, helping users complete tasks seamlessly. No longer just a “feature,” AI is becoming foundational to user experiences.
EMPOWER EVERYDAY INNOVATION
On-device AI is already changing everyday life, helping people more intelligently manage routines, organize to-do lists, monitor their health, and choose meals. AI-powered cameras optimize photos in real time, empowering anyone to capture professional-quality images. At work, AI enhances productivity by eliminating background noise on calls, automating repetitive tasks, and offering context-aware suggestions. These capabilities are scaling, making AI more accessible and useful for everyone.
For businesses, the opportunities are clear: Embracing AI unlocks new efficiency and creativity levels. Generative AI tools can now be fine-tuned with a user’s own data—learning their writing style, design preferences, or workflow patterns—to deliver personalized, context-rich outputs. On-device AI is democratizing innovation, helping creative professionals iterate faster and allowing traveling workers to understand business trends without connecting to company servers. As a result, businesses are increasingly realizing what employees can do when equipped with AI.
WHAT BUSINESS LEADERS SHOULD KNOW AND DO NOW
Business leaders should understand that on-device AI doesn’t mean eliminating cloud AI: They will leverage new capabilities in modern mobile devices while understanding their (current) limitations. As mobile devices typically have less battery power and storage than cloud servers, on-device AI models need to be optimized and tested to ensure results acceptable for business purposes. Additionally, on-device AI needs access to business data, which may surface unresolved business data fragmentation, privacy, and security issues.
Based on my years of mobile engineering experience, the most important steps in successfully adopting new technologies are human rather than technological. Business leaders hoping to adopt AI first need to achieve organizational alignment. This means understanding the specific opportunities AI is addressing, identifying leaders and stakeholders to roll it out and measure effectiveness, then aligning on the timetable and data governance issues above. Then, leaders must train employees to use on-device AI capabilities in their daily work.
Thankfully, business leaders won’t find any of these adjustments to be a deal-breaker. CTOs can handle optimization, testing, and ensuring proper data hygiene practices; similarly, AI training will take most workers hours or days, not weeks. The results of their efforts will be dramatically improved productivity—better results, faster, with less heavy lifting.
THE NEXT WAVE OF ON-DEVICE AI
Looking ahead, AI will expand into wearables such as glasses, earbuds, and even rings, delivering even more personalized, context-aware assistance by using gestures, voice cues, and sensory inputs. AI will become more intuitive, ambient, and seamlessly integrated into how we live, summarizing conversations, translating in real time, and proactively surfacing relevant information.
These advancements will be powered by continued silicon innovations. Chips will become smaller, more efficient, and more powerful, including more advanced NPUs. AI is already reshaping how people work, play, and drive. Over the next decade, AI will redefine user experiences as it becomes embedded in an even broader range of form factors, unlocking more personal, more proactive, and more capable tools than ever before.
For business leaders, the mandate is clear: AI is already here, and thanks to on-device AI, it will soon be everywhere. Now is the time to prepare your organization for a new age of productivity by choosing devices and AI tools that will change the way your people work, then align them from top to bottom for their next era of success.
Alex Katouzian is group general manager of mobile, compute, XR, voice and music, and wearables at Qualcomm.