Skip to content
Fast Company Executive Board

The Fast Company Executive Board is a private, fee-based network of influential leaders, experts, executives, and entrepreneurs who share their insights with our audience.

Search reinvented: The key to unlocking GenAI’s business potential

The role of search is rapidly moving from simple query-and-results models to more conversational and advisory experiences.

Louis Tetu

[Courtesy of Louis Tetu]

Profile photo of Fast Company Executive Board

When ChatGPT was released in 2022, many people thought it might replace search engines altogether. Now that the hype has settled, it’s clear that instead of just looking for quick answers, people are seeking more in-depth, precise, and customized advice, grounded in current and secure data, says Louis Tetu, CEO of Coveo. “Search isn’t dead, it’s just different—and for enterprise, it’s more critical than ever.”

For businesses, search remains indispensable as advanced AI tools and co-pilots become integral to their operations. The challenge is feeding accurate and complete information to make them as effective as possible. But many companies struggle with siloed data spread across various platforms and apps, from documents to videos, Zoom to Google Drive. “How you bring together all that information securely is the biggest challenge, and it’s our specialty because we’ve been doing search forever,” Tetu says.

This is where retrieval-augmented generation (RAG) comes in, a game-changing approach that combines precise information retrieval with GenAI’s language capabilities. RAG addresses the fundamental problem of fragmented enterprise data, ensuring AI systems can access the right information at the right time, in precise context.

“Just plugging in a prompt isn’t enough,” Tetu says. “RAG is about augmenting the quality and relevance of the retrieval using powerful AI that has a semantic understanding of context, the preferences, behavior, and intent of the user, so it can do a much better job of retrieval.”

THE ROLE OF RETRIEVAL

Retrieval is the critical component in RAG, but it’s also notoriously difficult to perfect. It involves extracting the most accurate and relevant data from extensive and sometimes siloed data sources, a challenge that can be compounded by the sheer complexity of enterprise systems, volume, and variety of content. This capability influences digital experiences of all kinds, from personalized e-commerce recommendations to streamlined customer service and improved workplace tools. The stakes are high, since failing to master retrieval can lead to inaccurate answers, hallucinations, or even data breaches. That’s why companies of all sizes are grappling with how to get it right. 

To address these challenges, Coveo recently launched the Coveo Relevance-Augmented Passage Retrieval API, a powerful tool designed to enhance and simplify RAG strategies for enterprises. This API offers businesses a robust retrieval system that integrates seamlessly with their AI applications. For organizations that decide to invest in their own LLMs, Coveo’s solution offers both precision and data security while minimizing hallucinations. Salesforce is also using Coveo’s retrieval capabilities to improve its AI assistant Einstein’s ability to seamlessly access diverse data across every Salesforce application and workflow. Coveo has also recently announced partnerships to bring AI-powered search and generative experiences to AWS, SAP, and Shopify.

THE FUTURE OF THE DIGITAL EXPERIENCE

The role of search is rapidly moving from simple query-and-results models to more conversational and advisory experiences. The next phase of digital transformation will bring AI to every point-of-experience and see businesses blending search and relevance-augmented retrieval with conversation and generative capabilities to meet users’ evolving expectations.

“The digital experience is being redefined,” Tetu says. “Users expect experiences that are personalized, advisory, conversational, and grounded in strong search and relevance capabilities.” Imagine walking into a cosmetics store and asking for a product suitable for your particular skin condition. The store’s AI system will need to understand the nuances of your request and cross-reference specific advice and product details matching your preferences, using data and powerful semantics to recommend items that are in stock and deliver margins.

Tetu predicts this shift will happen quickly in key sectors such as commerce, knowledge management, and customer service. Companies that embrace this transformation to optimize their AI strategies will reshape how their users interact with digital experiences in the process, and manage their business outcomes in ways otherwise humanly impossible without AI. Competing against these enterprise AI adopters will be challenging.