The other day, I was using an AI tool to help me with a task in Outlook, and it confidently provided a set of instructions that included a button that didn’t exist. I pointed this out, and in no time, it admitted the mistake and moved on.
While this was a small hiccup, moments like these chip away at trust in AI every time they happen. It’s death by a thousand paper cuts or, in this case, nonexistent buttons. AI tools like Copilot and ChatGPT are incredibly powerful, but it’s those little errors and the lack of transparency that hold business leaders back from fully embracing them.
The solution to this problem is a two-way street.
As AI evolves, companies must guide their teams to understand and navigate its limitations while also providing the data and company context it requires.
A CONFIDENCE CRISIS
Let’s face it: AI has an unfaithful narrative problem. It is often incredibly confident, even when it’s wrong. For a human user, it can be hard to guess what AI might be hallucinating about because the answers it gives almost always sound spot-on.
And here’s another challenge: AI doesn’t always show its work. Even when you can call out an inaccurate answer, it sometimes can’t explain why it gave you the wrong answer.
That’s because AI works on a probabilistic model. The questions we are asking of generative AI aren’t always straightforward math problems with one correct answer. In fact, often there are many wrong answers and no straightforward “right” one. This can come as a real shock to users who expect the mathematical certainty we’ve all come to trust in computers.
As we move forward, AI needs to show its work and clearly indicate its level of confidence in its responses on the front end. This way, users know when to apply greater scrutiny when fact-checking AI.
WHERE WE TRUST AI TODAY
While I always recommend using AI with a healthy dose of curiosity and caution, there are certain areas where it consistently hits the mark. I use it to communicate more clearly, summarize more efficiently, and conduct research faster.
At Alteryx, we recently surveyed 1,400 business leaders and IT decision-makers about where they place their trust in AI. The top three areas where they said they trust AI fully or in some situations overlapped with my experience:
- Drafting or summarizing content (92%)
- Customer communications or personalization (88%)
- Automating repetitive tasks (87%)
Other trusted areas included monitoring systems or alerts, writing or reviewing code, and enhancing customer experiences. Yet, when it comes to forecasting, many still hesitate to hand over control to AI. Planning tasks like this often rely on human intuition, context, and long-term judgment, which are challenging to replicate with technology.
When AI operates in structured, repeatable contexts, trust naturally follows as you validate the outputs. But getting good results from AI isn’t enough. To truly trust AI, we also need to trust the data behind it.
THE ROLE OF DATA
Performance may build trust, but data sustains it. And that’s where many organizations still struggle. Beyond transparency, many other factors erode trust in AI, including the risk of bias, a lack of accountability when things go wrong, and ongoing concerns about data privacy and security.
Data is often a trust barrier in and of itself. Even when you’re confident that AI is keeping your data secure, that very data is often incomplete, unclear, or just plain messy. That makes it difficult for AI to generate accurate, reliable outcomes.
In fact, 49% of business and IT leaders believe that high-quality, accessible, and well-governed data is one of the most important attributes for agentic AI to reach its full potential, according to our survey.
Think about how you talk to experts at your company. When you ask them a question, they rarely give you a direct answer right off the bat. Instead, they ask thoughtful, nuanced follow-up questions to ensure they provide you with the information you need.
Every company’s business model is different, as is the data that underpins it. The real challenge is empowering the people who understand that context to bring their knowledge and data together within the AI platforms your company uses.
WHAT IT WILL TAKE FOR AI TO GAIN WIDESPREAD TRUST (AND ADOPTION)
For businesses to deepen their trust in AI, both the technology itself and the processes companies place around it must continue to evolve. AI should be able to validate its work by checking answers from multiple angles and showing how it arrived at a conclusion. In other words: show its work.
Of course, none of that is possible without a strong foundation. It all comes back to data. The data feeding AI systems must be trustworthy, high quality, and put into context by the experts who know it best.
Companies must also view AI as an enhancement to human decision-making, not as a replacement. AI should amplify employees’ knowledge and creativity, not the other way around.
Just as importantly, employees should be well educated about AI’s limitations and strengths. Educating teams on AI limitations and best practices to overcome those shortcomings helps generate confidence.
Just as in any relationship, trust in AI will take time to build. Right now, working with it can feel like an icebreaker game of truths and lies. But every time we challenge it, refine it, and teach it to show its work, we move closer to turning those two truths into three.
Andy MacMillan is the CEO of Alteryx.