Skip to content
Fast Company Executive Board

The Fast Company Executive Board is a private, fee-based network of influential leaders, experts, executives, and entrepreneurs who share their insights with our audience.

The rigor of UX is in the research, not the design

It's up to the leaders in the UX, CX, technology, and product development fields to reaffirm their commitment to the rigor of the process—in every situation—to protect it for many years to come.

[MIND AND I / Adobe Stock]

Profile photo of Adrienne Guillory

I’ve watched as the UX industry has spent years developing rigorous, value-adding processes to help companies create experiences, products, and services that have shaped or enhanced our lives. At the heart of those efforts have been UX research practitioners or related professionals who connect with end users, customers, clients, etc., to get the insights and stories needed to create strategy and vision and breed innovation.

Unfortunately, over the last few years, I’ve noticed more and more companies succumbing to the temptation to cut corners and water down the research process. In hopes of getting specific results or speeding things up, some companies, product teams, and even UX professionals are taking shortcuts that I believe skew or nullify the effects of research altogether.

CUTTING CORNERS

UX research is certainly not the first business process to rise to prominence based on its rigor and commitment to a solid methodology, only to see some tempted over time to take a laxer approach. This is why companies have quality-control officers and train employees on following their processes.

There may be busy moments when it seems pointless to do that one final inspection, or check with legal, or refer once again to the client specs to confirm the details. However, the one time you don’t double-check or skip a step in the process, you may set a precedent that can lead to more. Once people begin skipping over parts of the procedure and perceiving that no harm has been done, it may no longer seem beyond the pale to dilute the rigor of the process when it feels unnecessary.

I believe research is especially susceptible to these temptations because, as much as we like to say we are doing scientific research, the part that makes it scientific is cumbersome. Hours upon hours of reading, interviewing, and sifting through data can seem daunting and unnecessary compared to asking people around the office to give you their reactions or thoughts.

REPLACING EXPERIENCED RESEARCHERS WITH TOOLS OR SUBSTITUTES

User research, specifically interviewing and phrasing questions, can look easier than it actually is (or should be). Without an understanding of the importance of how and when to ask questions, it can be easy to think that anybody, even a machine, can do it. As such, there are a growing number of DIY tools designed to make it easier to collect insights. But if not used properly, these online tools can only exacerbate the problem.

Remember, these tools can and do provide some value to experienced researchers. They simplify the operational process for things like finding users and scheduling interviews. They make it easier to sift through data and pull out very specific insights, but they are not capable of formulating questions. They are not designed to learn new things or replace practitioners.

Relying on them to pose questions and collect the answers can leave inexperienced researchers or untrained professionals with inferior, often surface-level data that can’t generate high-quality results to drive action forward.

An even more tempting trap can be the survey. Surveys can get you answers from wide swaths of people. However, they don’t allow for the kind of interview approach that produces a story or tells you why people are or are not doing something. By conducting surveys alone, many are forced to fill in the blanks, leaving you with more questions than answers and questioning if research, in general, is worth the time or money.

SUBSTITUTING ACTUAL USERS FOR EASY-TO-GET USERS

Not all issues with rigor in UX research can be blamed on tools. I’ve found there’s also a growing and troubling trend that sees companies using “proxy users” instead of real ones when conducting research. What is a proxy user? Usually it’s someone the product owner or developer knows, like a friend or coworker, whose profile can be seen as “close enough” to the type of user who should actually be interviewed, or worse, persons who have no experience, knowledge, or need for their product, but were open to sharing their conjecture (I mean opinion).

BRINGING BACK THE RIGOR

I don’t want this to sound all doom and gloom. There’s no reason these trends need to persist, and it’s certainly not too late to reverse course and bring rigor back to the discipline of UX research. I believe reinstating and maintaining quality research will require researchers, product owners, and developers to hold themselves and their organizations to higher standards—both for their processes and for the desired results.

Some steps you can take to protect the rigor and quality of UX research include:

• Build UX research into your process. Don’t wait until you have a problem. I often recommend pre-scheduled UX days to test features, designs, and ideas in smaller chunks as opposed to waiting to test the entire experience. For others, plan to do a UX evaluation annually or quarterly, depending on the speed of your business and milestones.

• Properly define your target audience and recruit those persons. Remember, no proxy users!

• Engage a sufficient sample size from that group. It doesn’t have to be gigantic. For qualitative UX research, eight to 10 people is usually enough, but it shouldn’t just be one or two people you know.

• Conduct a proper follow-up analysis. This can help you develop a clear direction on the actions to be taken with the information gathered.

• Invest in research partnerships or training. This helps ensure your research team or persons doing research are equipped with experience, best practices, and expertise in effective information gathering.

I believe the scientific rigor of UX research is not the only thing that makes it valuable to clients. It’s also what gives the industry its reputation for legitimacy. Allowing people in the industry to compromise that, even when it seems completely harmless in a given moment, jeopardizes not only an industry’s reputation but the viability of a process that benefits both clients and users in significant ways. I believe it’s up to the leaders in the UX, CX, technology, and product development fields to reaffirm their commitment to the rigor of the process—in every situation—to protect it for many years to come.


Adrienne Guillory is Chief Operating Officer at Usability Sciences and leads research operations, marketing, and business development.