How to Get Comfortable with Quantitative UX Research
Jeff Sauro, PhD | Jim Lewis, PhD

How to Get Comfortable with Quantitative UX Research

We know that for a lot of UX professionals, quantitative UX research sounds like an oxymoron. You might have been involved in a few debates that included topics like:

  • Whether you should even use numbers in UX research

  • Which is the best UX metric to use

  • Whether you’re using the right statistical test on your data

  • Whether surveys are ever an appropriate UX research method

  • The “right” number of points in a rating scale

  • And, of course, the “correct” sample size

Unfortunately, these debates and discussions can lead to discomfort and avoidance of the topics altogether. Quantitative methods and analysis can be intimidating because when there’s math, many think there should always be only one correct answer. But UX research is an applied field. There’s as much work in understanding when to quantify, how to compute, when rules can be bent, and the limitations or flexibility in interpreting the numbers. We can’t solve all your math problems, but we hope we can get you more comfortable with quantitative research. Here are five ways.

This article is a preview. Read the full article on MeasuringU's Blog.


Summary

How do you get comfortable with quantitative research? It takes patience and the right mindset. Here are our five recommendations:

  1. Look for keywords in research questions that suggest quant over qual methods.

  2. While there are 70+ UX metrics, getting to know four (task completion, task time, SEQ, and UX-Lite) will allow you to address most research questions.

  3. Understand binary versus continuous data types because they guide analyses and sample size computations.

  4. Rating scales are the gateway to measuring attitudes. There are many variations and opportunities for biases and errors, but most format differences don’t have much impact on measures of UX attitudes.

  5. Sampling error is real but not insurmountable. Use magic ranges instead of magic numbers for sample size planning.

This article is a preview. Read the full article on MeasuringU's Blog.


20 Years of MeasuringU: Celebrating with the UX Community

Join us as we celebrate 20 years of innovation and partnership in UX Research on Thursday, August 7th, from 6:00 PM - 9:00 PM in the RiNo neighborhood of Denver.

We're excited to invite you to our anniversary happy hour - a special gathering for our valued customers, clients, and the entire UX community to connect, reminisce, and look to the future.

Expect an evening of great networking opportunities, drinks, and appetizers, along with brief remarks from Jeff Sauro and Jim Lewis to mark this milestone.

Please register on our website by August 1st so we can finalize arrangements. Spots are limited and will be open to the general public July 9th. Full event details will be provided after registration.

Click here to register: MeasuringU 20th Anniversary UX Happy Hour


MeasuringU Feedback Survey

As a valued member of the MeasuringU community, your feedback is extremely helpful.

To ensure we’re creating the most relevant and useful content for our UX community, we want to hear directly from you. We've put together a short survey to better understand how you engage with our resources and what you'd like to see more of in the future.

It takes just 3-4 minutes to complete, and your confidential feedback will directly influence our upcoming articles, products, and research topics.

You can take the survey here: MeasuringU Feedback Survey

Thank you for helping us, and our community, improve.


MUiQ: Measure Your User Experience

Getting to Insights, Faster

Collecting data is just the start. 

The real work is in the analysis — finding the story in the numbers and observations to help your team make better decisions.

MUiQ is designed to speed up that process. The platform includes real-time reporting, advanced behavioral analytics, statistical analyses (confidence intervals and p-values), and powerful visualizations that help you spot patterns quickly.

The goal is to move you from raw data to clear, informed decisions with less manual effort.

Learn more about MUiQ's analysis and reporting tools.

To view or add a comment, sign in

Others also viewed

Explore topics