User Experience Research & Software. Tweets by Jeff Sauro, Jim Lewis & MeasuringU Team: Authors of Quantifying the User Experience + 8 Other UX Books.

Denver, CO US
Joined January 2010
Do eleven-point scales take longer to respond to than three-point scales? In our analysis we found they take 100 to 300 milliseconds longer to respond to. measuringu.com/3-point-nps/
40
Apparently, it’s slightly easier for respondents to agree that a product is useful than that it meets their needs, which has implications for the set of equivalent alternates for the UMUX-Lite Usefulness item. measuringu.com/umux-lite-alt…
91
Broadly speaking, when measuring a construct on a continuum from low to high (satisfaction, ease, LTR), more points in your scale mean greater reliability and validity. measuringu.com/three-points/
86
#Metrics aren’t perfect, but despite their issues, they are of critical importance in quantitative #UX practice. Here’s a five-step process for selecting the right UX metric. measuringu.com/how-to-select…
70
How can classical urn problems inform the use of Bayesian analysis in #UXresearch? measuringu.com/bayes-law-in-…
110
In our study of digital twin prediction of business software SUS scores, we found high correlation (.80) with human scores but average errors of about +10 points (AI prediction consistently higher than human scores). measuringu.com/digital-twins…
76
Randomization tests use computer functions to randomly shuffle data many times. To evaluate mean differences after each shuffle, the means computed from the shuffled data are compared with the observed mean difference. measuringu.com/randomization…
107
The real value is not in the equipment or technology but in the technique. Here are the basics of what you need to moderate a #usability test. measuringu.com/conduct-moder…
1
90
When setting #benchmark targets, aim high but realistic. measuringu.com/benchmark-tar…
92
“Surely, God loves the .06 nearly as much as the .05” (Rosnow & Rosenthal, 1989, p. 1277). measuringu.com/setting-alpha…
134
For research contexts in which classical test theory provides inadequate measurement of individual differences, use item response theory (including Rasch analysis) instead. measuringu.com/applying-rasc…
157
A bipolar measure of likelihood to recommend appears to better predict negative word of mouth than the NPS measure of likelihood to recommend, but it cannot be interpreted with current NPS benchmarks. measuringu.com/does-the-nps-…
136
What is the N−1 two-proportion test, and why do we recommend it over chi-square and Fisher exact tests for analyzing 2 x 2 tables? measuringu.com/what-is-the-n…
135
Methods for conducting surveys include face-to-face, telephone, mail, and online. measuringu.com/census-poll-s…
172
Our confirmed version of a new standardized questionnaire for perceived website clutter has separate measures of Overall Clutter, Content Clutter, and Design Clutter. measuringu.com/confirming-a-…
1
3
199
Unlike our previous research, we found no significant differences in predicted SUS scores from two types of digital twins (summary and full)—but both were very different from human scores. measuringu.com/digital-twins…
206
The SUPR-Q has high internal-consistency reliability (Cronbach-alpha = .86). measuringu.com/10-things-sup…
216
How Much Should You Over-Recruit? measuringu.com/how-much-shou…
1
122
Math and empirical data indicate that the first few users in a formative #usability study will uncover most of the common problems that are available for discovery, but how can this help when planning these types of studies? measuringu.com/predicting-n-…
149
In an experiment with digital twins predicting SUS scores for business software, we found similar standard deviations for humans and AI but very different shapes (skewness and kurtosis). measuringu.com/digital-twins…
132