Allison Kosydar THUMB

Allison Kosydar

Insights & Strategy

Design Insights

Design

Interaction Design

<p>At Delve, we’re passionate advocates for <a href="https://www.delve.com/services/strategy/design-insights" target="_blank">user research</a> and the critical role it plays in product design. But even we will admit that not all research is equal, and if the research itself is not designed correctly, it can lead to mistakes.</p>
<p>Ideally, user research is a tool to help designers move products in the right direction. Designers rely on the user feedback we collect to help develop successful products. Research can reveal problems that products don’t currently solve. It can also help designers select a better direction when there are two or three concepts to choose from.</p>

<p>Delve's experts in insights, strategy, design, and engineering can guide you through an end-to-end innovation process that delivers results.</p>

Our Services Page: Product Design and Development (text only)

<p>But user feedback can often be biased, which skews results and leads designers down the wrong path.</p>

<h2>Common Types of User Bias</h2>
<p>One of our biggest challenges as user researchers is to differentiate between useful input and bias. That’s not easy, considering there are more than 160 scientifically-proven cognitive biases that can distort findings.</p>

<h3><strong>Groupthink or Bandwagon Effect</strong></h3>
<p>You may have heard of&nbsp;groupthink or bandwagon effect. This is when people in a focus group agree with the majority or loudest opinion just to avoid conflict. Most of the research we do is one on one, to avoid that bias.</p>
<h3>Order Bias</h3>
<p>Another common bias is order bias. This is when choices presented earlier or later in a sequence are more likely to be selected by research subjects, simply because they remember them better.</p>
<p>For instance, if a design team is asking which of three colors research participants prefer, users will likely pick the color they see first. The same thing tends to happen with more complex choices, too. If you give users a list of product attributes and ask which are most important to them, they are likely to choose one of the first or last attributes presented.</p>

<p>How you ask the questions can have an impact, too. When survey questions are delivered over the phone, for instance, users tend to choose the last answer because they remember it most clearly. When users are presented with a written list, they’re more likely to select answers from the top of the list.</p>
<h2>How to Avoid Order Bias</h2>
<p>To control for order bias during research, we practice a method called <strong>counterbalancing</strong>.</p>
<p>It looks like this: When you’re testing two versions of the same design, you give half the users a sequence reversed from that of the other half. If you’re testing three versions, you can use Latin Square Counterbalancing.</p>
<p>Let’s say the versions of the product you’re testing are labeled A, B and C. Your square would be: A B C for the 1st sequence; B C A for the 2nd sequence; and C A B for the 3rd sequence. This way each version gets a turn going first, middle, and last.</p>

<p>To understand the critical importance of user research and strategy for businesses, it's helpful to look at real-world examples.</p>

Don't Miss: The ROI of Research and Strategy

INLINE Order Bias ABC

<p>That said, not all questions need to be counterbalanced. In some cases, users will expect a particular order, for instance numerical or alphabetical. You’ve likely answered surveys that ask you how satisfied you were with a product or service, with levels of satisfaction ranging from least satisfied to most satisfied.</p>
<p>Changing an expected sequence will only confuse user research participants.</p>
<h2>How Order Bias Influences UI and UX Design</h2>
<p>Order bias can also be used to make products stronger. UI and UX designers consider order bias when they’re designing interfaces and applications. Open some of the apps on your phone and notice which icons are positioned all the way to the left and all the way to the right.</p>
<p>These typically represent the most important actions, because designers know this is where users focus their attention. By <a href="https://www.delve.com/insights/how-to-use-mapping-to-determine-the-design-of-your-controls">mapping important functions</a> to these key areas, designers can make products more intuitive and easier to use.</p>
<h2>Designers Can Have Order Bias, Too</h2>
<p>Designers should be careful not to let their own biases impact user research and product design.</p>
<p>When implementing a new feature, designers may be tempted to add it to a prominent place in the UI, but it might not be the best placement for the user. Or if designers are asking research participants which of several features is most important to them, they might be tempted to put the feature they think is most important at the top of the list. This may seem minor, but it can skew study findings.<br></p>

<p>For these reasons, it’s just as important for designers to consider their own biases, as it is to predict the biases of their users.</p>
<h2>Why You Should Consider Order Bias</h2>
<p>As with all cognitive biases, order bias can distort user research if you’re not careful. But it can also be used as a design tool to help people complete key tasks. Either way, anticipating order bias helps us develop more accurate data and make products more usable.</p>
<p>Does your user research plan consider order bias? Can you bring counterbalancing into your product design research? Can you use order bias to better understand your users and make stronger user interfaces?</p>
<p><strong>To explore other key product design principles, download our ebook, Design Defined:</strong></p>

<p>Every innovation challenge is different. At Delve, we use a client-specific mixture of research methods to build a solid foundation for design with an eye to the future.<a href="https://www.delve.com/services/strategy/design-insights" target="_blank" rel="noreferrer noopener"><br /></a></p>

Services Page: Design Research (Different from traditional market research)

Download: Design Defined 30 Key Design Principles

<p><strong>Learn more about&nbsp;<a href="https://www.delve.com/services" target="_blank">Product Development & Design Services at Delve.</a></strong></p>

SEO Text: Our Services

Odissei q YFN Hh1k HQ unsplash smaller

<p><strong>We’re passionate advocates for user research and the critical role it plays in product design. But not all research is equal. </strong></p>

Contact Us | General (Let's build something together)

Medical Devices

Consumer Products

Home

Insights

Don’t Let Order Bias Distort User Research

Breadcrumbs

A full-service product design and strategic innovation consultancy.

Delve

We’re passionate advocates for user research and the critical role it plays in product design. But not all research is equal.

description

generator

kSwNn6qD4B-4HloWnWMUBWQNpBx2_mPi3nMqgsh6ato

google-site-verification

user, research, critical, advocates, role, plays, passionate, product, equal, we’re, design

keywords

https://cms.delve.com/assets/images/_1200x630_crop_center-center_82_none/odissei-qYFN_Hh1kHQ-unsplash-smaller.jpg?mtime=1700682338

https://linkedin.com/company/delvedesign/

https://www.delve.com/insights/dont-let-order-bias-distort-user-research

referrer

robots

twitter:card

twitter:creator

twitter:description

https://cms.delve.com/assets/images/_800x418_crop_center-center_82_none/odissei-qYFN_Hh1kHQ-unsplash-smaller.jpg?mtime=1700682338

twitter:image

twitter:image:alt

twitter:image:height

twitter:image:width

twitter:site

twitter:title

{"title":{"title":"Don’t Let Order Bias Distort User Research | Delve"}}

Learn the Not-So-Basics

Privacy Policy

FCOI Policy

Services

Case Studies

Testimonials

What We Do

About Us

Our People

Join Our Team

Careers

Newsroom

Who We Are

Boston

Madison

Philadelphia

San Francisco

Our Studios

Partner with Delve

Contact Us

Contact

<p>Vamsee Pamula, Founder &amp; President, Baebies</p>

Read informative articles from Delve's team of experts. Discover innovative strategies and insights about product design, engineering, and development.

Delve Insights: Product Innovation & Development Blog

innovation, product, design, advice, development

https://cms.delve.com/assets/images/_1200x630_crop_center-center_82_none/Delve_titlecard.png?mtime=1654035558

https://cms.delve.com/assets/images/_800x418_crop_center-center_82_none/Delve_titlecard.png?mtime=1654035558

Don’t Let Order Bias Distort User Research

Don’t Let Order Bias Distort User Research

Related Insights