Surveys — Non Response Bias
Understanding Non Response Bias while conducting UX research surveys
This is a part of my class Assignment at UW Madison.
Surveys play a crucial role in collecting data and insights from a targeted group of individuals, providing valuable information for research, decision-making, and understanding public opinion. I noticed that with surveys are very useful, there could be potential for bias. While surveys aim to capture a some kind of representative structure, various factors can introduce bias and affect the accuracy of the results.
I noticed a major bias when conducting surveys for the assignment. Our primary goal was to understand how users interact with an apartment searching website.
Non-Response Bias:
Some users resort to skimming through the survey as they don’t want to add more cognitive load, resulting in improperly filled-out responses. We often received “N/A” for text field questions, and for ranking questions, the majority of responses defaulted to the pre-set list.
This behavior highlights the challenge of survey response quality when participants feel overwhelmed or rushed. Skimming through a survey can lead to incomplete or superficial responses, limiting the depth of insights that can be derived from the data.
What could have been done ?
To mitigate these biases, we could have reduced the number of text field questions or any other type of questions that require users to put in extra effort. Additionally, providing a more detailed description of how the data will be utilized and ensuring that the survey is always anonymous can help improve response quality.
Including an option like “prefer not to say” when asking personal questions is always recommended.
Furthermore, it’s important to interpret survey results with caution, taking into account the limitations and potential biases inherent in the data collection process.
In summary, surveys are powerful tools for gathering information, but it is crucial to be aware of the potential biases and limitations involved in their design and interpretation. Combining survey findings with other research methods can enhance the validity and reliability of the insights gained.
Additional Findings Related to UX:
- Is Coffee stirrer also meant to be a straw ?
Personally, I use a coffee stirrer as a straw as well, but apparently, it was never intended to be used in that way.
This sentence expresses the personal habit of using a coffee stirrer as a straw, despite the fact that it was not originally designed for that purpose. The word “apparently” suggests that the information about its intended use comes from external sources or general knowledge, indicating a contrast between personal usage and the intended purpos
2. Canva: Missing Appropriate Feedback
The dot is meant to disappear when the message is viewed by the user. However, it only disappears when I reload the page, which makes me think that the developers haven’t been mindful about the feedback or that it could be considered a very low priority on the business level and thus ignored.
