Category: Research

  • Agent-Based Modeling and Surveys: A Detailed Guide

    Imagine you have just completed a large-scale survey. The data looks promising, with clear trends, clean charts, and useful quantitative insights. Then a question comes up: what happens next? Will respondents actually behave the way they said they would? What if their circumstances change, a new competitor enters the market, the government changes, or a…

  • What Is Telescoping in Survey Research?

    What Is Telescoping in Survey Research?

    Have you ever been asked, “When was the last time you visited the dentist?” or “How many times have you gone to the gym this year?” Unless you keep detailed records, you probably didn’t know the exact answer. You made an educated guess based on what you could remember. That’s normal. Human memory doesn’t record…

  • How the Dunning-Kruger Effect Skews Self-Assessment Surveys

    How the Dunning-Kruger Effect Skews Self-Assessment Surveys

    When people in a group are asked to rate their own driving ability, most of them rate themselves as better than average. That can’t be true for everyone, since some people must be below average, yet very few people place themselves there. The least skilled drivers are often among the most confident. This pattern isn’t…

  • Approval Ratings: How They’re Measured and Interpreted

    Approval Ratings: How They’re Measured and Interpreted

    The Gallup Organization began measuring approval ratings in the late 1930s to gauge how much public support a president had for the way he was doing his job. Approval rating surveys measure public evaluations of a politician, institution, policy, or public figure, as well as judgments on public issues. Ratings rise and fall with the…

  • Stay Interviews: The Conversation That Prevents an Exit Interview

    Stay Interviews: The Conversation That Prevents an Exit Interview

    What Is a Stay Interview? A stay interview is a periodic, structured one-on-one conversation between a manager and an employee. Its purpose is to find out why the employee chooses to stay with the organization and what might eventually cause them to leave. Stay interviews show organizations what they are doing right, where they are…

  • Criterion Validity Explained for Survey Researchers

    Criterion Validity Explained for Survey Researchers

    You have a number from a survey. How can you be sure that number means anything? Take two surveys that both measure employee engagement. Each asks new employees to rate how engaged they are on a scale of 1 to 10. Both produce clean charts and statistics that appear to support conclusions about employee engagement.…

  • Psychological Reactance: Why Required Fields Make People Rebel

    Psychological Reactance: Why Required Fields Make People Rebel

    When you make a survey question required and look at the results, you’ll notice that some people answer it thoughtfully. Others type “N/A,” mash their keyboards, or enter false information just to get past the question and out of the survey. They were told the information was required, and some part of them pushed back…

  • The Wisdom of Crowds: When Averaging Survey Guesses Beats the Experts

    The Wisdom of Crowds: When Averaging Survey Guesses Beats the Experts

    Wisdom of crowd or wisdom of the majority according to Wikipedia expresses the notion that the collective opinion of a diverse and independent group of individuals rather than that of a single expert yields the best judgement. Wisdom of crowds does not mean crowds are more intelligent than experts, rather it works best when the…

  • The Third-Person Effect: Why Everyone Thinks Ads Work on Other People

    The Third-Person Effect: Why Everyone Thinks Ads Work on Other People

    Do you think other people are more influenced by advertising and media messages than you are? This belief illustrates the third-person effect, a psychological phenomenon in which people tend to believe that media messages influence others more strongly than they influence themselves. Although people may recognize that advertising, news, and persuasive messages affect others, they…

  • Agent-Based Modeling and Surveys: A Detailed Guide

    Imagine you have just completed a large-scale survey. The data looks exciting. Clean lines, sharp charts, solid quantitative insights. Then a question pops into your head. What happens next? Will respondents actually act the way they described? What if their conditions change? What if a new competitor springs up, a government changes, or a policy…