Structured Interviews: The Research Behind Better Hires

Every hiring manager has a story about the candidate who interviewed brilliantly, got the job, and then failed to deliver. The reverse happens too: quiet, unassuming candidates who turn out to be exceptional performers. What separates good hiring decisions from bad ones is not intuition. It is structure. Decades of research in industrial-organizational psychology have reached a remarkably consistent conclusion: structured interviews outperform unstructured ones in predicting job performance, reducing bias, and creating fairer outcomes for candidates.

What is a structured interview?

A structured interview is defined by four core elements: every candidate is asked the same questions, in the same order, with the same time constraints; responses are evaluated against a pre-defined scoring rubric; and interviewers are trained to minimize deviation from the protocol. This sounds rigid because it is. The rigidity is what makes it work.

In contrast, unstructured interviews resemble casual conversations. The interviewer might ask different questions of each candidate, follow tangents that interest them, and form impressions based on personality or rapport rather than job-relevant competencies. These interviews feel natural and often enjoyable. They are also poor predictors of anything that matters for job performance.

The Schmidt and Hunter landmark

In 1998, Frank Schmidt and John Hunter published a meta-analysis that remains the most-cited work in personnel selection research. They synthesized decades of studies to measure the predictive validity of various hiring tools — how well each tool predicts future job performance. Their findings were stark.

Unstructured interviews showed a predictive validity of roughly 0.38 on a scale where 1.0 is perfect prediction. Structured interviews, by comparison, scored 0.51. That gap may seem small, but at the scale of a hundred hires, it is the difference between a team that performs and one that stagnates. To put this in context, unstructured interviews are barely better than handwriting analysis. Structured interviews outperform years of job experience as a predictor.

Since then, subsequent meta-analyses have confirmed and refined these findings. The 2009 study by Levashina et al. found that structured interviews reduce racial and gender disparities in ratings by constraining interviewer latitude. When everyone is asked the same questions and scored on the same criteria, there is simply less room for unconscious bias to steer decisions.

Why intuition fails

Human beings are excellent at pattern recognition and terrible at probabilistic reasoning. An interviewer who has hired dozens of engineers over the years develops a sense of what a "good" candidate feels like. But that sense is shaped by confirmation bias, availability bias, and the specific culture of the organizations where they learned their craft.

Research by Dana, Dawes, and Peterson in 2013 demonstrated that experienced hiring managers who were allowed to use their intuition after a structured interview actually made worse decisions than those who followed the rubric alone. The structured data was predictive. Their subjective overlay introduced noise and degraded accuracy. Experience does not automatically translate to better judgment in interviewing.

This is not to say that human judgment has no role. The rubric itself must be designed by people who understand the role. The questions must be relevant. The scoring criteria must reflect what actually drives success. But once those parameters are set, deviation from the protocol is not a sign of sophisticated judgment. It is a well-documented source of error.

Behavioral vs. situational questions

Within structured interviews, two question types dominate the literature. Behavioral questions ask candidates to describe past experiences: "Tell me about a time you had to deliver bad news to a client." Situational questions present hypothetical scenarios: "Imagine a client is threatening to cancel. What do you do?"

Both formats have strong validity when scored with rubrics. Behavioral questions may have a slight edge for experienced candidates who have relevant past experiences to draw on. Situational questions can be more equitable for early-career candidates or career switchers who have fewer direct precedents. The key is not which format you choose, but that you choose one, define the criteria for a good answer, and apply it uniformly.

Building a rubric that works

A good scoring rubric has three properties. It is criterion-based: anchored to observable behaviors rather than vague impressions. It is calibrated: tested across multiple interviewers to ensure different people score the same response similarly. And it is job-relevant: tied to competencies that actually predict performance in the target role.

Most teams fail on at least one of these dimensions. Rubrics are often written in a single afternoon by the hiring manager alone, without input from the team or validation against past hires. The result is a document that feels structured but is no better than intuition. Time invested in rubric design pays off disproportionately.

One practical approach is to start with your top and bottom performers from the past year. What did the best people do differently? What behaviors did the struggling hires lack? Those differences are the seeds of your rubric. Then, before you use it live, have multiple interviewers score the same recorded responses and compare results. If two qualified interviewers give wildly different scores to the same answer, your rubric needs work.

The role of async video in structured hiring

Structured interviews have traditionally been hard to scale. Live interviews require trained interviewers, scheduling coordination, and significant time investment. The result is that many teams abandon structure as volume increases, reverting to informal conversations or resume screening alone.

Async video changes the economics. Candidates record responses to structured questions on their own time. Reviewers evaluate those responses against a shared rubric, at their own pace, with calibration tools built in. The structure is not only preserved; it is enforced. Every candidate answers the same questions. Every reviewer sees the same responses. The barriers to doing structured well at scale drop dramatically.

Research on video-based structured interviews is still emerging, but early findings are consistent with the broader literature. Candidates perform similarly on structured questions regardless of whether the interview is live or recorded. Reviewers show comparable reliability. And candidates often prefer the async format because it removes scheduling friction and reduces performance anxiety.

What this means for your next hire

The evidence is not ambiguous. If you want to hire better, you need structure. Not structure for its own sake, but structure as a container for the human judgment that already exists in your organization. A good rubric captures what your best people know intuitively and makes it available to everyone on the team.

Start small. Pick one role. Define three to five competencies that matter most. Write behavioral questions that probe each competency. Build a 1-to-5 rubric with behavioral anchors. Train two interviewers and compare scores. Refine and repeat. Within a few hiring cycles, you will have a process that is not only more predictive but also more defensible, more equitable, and faster to execute.

The teams that get this right will pull away from those that don't. Not because they have better intuition, but because they have better systems. That is what the research has been telling us for decades. The only question is whether we choose to listen.