Most hiring teams already believe their interviews are fair and consistent. Most of them are wrong, not because interviewers are careless, but because an unstructured conversation, however well-intentioned, produces genuinely different results depending on who’s asking the questions and how a candidate happens to perform on that particular day. Structured interviews fix a specific, well-documented problem: they replace interviewer-to-interviewer variation with a consistent, comparable, and defensible process.
This guide walks through what a structured interview actually is, why the consistency it enforces matters more than it seems, and how to build one step by step, including a reusable scorecard you can adapt for any role.
Key Takeaways
Structured interviews are measurably more reliable. Research on selection interviews found structured formats reach an inter-rater reliability of about 0.59, compared with 0.37 for unstructured ones.
The core building blocks are competencies, questions, and a scorecard. Each interview question should map to a defined competency, and every answer should be scored against the same criteria.
Different question types serve different purposes. Behavioral, situational, technical, and competency-based questions each test something different, and most well-built interviews use more than one type.
AI can accelerate question and scorecard creation. But the interviewer’s judgment in the room, and how the evidence gets interpreted, still requires a person.
What Is a Structured Interview?
A structured interview is an interview format in which every candidate for a role is asked the same predetermined questions, in the same order, and evaluated against the same defined scoring criteria. It removes the improvisation that characterizes an unstructured interview, where questions and follow-ups vary based on the conversation’s flow and the interviewer’s individual judgment in the moment.
Structured vs. Unstructured Interviews
The difference isn’t just about following a script. It’s about what that script makes possible: comparable data across candidates, and a documented record of why a decision was made.
| Unstructured Interview | Structured Interview | |
| Questions | Vary by interviewer, often improvised | Predetermined, identical for every candidate |
| Scoring | Overall impression, rarely documented | Defined criteria, scored per answer with evidence recorded |
| Reliability | Inter-rater reliability of about 0.37 | Inter-rater reliability of about 0.59 |
| Comparability | Hard to compare candidates fairly across interviewers | Every candidate evaluated against the same standard |
| Legal defensibility | Weak, decisions are hard to document or justify | Stronger, evidence-based record for every decision |
A meta-analysis by Conway, Jako, and Goodman, published in the Journal of Applied Psychology, found this reliability gap consistently across the selection interview research: unstructured interviews averaged 0.37, structured interviews 0.59. In practical terms, two interviewers using an unstructured format frequently reach different conclusions about the same candidate. Two interviewers using a structured format, scoring against the same defined criteria, are far more likely to agree.
Why Consistency Matters
Inconsistency in interviewing doesn’t announce itself. It shows up as a slow accumulation of small differences, one interviewer asking harder follow-up questions of certain candidates, another giving more benefit of the doubt to someone who reminds them of a strong past hire, that never gets audited because there’s no consistent record to audit against. Structured interviews create that record. When every candidate answers the same questions and gets scored against the same criteria, a hiring team can actually compare Candidate A’s problem-solving score to Candidate B’s, rather than comparing two interviewers’ general impressions of two different conversations.
How to Build a Structured Interview, Step by Step
Step 1: Define the Competencies the Role Requires
Step 1: Define the Competencies the Role Requires
Start from what the job actually demands, not a generic list of desirable traits. A support role might prioritize communication and composure under pressure; an engineering role might prioritize problem-solving and technical depth. Three to five competencies per role is usually enough to evaluate meaningfully without making the interview exhaustingly long.
Step 2: Write Consistent Questions Tied to Each Competency
Every question should map directly to one of the defined competencies, and every candidate for the role should be asked the same core questions. Follow-up questions can vary to probe a specific answer, but the initial question set shouldn’t change candidate to candidate.
Step 3: Define Evaluation Criteria for Each Question
Before the interview happens, decide what a strong answer, an average answer, and a weak answer actually look like for each question. Without this step, two interviewers can ask the identical question and still score the same answer completely differently, because “good” was never defined.
Step 4: Build the Scorecard
A scorecard puts the competencies, questions, and evaluation criteria into a single document interviewers can use in real time to record evidence and assign a rating during the conversation, not reconstruct from memory afterward.
Step 5: Document Evidence, Not Just a Score
A rating alone, a 4 out of 5 with no notes, is nearly impossible to defend or compare later. Recording the specific example a candidate gave, briefly, is what makes the score meaningful and gives a hiring team something concrete to discuss if opinions differ.
Step 6: Compare Candidates on the Same Criteria
Once every interviewer has completed a scorecard, the hiring decision is a comparison of documented evidence across the same competencies, not a debate between conflicting general impressions.
A Reusable Interview Scorecard Example
This is a simplified template. Adapt the competencies and questions to the specific role, but keep the structure, competency, question, evidence, rating, consistent.
| Competency | Question Asked | Evidence Observed | Rating (1 to 5) |
| Problem-solving | “Tell me about a time you had to solve a problem with incomplete information. What did you do?” | [Interviewer notes specific example, actions taken, outcome] | |
| Communication | “Describe a time you had to explain something complex to someone without your background.” | [Interviewer notes clarity, structure, audience awareness] | |
| Technical skill | [Role-specific technical question tied to a required skill] | [Interviewer notes accuracy, approach, depth] | |
| Situational judgment | “A customer is upset about a delay that wasn’t your fault. Walk me through what you’d do.” | [Interviewer notes reasoning, prioritization, tone] | |
| Overall recommendation |
Types of Structured Interview Questions
Behavioral Questions
Behavioral Questions
Behavioral questions ask a candidate to describe a specific past situation, built on the premise that past behavior predicts future behavior better than a hypothetical answer does. “Tell me about a time you disagreed with a manager’s decision” is a behavioral question. The STAR framework, Situation, Task, Action, Result, is the standard structure for evaluating the answer.
Situational Questions
Situational questions present a hypothetical scenario and ask how the candidate would respond. “If a client asked you to do something against company policy, what would you do?” tests judgment directly, without requiring the candidate to have already faced that exact situation.
Technical Questions
Technical questions test specific, job-relevant knowledge or skill directly, a coding problem, a case study, a scenario requiring domain expertise. These are most useful for roles where a specific hard skill is non-negotiable.
Competency-Based Questions
Competency-based questions target a named trait or ability explicitly, communication, leadership, adaptability, and can use either a behavioral or situational format. The distinguishing feature is that the competency being tested is defined in advance, and the question is written specifically to surface it.
How AI Can Help Generate Role-Specific Interview Questions
Building a full structured interview kit from scratch, competencies, questions, and scoring criteria for every role a company hires for, is genuinely time-consuming, which is exactly why many teams default back to unstructured conversations under time pressure. AI tools can generate a role-specific starting point directly from a job description: relevant competencies, a matching set of behavioral, situational, and technical questions, and baseline scoring criteria, in a fraction of the time it takes to build one manually.
SmoothHiring’s AI Interview Kit works this way: it generates a standardized set of questions, evaluation criteria, and scoring guidance for a given role directly from the job description, giving a hiring team a structured starting point instead of a blank page. The output still benefits from a quick review, an AI-generated question set is a draft that reflects the job description it was built from, not a substitute for someone who knows the role checking that the right things are actually being tested.
Where Human Judgment Is Still Necessary
Interpreting the answer, not just scoring it. A scorecard structures the evaluation; it doesn’t replace the judgment needed to assess whether an answer actually demonstrates the competency being tested.
Adjusting follow-up questions in real time. A structured interview keeps the core questions consistent, but a skilled interviewer still needs to probe an unclear or incomplete answer.
Weighing evidence against context. A candidate’s best example might come from a very different environment than the role being hired for, and translating that requires judgment a scorecard alone can’t supply.
Reviewing AI-generated content for actual fit. Questions generated from a job description reflect what’s written in that document, not necessarily everything that actually matters for the role, which is why a human review step before the interview stays essential.
Common Mistakes When Implementing Structured Interviews
Treating the question list as a rigid script with no room for follow-up. Structure applies to the core questions and scoring criteria, not to banning every clarifying follow-up.
Skipping the evaluation criteria step. Without a defined sense of what a strong answer looks like, structured questions still produce inconsistent scoring.
Scoring after the fact from memory. Evidence recorded in the moment is far more reliable than an interviewer’s recollection an hour, or a day, later.
Using the same generic questions for every role. A structured interview that isn’t actually tied to role-specific competencies loses most of its predictive value.
Frequently Asked Questions
What is a structured interview?
What is a structured interview?
A structured interview is an interview format where every candidate for a role is asked the same predetermined questions and evaluated against the same defined scoring criteria, removing the variation that comes with an improvised, unstructured conversation.
How do structured interviews work?
They work by defining the competencies a role requires, writing consistent questions tied to each one, establishing what a strong versus weak answer looks like in advance, and scoring every candidate’s answers against those same criteria using a scorecard.
How do you conduct a structured interview?
Ask every candidate the same core questions in the same order, record specific evidence from their answers rather than just an overall impression, and score each answer against pre-defined criteria using a scorecard, allowing clarifying follow-up questions without changing the core question set.
What is a structured interview scorecard?
A structured interview scorecard is a document that lists the competencies being evaluated, the questions tied to each one, space to record evidence from the candidate’s answers, and a rating scale, used by interviewers to score candidates consistently during or immediately after the interview.
What questions should be used in a structured interview?
A mix of behavioral, situational, technical, and competency-based questions, each tied to a specific competency the role requires, tends to give the most complete picture. Which mix to use depends on what the role actually demands.
Can AI create structured interview questions?
Yes. AI tools can generate a role-specific set of questions, competencies, and scoring criteria directly from a job description, giving hiring teams a structured starting point. The output still benefits from a human review to confirm it reflects what the role genuinely requires.
Conclusion
Structured interviews aren’t about making hiring feel more bureaucratic. They’re about replacing a process that quietly varies by interviewer and by day with one that produces comparable, defensible evidence for every candidate. The setup work, defining competencies, writing consistent questions, building a scorecard, pays for itself the first time two interviewers can actually compare notes on the same criteria instead of debating two different impressions of two different conversations.





