AI with Michal

Interview kit

A structured packet distributed to every interviewer before the first conversation with a candidate, containing assigned competencies, behavioural questions, and a shared rating rubric so the panel evaluates consistently.

Michal Juhas · Last reviewed June 16, 2026

What is an interview kit?

An interview kit is the structured guide a recruiter distributes to every member of the interview panel before the first candidate conversation. It assigns competencies, questions, and rating scales to each interviewer so the panel covers the full requirements without duplicating effort or accidentally skipping what matters most.

Without one, every interviewer decides independently what to probe. Debriefs become a comparison of personal impressions rather than a shared evaluation against the same criteria. With one, the conversation in the debrief starts from a scorecard instead of from feelings.

Interview kits connect directly to the scorecard and are usually stored inside the ATS, in a shared doc, or in a dedicated interview intelligence tool. They are most valuable when paired with a calibration session at the start of a search so the panel agrees on what "good" looks like before anyone meets a candidate.

In practice

  • A recruiter builds a five-competency kit for a senior product manager role, assigns two competencies to the engineering lead and three to the CPO, and sends a pre-brief ten minutes before the panel call to confirm the split.
  • During a debrief, the hiring manager says "she seemed sharp" and the recruiter pulls up the kit: the sharp impression was not backed by a rating on the problem-solving rubric because the hiring manager ran out of time for that section.
  • An HR team discovers that one hiring manager who conducts 20 interviews a year has never received a kit, explaining why their offer acceptance rate is 20 points below the company average.

Quick read, then how hiring teams use it

This is for recruiters, HR partners, and anyone who coordinates interview panels. Skim the first section for the shared definition. Use the second when you are setting up kits in your ATS or coaching a panel for the first time.

Plain-language summary

  • What it means for you: A kit is a packet that tells each interviewer exactly which questions to ask and what a good answer looks like, so the debrief is evidence-based rather than a gut-check.
  • How you would use it: Build a kit for each role family, not each individual role. Customise the competency weights for seniority, but reuse the question bank and rubric structure.
  • How to get started: Start with your three most common role types. Write two behavioural questions per competency, define two observable anchors (meets bar, does not meet bar), and pilot with one panel before refining.
  • When it is a good time: Every search, without exception. The return is highest for roles where the panel includes hiring managers who are not trained interviewers.

When you are running live reqs and tools

  • What it means for you: A well-designed kit reduces time in debrief, cuts score variance across the panel, and gives you defensible documentation if a hiring decision is challenged.
  • When it is a good time: Start building kits before sourcing opens so the panel can calibrate on what they are screening for, not after first interviews expose disagreements.
  • How to use it: Use your ATS kit builder (or a shared Notion template) to lock the question set and rubric. Send automatically when an interviewer is added to a stage. Pull completion rates in your ATS to see which interviewers are skipping kit review.
  • How to get started: Audit your last ten hiring decisions. For how many did the panel submit scores before the debrief rather than after? If fewer than half, the kit is not being used as designed.
  • What to watch for: Kits that are built but never reviewed, rating scales with anchors so vague they produce no calibration, and AI-generated question banks that include legally risky questions about employment gaps or family circumstances.

Where we talk about this

On AI with Michal live sessions, interview kits come up in AI in recruiting blocks when participants are designing structured evaluation processes and connecting them to scorecard templates and ATS workflows. The membership community is a good place to share and compare kit templates across industries.

Around the web (opinions and rabbit holes)

Third-party creators move fast. Treat these as starting points, not endorsements, and double-check anything before you embed it in a live hiring process.

YouTube

  • Searches for "structured interview guide" and "interview scorecard design" on YouTube surface practitioner walkthroughs on building question banks and rubrics for consistent hiring.

Reddit

  • r/recruiting has threads on how to introduce structured interviews to hiring managers who resist the process and on which ATS platforms have the best kit builders.
  • r/humanresources includes discussion on legal requirements for interview documentation and how kits factor into adverse impact analysis.

Quora

  • Searches for "how to build an interview guide for hiring" on Quora collect a range of practitioner answers on question design, rubric calibration, and panel coordination.

Related on this site

Frequently asked questions

What is an interview kit?
An interview kit is a structured packet distributed to everyone on the interview panel before the first conversation with a candidate. It contains role-specific competency areas, the questions each interviewer is assigned to probe, a shared rating rubric (usually a four-point scale anchored with observable behaviours), and any background context the panel needs (seniority expectations, scope, must-haves versus nice-to-haves). The goal is to prevent interviewers going in cold and improvising questions that overlap, miss key competencies, or stray into legally risky territory. ATS platforms like Greenhouse and Lever have native interview kit builders; many teams build theirs in Notion or a shared doc tied to the scorecard.
Why do teams without a structured kit produce inconsistent hiring decisions?
Without a shared kit, two interviewers decide independently what matters and compare impressions in a debrief with no common scale. One probes communication style, another focuses on a niche technical skill, a third spends the slot on culture fit with no rubric. The result is gut-feel trading in the debrief: 'I liked them,' 'I didn't get a great vibe,' 'they weren't as technical as the last person.' None of those signals connect to role requirements. Research on structured interviewing consistently shows higher predictive validity and lower bias compared to unstructured conversation. A kit is the minimum structure needed for a calibration session to produce an evidence-based decision.
How do you build an interview kit from a competency framework?
Start with the competency framework for the role, then pick three to five competencies the hiring manager and recruiter agree are the real differentiators at this level. For each competency, write two to three behavioural questions (starting with 'Tell me about a time when...') and define observable anchors for a 1 (did not demonstrate) through 4 (strong evidence) scale. Assign one or two competencies per interviewer so the panel covers the whole kit without duplication. Review the anchors in a brief pre-panel call, not during the debrief when everyone already has formed opinions. See job description bias detection for a parallel step that removes loaded language from the role requirements before the kit is built.
Can AI generate interview kits?
AI models can draft a first-pass interview kit from a job description in under two minutes. In live sessions at AI with Michal, we paste the JD and scorecard into a prompt, ask Claude or ChatGPT to suggest competencies, questions, and rating anchors, then review the draft with a recruiter before it reaches a panel. The output needs expert review: models suggest legally risky questions or competency labels too broad to measure reliably. Use few-shot prompting with examples from past kits you trust. A human-in-the-loop checkpoint with HR sign-off is non-negotiable before sharing with interviewers, especially in organisations where employment lawyers review interview materials.
What should a good interview kit include?
A well-built kit has five components: (1) role context (scope, level, three success metrics at 12 months); (2) a competency map assigning each competency to one interviewer; (3) behavioural questions for each competency, two to three per section; (4) scoring rubrics with observable anchors at each level, not vague adjectives like 'strong' or 'weak'; and (5) a debrief guide noting when and how the panel submits scores before discussion opens. Debrief timing matters: if interviewers hear each other's scores before submitting their own, groupthink anchors the room. Add a one-page list of legally risky topics to avoid, especially if the panel includes hiring managers who have not been recently trained.
How do you stop interviewers from going off-script?
You cannot fully prevent it, but you can raise the cost of deviation. Send the kit three to five days before (not 30 minutes before) so interviewers can actually read it. Hold a ten-minute pre-brief before the candidate joins to clarify who covers which competency. Use a shared debrief form instead of a verbal round-table: submitting a score forces interviewers to reference their own notes. Debrief the debrief after decisions to spot patterns, such as a panel member who never flags anyone or flags everyone. See panel debrief alignment for how to run the debrief itself.

← Back to AI glossary in practice