Set up AI scorecards and candidate scoring

Hirevire scores candidates in two ways: AI Scorecards that generate weighted factors from interview answers and candidate evidence, and must-have / good-to-have criteria for standard questions. You can also turn on Auto-disqualify Applicants so candidates who miss must-have criteria stop before media questions.

Use this guide to pick the right method, set it up, and know when scores appear after you save.

Choose the right scoring method

Pick the method that matches the questions you need to evaluate.

Set up an AI Scorecard

Create a scorecard from the job’s AI Scorecard tab so new interview answers and candidate evidence can be scored automatically.

Open the scorecard builder

1. Open the job and go to Settings.

2. Select the AI Scorecard tab.

3. Choose how to start:

   • Use a Template — pick a pre-built scorecard, then customize factors

   • Upload Rubric — upload a text rubric for Hirevire to parse into factors

   • Generate using AI — create a tailored scorecard from the job and its questions

In the Use a Template picker, the Search by role, skill or keyword field matches template names, tags, and descriptions case-insensitively and shows the number of matching templates. Filter by category accepts multiple categories at once and shows templates matching any selected category, with filter chips, the active filter count, and Clear all and Clear filters controls to reset. Grid view and List view switch the layout, your chosen view is kept for future visits, and the picker shows No templates match your search when nothing matches.

If the job has no questions, the builder is empty until you add one. All active primary question types can be associated with scorecard factors.

Choosing Generate using AI creates a draft with 2–6 assessment factors, each linked to the questions it evaluates. Review the draft and save it to apply it to the job.

Add and edit factors

Each factor is one evaluation dimension the AI scores on a 1–5 rubric.

1. Select Add new factor (or edit an existing factor).

2. Fill in:

   • Name of factor

   • Description / Purpose

   • Indicators (What to look for)

   • Scoring Rubric (1-5 Scale) — criteria for scores 5 through 1

   • Color for the factor badge

3. Set Factor weightage for final score so all factors total 100%.

You cannot remove the last remaining factor. After a template is applied, use Change Template if you need a different starting point. If you already saved scorecards, you can also open Saved Scorecards from the template picker.

Associate factors with questions

Every factor must be linked to at least one question before you can save. The association table lists the job’s active primary questions across all question types, plus candidate resume evidence.

1. In the Associate Factors with Questions table, check the factor columns for each question the AI should evaluate.

2. Map multiple factors to one question, or one factor across several questions, as needed.

If a factor has no question link, save shows: Please associate at least one question with each factor.

Turn on automatic scoring and save

1. In Credit Usage, turn on Automatically score applications if you want new applications scored without a manual step.

2. Optional: turn on Set spend limit on credits for this job and enter a credit limit. When the limit is reached, you are notified and automatic AI reviews pause until the next cycle.

3. Select Save.

Save succeeds only when the scorecard has at least one factor, every factor is linked to a question, and total weightage is exactly 100%. On success, Hirevire confirms the scorecard was saved.

Set up must-have and good-to-have scoring

Score standard question answers from the job editor Scoring step.

Enable scoring

1. Open the job in the job editor (or create a new job).

2. Add at least one standard question on the questions step if you have not already.

3. Go to the Scoring step.

4. Turn on Enable Scoring for Standard Responses.

If the job has no standard questions, the criteria list shows No standard response questions found. Video, audio, file upload, and screenshare answers are not scored here.

Add criteria to a question

1. In the scoring table, set the question’s impact to Must have or Good to have (or None to leave it unscored).

2. Select Add conditions (or Edit if conditions already exist).

3. Choose an operator and value:

   • = equals / ≠ doesn't equal

   • > is more than / >= is at least (more than or equal to)

   • < is less than / <= is upto (less than or equal to)

   • <> is between (two values)

   • ∋ contains / ∌ doesn't contain

   • ✓ is set / ✕ is not set

4. Save the condition.

Must have is pass or fail: the candidate meets the condition (100%) or does not. Use it for dealbreakers such as location, authorization, or required qualifications.

Good to have uses tiered condition scores shown as percentages (25%, 50%, 75%, or 100%). Use it for preferences such as years of experience.

How contains matching works

The contains operator looks for a literal substring match and is case-insensitive.

• The candidate answer must include the exact phrase you enter.

• Special characters matter (Impact and Urgency does not match Impact & Urgency).

• You can provide multiple values where the condition UI allows multi-select for contains / doesn't contain.

Auto-disqualify applicants

Turn on Auto-disqualify Applicants on the same Scoring step so candidates who miss must-have criteria stop early.

Before you enable it

Auto-disqualify is available only when both are true:

• Enable Scoring for Standard Responses is on

• At least one standard question is set to Must have

Without a must-have question, Hirevire shows: Add at least one must-have question to enable disqualification.

Turn it on

1. On the job editor Scoring step, enable standard scoring and add at least one Must have rule.

2. Turn on Auto-disqualify Applicants.

3. Save the job.

After save, customize the thank you page and disqualification email in job settings so disqualified candidates get the right message.

During the application flow, Hirevire checks the candidate’s must-have score against the job’s disqualification threshold. Unless a different threshold is configured for the job, that threshold is 100, so candidates need a full must-have score to continue.

If the candidate is below the threshold, Hirevire:

• Marks the application Disqualified

• Submits the application in that state

• Sends the job’s disqualification email

• Stops the candidate before media questions

You can still open the Disqualified application later. Auto-disqualification only applies to applications evaluated after you save the job with the setting on.

When scores appear and what changes after save

Scores are generated for applications handled after your configuration is saved—not as a full re-score of past applicants.

• AI Scorecards: New applications are scored when a scorecard exists and Automatically score applications is on. Media answers are scored from their transcripts when a transcript is available—turn on AI transcripts for the job so those answers can be scored—and file answers are scored from their extracted text. Changing the scorecard later does not automatically recalculate existing AI scores.

• Must have / Good to have: Criteria are evaluated on standard answers during the application flow for applications handled after you save.

• Auto-disqualify: Only applications evaluated after you save with the toggle on are stopped early.

AI scorecard runs use AI credits. The scorecard Credit Usage panel shows credits used and credits available. If credits run out, scoring can fail with Not enough credits. See AI Credit Consumption for Candidate Responses and How to Purchase Additional AI Credits.

How AI Scorecards evaluate candidates

AI Scorecards evaluate a candidate's answers by reading the relevant evidence against the rubric you set up for the role. Video and audio answers are scored from their transcripts, screen recordings from their transcripts, and files from their extracted text — not from the video, images, or on-screen visuals, so there is no facial or body language analysis. Each candidate gets a weighted score plus a short explanation tied to each question.

The AI never rejects a candidate on its own; it supports your team's review. We power AI Scorecards with the OpenAI API, and per OpenAI's API terms your data is not used to train their models.

Review candidate scores

Open the job’s applications list or an individual application to read scores.

On the applications list

Application cards can show Must have, Good-to have, and AI score when those values exist.

On the application detail page

Open a candidate to see:

• AI Score — overall score out of 5, with expandable factor rows, feedback, and question references

• Must-have and good-to-have condition results on the standard answers

• Disqualified status when auto-disqualification applied

AI Scorecards help prioritize review; they do not replace a hiring decision. For how AI review relates to transcripts and other analysis, see Understanding Hirevire's AI Review Process: Video Analysis and Beyond.

Troubleshooting

Related articles

• Configure Scorecard Weightage

• How to edit questions in a job post

• Add more details to each question

• Modify the automated email sent on a successful application

• AI Credit Consumption for Candidate Responses

• Understanding Hirevire's AI Review Process: Video Analysis and Beyond