Guide
Award Score Audit Checklist Before Finalist Selection
Check review coverage, rubric calculations, recusals, and score corrections before your chamber or nonprofit committee uses award rankings to select finalists.
What is an award score audit?
An award score audit is an administrative check of the review records and calculations behind a ranking. It asks whether eligible entries received the required reviews, the correct rubric was used, conflicts were handled, and any corrections can be explained. It does not ask staff to replace a judge's assessment with the score they would prefer.
Run the check after the scoring deadline and before circulating finalist rankings. Name an audit owner and a second person to verify corrections. For a small chamber or nonprofit program, these can be two staff or committee members without conflicts in the affected category. Keep an untouched copy of the original results in your approved records location.
The checklist below is a suggested operating procedure. Adapt it to the rules announced for your program; the sample review counts and scoring weights are examples, not universal requirements.
Award score audit checklist
Work by category and submission ID so similar names or different category rubrics do not hide errors. Record a pass, an open issue, or an approved exception for each check.
| Check | Evidence to inspect | If the check fails |
|---|---|---|
| Eligible review set | Submission IDs, categories, eligibility decisions, and withdrawals | Separate withdrawn or ineligible entries from the ranking; retain the reason. |
| Completed review coverage | Expected versus completed, non-conflicted reviews for every entry | Arrange missing reviews under the assignment policy or record the authorized exception. |
| Correct rubric | Category, criterion scale, weights, and rubric version | Identify every affected review before deciding how to correct it consistently. |
| Valid criterion values | Blank fields, out-of-range values, and allowed not-applicable responses | Ask the reviewer to complete or clarify the record; do not silently enter a zero. |
| Calculation accuracy | A recomputed weighted score and category aggregation rule | Correct the calculation for the entire affected set and verify it independently. |
| Conflict exclusions | Recusal decisions and the reviews included in each total | Exclude a recused review under the policy and check replacement coverage. |
| Unusual score differences | Criterion-level differences and evidence-based reviewer notes | Request clarification without asking judges to converge on a preferred score. |
| Release readiness | Correction log, unresolved issues, tie rules, and approver | Hold the affected category until its results are usable under the program rules. |
Recompute one result before trusting the ranking
Suppose a category uses a 1–5 scale with impact weighted at 50%, leadership at 30%, and innovation at 20%. A review with scores of 4, 3, and 5 produces (4 × 0.50) + (3 × 0.30) + (5 × 0.20) = 3.9 out of 5. If the program expresses that result as a percentage of the maximum, it is 78 out of 100. This conversion gives the lowest possible score 20 out of 100; it does not create a scale whose minimum is zero.
Recompute a result for each distinct category rubric and aggregation method, plus every result affected by a detected error. If a category averages three complete review totals of 3.9, 4.2, and 3.6, the entry average is 3.9. A missing third review is neither a zero nor a completed review: an average of the two available reviews still has a coverage problem if three were required.
Use the published rule for not-applicable criteria. Silently redistributing their weight changes the calculation. Check the precision used to order results before applying the published tie rule; two displayed scores rounded to 3.9 may differ in the underlying values. The scoring matrix template provides a starting structure for these checks.
Resolve audit findings in a controlled sequence
- 1
Save the original result set
Record the program, category, export or snapshot time, rubric version, and review deadline. Restrict access to the people who need the records. Keep later corrected copies distinguishable from this baseline.
- 2
Classify the issue
Separate incomplete coverage, a data-entry mistake, a calculation defect, a conflict, and a difference in judgment. Name the affected submission and review IDs and the rule that determines the next step.
- 3
Obtain the appropriate correction
Ask a reviewer to confirm a suspected entry mistake without showing a target ranking. Have an authorized administrator correct a formula error. Handle replacement reviews under the existing assignment and conflict rules, with the same evidence and rubric.
- 4
Recheck all affected results
Apply a shared calculation fix to every record it affects, not just entries near the cutoff. Have the second checker verify the before-and-after values, review coverage, and any ranking movement.
- 5
Approve the category for committee review
Attach the audit status, correction log, remaining exceptions, and approval date to the committee materials. If results are still incomplete, label them provisional and keep them out of finalist announcements.
A sample score correction log
Use these fictional examples as a record format. Store the log with restricted program records; do not include private reviewer details in public finalist materials.
| Record and finding | Action and evidence | Verification and release status |
|---|---|---|
| Entry A-014, review R-08: impact entered as 2; reviewer reports a typing error | Keep the original value and reviewer confirmation; authorized correction changes 2 to 4 | Second checker verifies recalculation and ranking impact; record names and dates. |
| Entry A-022: two of three required reviews complete | Assign an eligible backup reviewer using the same submission evidence and rubric | Hold until the third review is complete and coverage is checked. |
| Category B: calculation uses a 40% impact weight instead of the approved 50% | Correct the formula for every affected record against the approved rubric | Independently verify revised totals; replace earlier committee copies with the corrected version. |
Investigate score outliers without rewriting judgment
A low or high score is a prompt to inspect the evidence, not proof of an error. Ask whether the reviewer used the right criterion, saw the complete submission, and can explain the score against the rubric. A well-supported dissenting score can remain valid even when other judges disagree.
Do not delete an inconvenient review, invent a new normalization method, or change weights after seeing who benefits. If the written rules leave a serious process problem unresolved, pause the affected category and obtain a documented decision from the authorized, non-conflicted program owner. Explain the treatment consistently for all affected entries.
Once the records are ready, move to finalist selection and the committee packet. Passing an audit confirms that the checks are complete; it does not guarantee that every judgment is free from bias or make the ranking an automatic winner decision.
Award score audit questions
Should staff fill a missing judge score with zero?
No. A missing review is a coverage issue. A zero changes the result and may be outside the rubric scale. Obtain the required review or document an exception authorized under the program rules before releasing the category.
Can a judge correct a score after the deadline?
Use the program's correction policy. Where corrections are permitted, retain the original score, the reviewer's reason and confirmation, the authorized change, and the verification record. Apply the same opportunity and limits to comparable cases; do not reopen scoring to favor a preferred finalist.
Does the committee need to see every audit detail?
Give the committee the review counts, audit status, material corrections, unresolved exceptions, and any effect on rankings. Keep sensitive reviewer information in restricted records and share it only with authorized people who need it to resolve a decision.
Is an audit the same as judge calibration?
No. Calibration establishes shared rubric expectations before live scoring. An audit checks the completed records and calculations before decisions. Both can help a program, but an audit should not become a late exercise in making every judge agree.
Next step
Put this process into a working awards workspace.
ChamberPages Awards Manager connects public forms, categories, reviewer assignments, scoring, reminders, finalist review, and committee packets so the process stays organized from intake to decision.