Evaluate Water Quality Analyst candidates across 4 weighted areas: technique and experimental design, results that went somewhere, troubleshooting and reproducibility, and documentation and collaboration. Technique and experimental design leads at 35%, so check which Standard Methods and EPA procedures they run unsupervised: 200.8 metals by ICP-MS, 300.1 anions by. Use the rubric to compare role-specific evidence consistently.
For technique and experimental design, look for evidence the candidate names specific methods with MDL/MRL figures, digestion or dilution steps, and calibration criteria they set up themselves rather than inherited. For results that went somewhere, look for evidence the candidate cites datasets that triggered a real action: a boil notice, coagulant dose change, permit exceedance report, or corrected sampling site.
Apply the written 1–5 anchors to every answer, record the evidence behind each rating, and use the factor weights to reach a consistent overall assessment.
Complete evaluation framework
What to assess and how to score it
Review the evidence signals before interviewing. Then use the anchored descriptions—not instinct alone—to choose the score that best matches each answer.
01
Evaluation factor
Technique and experimental design
35% weight
Check which Standard Methods and EPA procedures they run unsupervised: 200.8 metals by ICP-MS, 300.1 anions by IC, BOD, turbidity, Colilert coliform, plus holding time and preservation rules.
Evidence to listen for
Runs the assays and instruments themselves rather than describing what a team does
Designs experiments with controls, replicates, and a stated hypothesis
Knows what each technique can and cannot resolve
Understands the science, not only the protocol
Five-point scoring guide
1
Poor
Protocol follower with no experimental design; cannot justify controls.
2
Needs Improvement
Runs standard assays; designs experiments poorly or not at all.
3
Satisfactory
Competent at the bench with sound routine design.
4
Very Good
Designs rigorous experiments and understands the limits of each technique.
5
Excellent
Names specific methods with MDL/MRL figures, digestion or dilution steps, and calibration criteria they set up themselves rather than inherited.
02
Evaluation factor
Results that went somewhere
25% weight
Probe sampling programmes they supported: SDWA compliance monitoring, wastewater NPDES permits, lead and copper sampling, and what regulator submission or treatment change their data drove.
Evidence to listen for
Names projects where their results changed a decision, a process, or a product
States their own contribution rather than the group's
Has taken something from bench to a larger scale, a filing, or a publication
Knows what happened to the work after they handed it over
Five-point scoring guide
1
Poor
No results that went anywhere; work is entirely exploratory.
2
Needs Improvement
Contributed to projects but cannot say what their data changed.
3
Satisfactory
Real contributions; outcomes described loosely.
4
Very Good
Names results that changed a decision, with clear personal scope.
5
Excellent
Cites datasets that triggered a real action: a boil notice, coagulant dose change, permit exceedance report, or corrected sampling site.
03
Evaluation factor
Troubleshooting and reproducibility
25% weight
Test how they chase bad data: failing spike recoveries, drifting internal standards, high field blanks, carryover on the IC, and duplicate RPD outside control limits.
Evidence to listen for
Treats a failed run as information rather than bad luck
Isolates reagent, instrument, operator, and biological causes systematically
Knows why a result failed to reproduce and can say when their own data was wrong
Keeps records good enough to diagnose from months later
Five-point scoring guide
1
Poor
Repeats failed runs unchanged; no diagnostic thinking.
2
Needs Improvement
Troubleshoots by substitution; cannot explain a reproducibility failure.
3
Satisfactory
Solid troubleshooting on familiar assays.
4
Very Good
Systematic isolation of causes, and honest about their own irreproducible results.
5
Excellent
Walks through a specific out-of-control event, isolates the cause (contaminated preservative, worn nebulizer), and describes the reanalysis and corrective action logged.
04
Evaluation factor
Documentation and collaboration
15% weight
Assess chain of custody discipline, LIMS entry, TNI or ISO 17025 accreditation audits they faced, and how they report non-conformances to operators or utility managers.
Evidence to listen for
Keeps records to the standard the setting requires, whether that is GLP, GMP, or a defensible notebook
Writes up so someone else can repeat the work
Works with process, quality, or clinical colleagues rather than in a bench silo
Explains a result to a non-specialist without overclaiming
Five-point scoring guide
1
Poor
Records would not survive audit; work is not repeatable from them.
2
Needs Improvement
Documentation is thin; write-ups need heavy editing.
3
Satisfactory
Adequate records and write-ups; collaboration is limited.
4
Very Good
Audit-standard records and clear communication across functions.
5
Excellent
Describes surviving an accreditation audit with clean records, and flags questionable results to plant staff before they reach the public report.
Evidence-led prompts
Interview questions for a Water Quality Analyst
Use these prompts to surface evidence for the weighted factors above and compare candidates against the same role-specific criteria.
01
Describe your experience with water quality testing methods and instruments.
02
What are the key parameters you monitor in a water quality assessment?
03
Which techniques do you use to detect heavy metals in water samples?
04
Can you explain your process for collecting water samples?
05
Can you give an example of a challenging water quality issue you dealt with and how you resolved it?
