Abstract
Field Computer-implemented systems for identifying which employees require requalification after authoritative document updates by administering updated assessments and comparing scores against historical performance, rather than tracing document changes to employees through section-level attribution records. Background When a reference document is updated, one approach maps the changes to the specific document sections each employee was previously assessed on, then targets requalification to only those employees whose assessments covered changed sections. The approach described here takes a different path entirely: instead of analyzing what changed in the document and tracing it back to employees, it generates a new assessment from the updated content, administers it, and lets the score comparison identify who is affected. Technical Description When the system detects an updated version of an authoritative reference document, it triggers the following sequence. A question generation module creates a new assessment instrument from the updated document content. The generation can use template-based extraction (identifying key facts and generating questions from templates) or language-model-based generation (prompting an LLM to produce questions covering the document's main points). The new assessment is tagged with the document_id and version. The new assessment is administered to all employees currently holding active certifications for that document. Each employee's responses are collected, scored, and stored alongside their historical score from the prior version's assessment. A score comparison engine computes, for each employee, the delta between their new-version score and their prior-version score. Employees whose score declines by more than a configurable threshold (default: 15 percentage points) are flagged for requalification. The requalification assignment is scoped to the specific assessment items the employee answered incorrectly on the new version, not the full document. Employees who score above the threshold on the new assessment are recertified with an updated certification timestamp and the new document version. The system stores a requalification record containing: employee_id, document_id, old_version, new_version, old_score, new_score, score_delta, flagged_item_ids, and requalification_status. Distinguishing Characteristics This system does not maintain source-attribution records binding assessments to document sections. There is no reverse-index traversal from changed sections to impacted employees. There is no section-level semantic differential computation. Impact determination is empirical (measured by re-testing) rather than analytical (computed by tracing attribution records). The system also does not simply invalidate all credentials linked to the changed document. It re-tests and uses score regression as the targeting mechanism, which is distinct from both section-level attribution and document-level binary invalidation.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
Davis, Kenneth, "Comparative Quiz Score Regression for Document-Change-Triggered Employee Requalification", Technical Disclosure Commons, (March 25, 2026)
https://www.tdcommons.org/dpubs_series/9631