Document the resources, timeline, and milestones needed to complete validation.
Verifies assessments can separate performers from nonperformers.
Establishes the percentage of students that must pass the assessment for each objective.
Verifies that all course/courseware materials and supporting documentation are Doctrinally and technically accurate and complete.
To uncover unanticipated problems with the Content, Training materials, Delivery or timing of the instruction.
Verifies that the training materials and instruction enable the students to achieve the standard.
Process that examines the effectiveness of the training provided. | Certifies the training provided enables students to reach the required outcomes.
Fixed Sample Chart
After determining the mean score for each objective, use the Fixed Sample Chart to determine the Criticality Standard for the objectives.
- Soldiers could be unprepared for their job and the operational environment.
- Validation depends on the assessments’ ability to measure standards accurately, fairly, and consistently.
- Provides a number to certify that the training materials enable students to reach the standard.
- If a criticality standard is not met, the materials must be revised.
- Who, when, and how the data needed to make the certification will be collected, adjudicated, and documented.
- Increases the likelihood that the materials represent the current job environment
- Failing to vet materials means student learning will be affected by poor training materials.
- Provides quantitative information on the validity of the training.
Identify the number of performers who passed the test.
Identify the number of nonperformers who passed the test.
Subtract the number of nonperformers who passed the test from the number of performers who passed the test.
Divide the answer obtained above by half of the TOTAL number of performers and nonperformers who took the test.
Assume a group of 6 performers and a group of 6 nonperformers took the test.
All 6 performers passed the test. Only 1 nonperformer passed the test
Calculating the Phi Coefficient
Round the answer to the nearest hundredth place (two decimal places).
INDIVIDUAL TRIAL METHODS
- Evidence test questions are suitable for their intended purpose.
- Questions are correct and adequately measure the standards of the objectives.
- Document results/findings on an MFR and maintain on the ADDIE SharePoint site.
- A rubric possesses content validity when a group of content SMEs have verified:
- The performance criteria (rubric rows) are the most important indicators of success.
- The performance descriptors (rubric columns) distinguish between levels of performance.
- Multiple instructors can use the same rubric and come to the same conclusion about a student.
- No single numerical formula for validating a rubric.
- Establishes that instructors will come to a reasonably close score using the rubric.
- Process resulting in a numerical outcome that can be compared to a standard.
- Uses the phi coefficient to express the relationship between scores and criterion measures.
Student's & Instructor's
follow the same process.
Review Board usesa different process.