Criterion-Referenced Assessment for Pre and Post Measurement

0 Views
What do you think about this article? Rate it using the stars above and let us know what you think in the comments below.
Criterion-referenced tests require clear and measurable instructional or training objectives. A complete instructional or training objective includes: (1) an observable behavior, (2) any special condition under which the behavior must be displayed, and (3) a performance level considered sufficient to demonstrate mastery. An example of a complete instructional objective for an adult basic-skills mathematics program might be, "Given a calculator, the learner will multiply two-digit numbers, correct to the nearest whole number, with a 90 percent level of accuracy." An example of a complete instructional objective for a secretarial writing pro-gram might be, "Given a dictionary, the learner will correct spelling errors in a sample letter of inquiry with a 95 percent accuracy level."

Where criterion-referenced assessment is used, pre- and post-measurement of the skills that are critical to optimal performance is the only concrete way of assessing whether instructional or training programs are making a difference. It is also important for learners to be able to track their own progress. In both program evaluation and learner feedback, the difficulty is always in finding a systematic way to examine key indicators that are valued in optimal performance.

Curriculum-Based Measurement (CBM). Because norm-referenced tests, and sometimes criterion-referenced measures, are intended for broad use, there is still considerable concern over the mismatch between content of such tests and the content of training or instructional programs. It is important to note, however, that standardized tests make no pretense of fitting training or instructional curricula precisely. What kinds of assessment might have a better fit in this respect?



Curriculum-based measurements (CBMs) are repeated measurements of an adult learner's performance on a single global task across time. They offer multiple assessments of adult learner progress toward a long-term course goal specific to mastering a task. CBMs use the specific curriculum provided in a training or instructional setting as the basis for tracking the adult learner's performance on specific desired outcomes. For example, at the beginning of a train-the-trainer program, the adult learner is given a set of questions pertaining to the personal attributes of a good trainer. Using the provided CBM rating scale, they determine their personal understanding of principles critical to the train-the-trainer learning process. At the end of the train-the-trainer course, the adult learner again is assessed using this same CBM. Of critical importance is how well the rating scale tracks post program changes in the degree of individual understanding of train-the-trainer "best training practices."

It is important in CBMs that learners review their performance before each assessment. The goal line, for example, helps learners to monitor their own progress. In addition, progress toward the estimated goal helps instructors make decisions about modifying instruction, changing the level of reading passages, or modifying the goal line.

A CBM that could be applied to a management development program would be to monitor and assess effective communication within a work team by using a two-minute reading/response passage for each participant. This reading passage might be used on a weekly basis and the accuracy of responses calculated.

Participants' progress (accuracy of responses) is graphed. An optimal performance, or goal line, might be determined by using the average of participants' performances on two baseline scenarios and adding a percentage of accurate responses to the score as a target for improvement. It is again important in CBMs that learners review their performance before each assessment to monitor their own progress.

Several factors must be taken into consideration when designing CBMs:
  1. Select tasks that will represent those the adult learner is expected to perform in class/training sessions. Such tasks can be taken directly from sample curriculum materials being used.

  2. Remember that CBMs are timed. Keep the measurement short, for example, one to five minutes. The purpose of the CBM is to track learner performance in multiple tasks over time.

  3. CBMs are most useful when they are given frequently, for example, every other day, or twice a week, depending upon the length of the class/training session. Useful measurement occurs when the measurement task looks and functions like any other class/training session task. In other words learners should not feel like they are taking a test.

  4. CBMs can be normed. Give the same measurement to a sample of five to ten learners identified by the supervisor/ employer as average peers of the learner. Or, if the trainer/ employer wants to compare the learner's performance against optimally desired performance, the five to ten learners might be selected from among top-rated on-the-job per-formers. The performance of this sample of five to ten average or optimal learners sets the baseline for comparison of the individual learner's performance against the norm. 5. The most effective way to represent learner growth is graphically. Norm performance, or goal-related performance, and the learner's actual performance can be charted on a line graph.
Why bother with better assessments? Unfortunately there is a shocking lack of systematic assessment and applied research to enrich our state-of-the-art and best-practice knowledge about workforce education. Research and evaluation data tend to be collected in uneven ways. When programs are evaluated, assessment data are often limited to sketchy descriptions of program components, anecdotal recountings as indicators of effectiveness, questionnaires and surveys of program participants, and incomplete references to learner performance results. Occasionally standardized test results may be provided, but standardized tests are useful indicators of general ability only. They are not specific to program curricula.

Better assessments are built upon three key assumptions. First, assessment is seen as integral to learning. The one-shot notion of assessment celebrated in standardized tests does not fit an emerging developmental and constructivist view of knowledge and understanding. The major purpose of assessment should be to aid learning. Assessment cannot be conceived as a series of discrete milestones but as part of a continuous and coherent learning process.

Second, assessment is linked to outcomes. Learning and understanding go beyond what one knows to what one does with that knowledge. Thus it is important that assessments directly relate to instructional and training objectives. Assessments that reflect specific and explicit criteria for performance, continuous feedback, and self-assessment are more effective in capturing performance of valued outcomes over time.

Third, abilities must be developed and assessed in multiple modes and contexts. Most abilities and the real-life situations in which they are tested are multidimensional and complex. Assessment should provide learners with repeated opportunities to experience, practice, and assess their performance in varied contexts and at varied levels of mastery.
If this article has helped you in some way, will you say thanks by sharing it through a share, like, a link, or an email to someone you think would appreciate the reference.



EmploymentCrossing provides an excellent service. I have recommended the website to many people..
Laurie H - Dallas, TX
  • All we do is research jobs.
  • Our team of researchers, programmers, and analysts find you jobs from over 1,000 career pages and other sources
  • Our members get more interviews and jobs than people who use "public job boards"
Shoot for the moon. Even if you miss it, you will land among the stars.
TrainingCrossing - #1 Job Aggregation and Private Job-Opening Research Service — The Most Quality Jobs Anywhere
TrainingCrossing is the first job consolidation service in the employment industry to seek to include every job that exists in the world.
Copyright © 2024 TrainingCrossing - All rights reserved. 21