‘You`re dealing with the demon of external validation. You can`t beat external validation.

You want to know why? Because it feels sooo good.’

- Barbara Hall

VALIDATION ?

• reviewing, comparing and evaluating the assessment processes, tools and evidence contributing to judgements made by a range of assessors against the same competency standards, at least annually

• documenting any action taken to improve the quality and consistency of assessment.

Validation

‘a quality review process that involves checking if the tool produced valid, reliable, sufficient, current and authentic evidence to enable reasonable judgements to be made as to whether the requirements of the relevant aspects of the training package had been met. It includes reviewing and making recommendations for future improvements to the tool, process and/or outcomes.’

ModerationThe process of bringing assessment judgements and standards into alignment. It is a process that ensures the same standards are applied to all assessment results within the same unit(s) of competency.…an active process…that adjustments to assessor judgements are made to overcome differences in the difficulty of the tool and/or the severity of judgements

WHY VALIDATE ?

Continuous improvement…….• Provide quality service to clients• Ensure principles of assessment met• Ensure consistent standards• Professional development of assessors• Increase assessor confidence• Ensure rules of evidence are being met

Also…AQTF Standard 1.5

‘Assessment:

(a) meets the requirements of the relevant Training Package or accredited course(b) is conducted in accordance with the principles of assessment and the rules of evidence(c) meets workplace and, where relevant, regulatory requirements(d) is systematically validated’

VALIDATION MUST BE……

• Planned• Targeted at a specific audience• Documented• Focussed on identified areas• At least annual

VALIDATION CAN INCLUDE….

Processes:• Informing learners about

assessment• Recognition processes• How assessments are conducted• Consistency of judgement• Instructions for assessors• Feedback processes

VALIDATION CAN INCLUDE….

Tools:• Individual/holistic assessment tools• Design of assessment tools• Interpretation of unit(s)• Setting standards and contexts

When does validation happen?

Pre assessment

During Assessment

Post Assessment

Will / Is / Did the assessment:

• Comply with the Training and Assessment Strategy

• Cover the performance criteria • Meet the Rules of Evidence• Follow the Principles of Assessment• Meet the requirements of the unit/module

– context of assessment, critical aspect of assessment, required skills and knowledge

• Allow application of skills and knowledge to industry standards

How can we do this?• Review assessments with colleagues• Get another facilitator to assess some of

your completed and assessed evidence• Get client feedback as soon as possible

following assessments• Reflect on the assessment yourself –

make changes• Get industry feedback on results• Get observer feedback• Document conversations and feedback• Show action plan for change if

necessary

RESOURCES

• AQTF User Guide 2010• Assessor Networks in Action

(NCVER)• Maximising Confidence in

Assessment Decision Making (NCVER)

• Professional Learning Phoenix site

The Assessment Process

Principles of Assessment

• Valid• Reliable• Flexible• Fair

Rules of Evidence

• Valid• Current• Sufficient• Authentic

Dimensions of Competence

• Task skills• Task management skills• Contingency management

skills• Job role & environment

skills