National external moderation manual for Tertiary Education Organisations
National external moderation manual for Tertiary Education Organisations (for NZQA-managed standards on the Directory of Assessment Standards) 2014 TEO Manual National External Moderation Manual for Tertiary Education Organisations 2014 Copyright © New Zealand Qualifications Authority 2014 2 TEO Manual Contents Introduction ........................................................................................................................ 4 Section One: Submitting an assessment plan ............................................................... 7 Section Two: Moderation plan ......................................................................................... 9 Section Three: Submitting assessment materials for moderation ............................. 10 Section Four: Moderation report ................................................................................... 15 Section Five: Moderation clarifications and appeals................................................... 21 Section Six: Resubmitting assessment material ......................................................... 22 Section Seven: National external moderation results ................................................. 23 Section Eight: Non-compliance ..................................................................................... 24 Section Nine: Action plans ............................................................................................ 25 Appendix: Guidance on assessment design and practice........................................... 27 The unit standard ............................................................................................................... 27 Assessment conditions and valid assessment ................................................................... 28 Assessment materials and resources ................................................................................ 29 Further assessment opportunities and resubmission of assessed learner work ................ 30 This manual is revised annually and available at http://www.nzqa.govt.nz/providerspartners/assessment-and-moderation/tertiary-moderation/ National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 3 Introduction This manual explains the process of national external moderation for NZQA-managed standards and how tertiary education organisations (TEOs) and NZQA contribute to the process. It describes the steps in the process and gives detailed information about the requirements for each step. TEOs can use this manual as a resource to help them work with NZQA through the national external moderation process. The manual includes information about: • the purpose of moderation • the moderation liaison’s role • the overall moderation process • submitting an assessment plan to NZQA • the moderation plan • submitting materials for moderation • national external moderation reports • what to do if asked to resubmit assessment material and assessed learner work • how to clarify or appeal moderation reports • summary of moderation results and follow up. The appendix provides information about effective assessment design and practice. What is moderation? Moderation provides assurance that assessment is fair, valid and at the national standard, and that the assessors are making accurate and consistent judgements about learner performance. Internal moderation Internal moderation is the responsibility of each organisation that has consent to assess. It can occur among assessors at a single site, at an organisation's multiple sites or among an ITO's registered workplace assessors. Internal moderation helps to ensure consistency of assessment within organisations, over time and between assessors. Internal moderation processes must be embedded in the quality management system of every TEO. National external moderation National external moderation provides assurance that assessment decisions are made at the national standard. Every standard on the Directory of Assessment standards is attached to a CMR (Consent and Moderation Requirements, previously called Accreditation and Moderation Action Plan or AMAP). The Moderation Requirements section in the CMR sets out the national external moderation system for the standard. It is the responsibility of organisations with consent to assess to ensure that they engage in the national external moderation system for standards for which they are assessing and reporting credits. The TEO reporting the results is responsible for the moderation, regardless of where an organisation sources the assessment material from, or who conducted the assessment. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 4 Meeting national external moderation requirements To meet national external moderation requirements for NZQA-managed standards, TEOs must: • provide NZQA with an accurate assessment plan for the year and update it during the year if required • meet moderation deadlines • provide assessment materials and make assessor judgements that are fair, valid and consistent, and reflect the national standard. The role of the TEO moderation liaison Each TEO must nominate a moderation liaison. • All moderation enquiries to NZQA should be directed through the moderation liaison. • The moderation liaison ensures their organisation’s assessment plan lodged with NZQA accurately reflects the standards they will assess and/or report results for in that calendar year. • The moderation liaison ensures assessment materials and samples of assessed learner work are sent to the designated moderators by the submission date, or contacts NZQA if learner samples cannot be submitted on time. • NZQA moderation reports are sent to the moderation liaison. • The moderation liaison circulates moderation reports and correspondence from NZQA to the appropriate people within their organisation. If the moderation liaison in your TEO changes, please complete the TEO moderation liaison details form available at: http://www.nzqa.govt.nz/assets/Providers-and-partners/Assessment-andmoderation/Tertiary-Moderation/TEO-moderation-liaison-details.doc and send it to NZQA at [email protected]. Who to contact about assessment and moderation Contact the Tertiary Assessment and Moderation (TAM) team at NZQA for assessment and moderation matters. Queries about moderation should come to TAM through your TEO’s NZQA moderation liaison. Tertiary Assessment and Moderation (TAM), NZQA Email: [email protected] Phone: 04 463 3000 or 0800 NZQA 96 (0800 6972 96) PO Box 160 Wellington 6140 Web: www.nzqa.govt.nz Your organisation’s NZQA Sector Relationship Manager is your first point of contact for all other matters. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 5 National external moderation process overview Assessment plan • TAM sends a circular to your TEO in November/December asking for an assessment plan for NZQA-managed standards your organisation intends reporting credits for in the following year. • Your plan lists the NZQA-managed standards your TEO expects to assess that year and when you expect to assess them. • Your TEO confirms its plan (online) to TAM in January. • Your moderation liaison emails TAM during the year if your organisation’s assessment plan needs to be updated. Moderation plan • TAM selects the standards for moderation and the submission date, based on your TEO’s moderation history. • TAM sends an initial moderation plan to your moderation liaison in March. • The moderation plan indicates the submission date and the standards that will be moderated. A final moderation plan, including all moderator addresses, is sent in June/July. Submission for moderation • Your moderation liaison sends assessment materials and assessed learner work to the moderators at the addresses on the moderation plan, by the submission date. • Your moderation liaison contacts TAM before the submission date if your organisation requires changes to the moderation plan submission date, the standards being assessed, or your organisation is unable to supply assessment materials and assessed learner work. • If the moderator does not receive the assessment materials and assessed learner work, the moderator will send an Assessment Materials Not Received (AMNR) report to your moderation liaison three weeks after the submission was due. Moderation report • The moderator moderates assessment materials and learner work, and sends the moderation report/s to your moderation liaison and NZQA. • The moderation report records outcomes of moderation. National External Moderation Results report (NEMR) • When all moderation is complete, TAM sends your TEO a summary of moderation results for the year across all moderation systems. • An accompanying letter details any further actions required by your TEO. Further action • Your moderation liaison may contact TAM for clarification of decisions and comments in a moderation report. • Your moderation liaison may contact TAM when there are concerns about the report and you want to appeal the decisions or comments. • Refer to Sections Five, Six, and Eight for information regarding clarifications and appeals, resubmissions and consequences of ongoing non-compliance. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 6 Section One: Submitting an assessment plan This section tells you what an assessment plan is and any requirements for specific types of standards. It also outlines how to submit an assessment plan. Creating an assessment plan for NZQA-managed standards The assessment plan is a list of all NZQA-managed standards the TEO plans to assess and/or report results for in the coming year. TEOs must complete an assessment plan annually as part of their consent to assess requirements. The assessment plan forms the basis of a TEO’s moderation plan for NZQA-managed standards. If a TEO is not assessing NZQA managed standards, a Nil assessment plan should be completed on an annual basis. If a TEO is likely to report results for a standard (regardless of the source of the assessment material), that standard must be included on the TEO’s assessment plan. Your TEO’s moderation liaison should email TAM at [email protected] during the year if the assessment plan needs amending. Please ensure your TEO includes the earliest date by which assessments for each standard will be completed, marked, and available for submission for national external moderation. This helps TAM to determine a single submission date for materials in all subjects for your TEO. TEOs who do not submit an assessment plan for a year when they have reported results against NZQA-managed standards are not meeting national external moderation requirements and may be referred to the appropriate Quality Assurance Body. Assessing against achievement standards TEOs using internally-assessed achievement standards need to enter them on the assessment plan in the same way as unit standards. TEOs intending to enter learners for externally assessed achievement standards must email TAM at [email protected]. Special arrangements must be made for entering TEO learners. TEOs entering candidates for external assessed achievement standards must follow the ‘Assessment and Examination Rules for TEOs with Consent to Assess Entering Candidates for Externally Assessed Achievement Standards 2014 found at: http://www.nzqa.govt.nz/about-us/ourrole/legislation/nzqa-rules/teo-rules-for-achievement-stds-2014/. Assessing against ITO-managed standards Standards that are managed by ITOs or other Standards Setting Bodies (SSBs) cannot be entered on your NZQA assessment plan. ITOs and SSBs are responsible for national external moderation for standards they manage. You can find further information about moderation of ITO-managed standards at the Industry Training Federation (ITF) website at: http://www.itf.org.nz, or in the relevant Consent and Moderation Requirements (CMR). Outsourcing TEOs reporting credits under their own TEO code for standards that are assessed under an outsourcing arrangement must list these standards on their assessment plan and engage in national external moderation. Also, if another organisation reports results using your TEO’s provider code, those standards must be included on your TEO’s assessment plan, and your TEO must engage in national external moderation. If you have any questions about outsourcing, please email TAM at [email protected]. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 7 Creating and submitting an assessment plan Please use the online facility to complete your TEO’s annual assessment plan. The online facility allows your TEO to: • view copies of your organisation’s assessment plans from previous years • use the current year’s assessment plan as a template for the next year’s assessment plan and then update it • check whether your organisation’s assessment plan has been received by NZQA • start entering standards in your organisation’s online assessment plan at any time up to the January submission date. Your TEO’s moderation liaison should contact the Sector Service Desk on 0800 422 599 or email [email protected] to apply for access to the NZQA secure extranet. TEO logins can be obtained by visiting: http://cms.steo.govt.nz/News+and+Info/ESAA.htm and following the instructions. Your TEO representatives can log in to complete your organisation’s assessment plans at: https://secure.nzqa.govt.nz/for-providers/tertiary/login.do. For help with creating or updating your TEO’s assessment plan, please email TAM at [email protected]. Changes to assessment plans If your TEO is assessing standards not initially included on your assessment plan, please tell TAM during the year, in a timely manner. Requirements for multi-site organisations Multi-site organisations need to enter one plan that includes all standards assessed across all sites (a single moderation plan will be sent to the “parent” site). Your TEO’s moderation liaison should please email TAM at [email protected] for advice on this. Standards for which your TEO does not hold consent to assess If your TEO wants to add standards to your organisation’s assessment plan that your organisation does not yet have consent to assess for, the following will apply: • If your TEO has applied for consent to assess, the standards should be added to the assessment plan. Your organisation should contact the Approvals and Accreditation team in the Quality Assurance Division (QAD) at NZQA to discuss progress with the application. • If your TEO has not yet applied for consent to assess, the standards should not be added to the assessment plan. Your organisation should contact the Approvals and Accreditation team to discuss applying for consent to assess. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 8 Section Two: Moderation plan TAM issues a moderation plan that lists the standards selected for national external moderation for the year, based on the information in a TEO’s assessment plan. The submission date for an organisation is determined in part by the latest assessment date on the TEO’s assessment plan. An initial moderation plan will be sent to your TEO’s moderation liaison in March. This does not contain the moderator names or addresses. A final plan including all moderator names and addresses will be sent to your organisation by the end of June. If your moderation liaison does not receive a moderation plan which includes all moderator details by mid-July, please email TAM at [email protected]. Your moderation liaison will be sent a revised moderation plan if a change is made to the submission date, systems selected, standards selected, or moderator details. What to do when you receive your moderation plan When your moderation liaison receives your moderation plan from NZQA, you should note the standards selected for national external moderation and the submission date(s). Your organisation’s moderation liaison must arrange to have the assessment materials and assessed learner samples to the appropriate moderator(s) by the submission date. For the number of learner samples to submit, refer to Section Three. If your TEO is not assessing a standard on your moderation plan, your moderation liaison should email TAM at [email protected] well before the submission date so a substitute standard can be selected. Conflicts of interest If your moderation liaison receives the moderation plan and an allocated moderator is known personally by your TEO, please contact TAM immediately, and a different moderator may be allocated. This prevents a conflict of interest arising before moderation takes place. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 9 Section Three: Submitting assessment materials for moderation This section describes how TEOs choose and submit assessment material to NZQA’s moderators. Sending materials to the moderator Your moderation liaison sends assessment materials and samples of assessed learner work to the moderator stated on the moderation plan. Allow enough time for the moderator to receive the materials before your TEO’s submission date. If assessment materials and learner samples are available well before the submission date, please send them to the moderator. While we cannot guarantee materials submitted early will be moderated immediately, it helps moderators and TAM ensure the timely reporting of your moderation results. You are provided with the moderator’s name and address solely for the purpose of submitting materials for moderation. Please direct any clarifications and queries to TAM ([email protected]) and not to the moderator(s). Tertiary moderation cover sheet Please ensure a completed Tertiary moderation cover sheet is attached to assessment materials for each standard submitted to the moderator. This is available at: http://www.nzqa.govt.nz/assets/Providers-and-partners/Assessment-and-moderation/TertiaryModeration/Tertiary-moderation-cover-sheet.doc. Clearly indicate the full TEO name and provider (MoE) code. In the learner samples section, ensure that both the Learner and Assessor judgements columns are filled in. Assessment material required Your organisation must submit assessment materials to your moderation liaison for national external moderation for the standards listed on your TEO’s moderation plan from NZQA. One complete set of assessed work for each learner must be supplied to the moderator. “Composite” samples (i.e. samples made up of work from several learners) must not be submitted. Materials to submit Please include the following assessment materials for moderation: • assessment activities/tasks and instructions to learners and/or candidate evidence guides • assessment schedules including evidence and judgement statements (qualitative and quantitative) and, if applicable, model or sample answers. This shows the moderator how assessment decisions have been made • three assessed learner samples for each standard that has only an ”achieved” grade available – i.e. one complete set of assessed work for each of three learners. It is expected that at least two samples will be ‘achieved’, and any ‘not achieved’ samples will be borderline • eight assessed learner samples for each standard that has merit and/or excellence grades available, from across a range of achievement: N (Not achieved), A (Achieved), M (Merit), E (Excellence), and including borderline samples; the majority of samples should be ‘achieved’ or higher and any ‘not achieved’ samples should be borderline • learner samples should be drawn from the current year (refer section below if not available) • any relevant electronic files provided to the learner with assessment tasks, or submitted by the learner for assessment purposes • a hardcopy of the standard if you have assessed against an earlier version than is currently on the NZQA website. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 10 Types of materials to submit The materials can be in the form of: • assessment materials developed by or under the jurisdiction of your TEO, including evidence guides and workplace assessment briefs • commercially produced assessment materials • assessment materials published by the Ministry of Education (MoE) or NZQA (modified or unmodified) • teaching materials or workbooks, if they contain actual summative assessment activities; relevant sections should be flagged • learner assessment evidence including attestations, witness testimonies, verified checklists • audio and visual digital evidence if appropriate (please use CDs and DVDs only). For more information on submitting audio and visual digital evidence, refer to the end of this section. Learner samples need to be verified and anonymous Please ensure learner samples sent to the moderator are legible and are: • verified as being assessed either at N (Not achieved) or A (Achieved) for standards with only the achieved grade available • verified as being assessed with N (Not achieved), A (Achieved), M (Merit), E (Excellence) for standards with merit and/or excellence grades available • identified as Learner A, B, C or Learner 1, 2, 3 (or initials only) – not named. Please ensure your submission includes a Moderation visual/digital evidence cover sheet, if audio and/or visual digital evidence is involved. You can download this from: http://www.nzqa.govt.nz/assets/Providers-and-partners/Assessment-and-moderation/mod-visualdigital-evidence-cvrsheet.doc. Early submission of assessment materials As mentioned above, if your TEO has assessment materials and learner samples are ready for submission much earlier than the submission date, your moderation liaison is encouraged to submit them to the moderator. The moderator will moderate these assessment materials subject to his or her workload. Problems with submitting assessment materials Late submission and non-submission of assessment materials If your TEO will not be able to send assessment materials and related assessed learner samples to the moderator by the submission date, your moderation liaison should email TAM at [email protected] as soon as possible and a new submission date may be arranged. Assessment materials not submitted on time will be recorded as late on your TEO’s the National External Moderation Results report. If materials do not arrive within the required time frame, an Assessment Materials Not Received (AMNR) report will be sent. This is considered as non-compliance with national external moderation requirements. If you receive an AMNR, this is not a signal to send materials for moderation. Wait until you receive your TEO’s National External Moderation Results report. The accompanying letter will advise the next steps to be taken. Learner samples from the current year unavailable If learner samples relating to assessments from the current year will not be available for one or more of the standards on your TEO’s moderation plan, your moderation liaison should email TAM National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 11 at [email protected] as early as this is known (and well before your organisation’s submission date). TAM will work with your TEO to either change the organisation’s submission date to when three assessed learner samples will be ready for national external moderation, or select an alternative standard. Integrated assessment materials Best practice assessment principles for the assessment of unit standards states that “Assessment of related or similar learning outcomes should be integrated, where possible”. Chapter 4 of the publication Learning and Assessment: A Guide to Assessment for the National Qualifications Framework, available on the NZQA website at: http://www.nzqa.govt.nz/providerspartners/assessment-and-moderation/assessment-of-standards/generic-resources/ includes an explanation of this type of assessment. TEO moderation plans may include standards where assessment has been integrated with other standards not selected for national external moderation. Your TEO may submit the whole integrated assessment package to the moderator, but assessment material and learner samples must clearly indicate which parts of the material apply to the standard selected for moderation. For example: • assessment materials and learner work could be marked with sticky notes or be printed on different coloured paper • an assessment grid or “map” that indicates which outcomes/elements have been assessed in which assessment activities could be included with materials • written information could be included that clearly explains to the moderator how (and in which part of the materials) the standard selected for moderation has been assessed. It may also be possible to adjust the moderation plan to include additional standards within the integrated package in the moderation selection. Please email TAM at [email protected] if you would like further advice on this matter. Online assessment materials Where standards selected for national external moderation have been partially or wholly assessed online, your TEO should contact TAM at [email protected] for advice regarding submission of materials for moderation. It may be necessary for the moderator to have access to the online assessment(s) and model answers, and system information and relevant data, in order to complete this moderation. Alternative forms of assessment Assessment by conversation Assessment can take place using conversations held by the assessor with others – such as the learner themselves, verifiers, attesters, supervisors, employers and colleagues. These conversations need to be formal assessment occasions where both the learner and the other party have been fully briefed on the requirements of the standard and the assessment requirements and conditions. If your TEO is conducting a substantial amount of assessment of NZQA-managed standards by conversation, please contact TAM at [email protected] to discuss moderation options. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 12 Specific evidence for assessment by conversation If postal moderation is the confirmed option, please ensure assessors, internal moderators and moderation liaisons take into account the following when preparing evidence for submission for national external moderation: • Either a CD of the recorded conversations or a transcript of the conversation should be included. The parts of discussion that have contributed to the assessor decision for the standard being moderated must be clearly identified for the moderator and reference made to the specific unit standard outcome/element. The relevant parts of the transcript could be highlighted or marked with sticky notes. Relevant parts of the recording should be indicated by listing the time stamps of the sections (for example 20:10-35:40). • Hard copies of any materials discussed or other supporting evidence relevant to the standards being moderated and taken into account by the assessor should be included (for example instructions/guidelines given to the learner, organisational policy and procedures, samples of learner work, or signed attestations). • Any written notes or comments made by the assessor that will assist the moderator to verify the assessor decision • The assessor guide that has been used by the assessor should also be submitted. Assessment of Prior Learning (APL) and Recognition of Current Competence (RCC) Where an APL and/or RCC process is used to assess a learner’s knowledge and/or skills, documentation submitted for national external moderation must show: • that the learner’s current level of competency against the outcomes/elements of the standard has been ascertained, in particular the practical skills • direct links between learner evidence and the standard at outcome/element level. This may be done using an evidence grid, matrix, or map that clearly indicates the evidence the assessor considered to make their decision. For large, complex, and/or integrated portfolios of evidence, it may be helpful to colour code specific pieces of evidence, so the moderator is able to navigate the material efficiently and consider all the relevant evidence. Preparing audio and visual digital submissions for moderation Assessors in areas such as Māori Performing Arts, English for Speakers of Other Languages, Business and Management, Drama and Physical Education may need to submit audio-visual copies of assessed work of selected learners for moderation. Assessors and moderation liaisons need to consider the following when preparing audio and visual digital submissions for moderation. Acceptable formats Only CD-R or DVD-R format should be used. The following file format types are acceptable: • Portable Document Format (.pdf) • JPEG Image Format (.jpg, .jpeg, .jpe …) • Graphics Interchange Format (.gif) • Standard formats as used in Windows Media Player • PowerPoint • QuickTime Other graphics formats may not be able to be read. Please do not send VHS video tapes, Blu-ray discs, Hi8, DV or MiniDV tapes, or HD files. Other technology, such as USB flash drives or YouTube, are not suitable due to high security risks and the potential for transmitting viruses. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 13 Apple Macintosh users must ensure submitted files can be read easily on a PC, except in the case of Media Studies. For Media Studies, PC users must ensure submitted files can also be read easily on an Apple Macintosh. Quality of CDs and DVDs Use new, previously unrecorded CDs or DVDs. To ensure the material is readable, please test it on a machine other than the one used for recording it before sending it in for moderation. Avoiding damage to discs To avoid damage to CDs or DVDs, please package materials carefully in bubble-wrap or similar packaging for transport to the moderator. Clearly identifying the learner Only present audio and/or visual copies of the performances to be moderated. Please use the Moderation visual/digital evidence cover sheet to identify the learner whose work is to be moderated. You can download a copy of this form from the NZQA website at: http://www.nzqa.govt.nz/providers-partners/assessment-and-moderation/tertiary-moderation/ Please ensure the sections of the recording relevant to the standard being moderated are clearly identified. Also ensure that the learner identification used for the recording is consistent with that in any submitted documentation (for example “Learner 1” in the recording is “Learner 1” in the documentation). Strategies for successful identification of the learner on the CD or DVD itself include: • a personal introduction, or a voice-over introduction of the learner • placing all of each learner’s work in a suitably identified folder, for example “SJ”. Each file within the folder can then be identified and numbered to indicate the sequencing of the work, for example “SJ1.jpg”, “SJ2.jpg” etc. • submitting a learner’s work in the form of a PowerPoint presentation which clearly sequences images as separate slides in the form of a slideshow. Written learner evidence may be added as notes if PowerPoint is used • a written guide indicating the sections of the recording which are relevant to the standard being moderated, for example through the time stamps. The quality of the recording Please ensure that the recording of the learner performance being moderated is of sufficient quality to show the basis of the assessor’s judgements. This includes the visual and/or audio quality of the recording. For more information, refer to ‘Preparing digital visual submissions for moderation’ available at: http://www.nzqa.govt.nz/qualifications-standards/qualifications/ncea/subjects/preparing-digitalvisual-submissions-for-moderation/ National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 14 Section Four: Moderation report The moderation report describes the outcomes of the moderation. The moderator completes the moderation report and sends a copy to the TEO’s moderation liaison and NZQA. The expected turnaround time is three weeks from the moderation submission date, except for November submissions when the turnaround time may be longer. If you have not received a moderation report within six weeks of your submission date, please contact TAM at [email protected]. Moderation results for most field Māori standards are often confirmed at kāhui. The turnaround time for materials moderated at kāhui may be eight to ten weeks, depending on the submission date. Following is a description of each part of a moderation report and how to interpret it. The front cover The front cover of the moderation report provides an overall summary of findings. It contains the following sections: 1. Overview: This gives a summary of moderation findings in relation to the standard, including where there are any areas of concern. It will refer to the assessment materials and assessor judgements. 2. Commentary (optional): This section is completed when the moderator can give some specific feedback to assist the assessor that is not directly related to the moderation result. 3. Next Steps: This section is included in all reports for schools and TEOs. There is a different statement for schools and TEOs. Moderation Results: explaining the results The Moderation Results section of the moderation report focuses on the overall moderation results. Overall decision about assessor judgements The number in the first box is how many assessor judgements about learner samples the moderator has agreed with (i.e. verified). The number in the second box is how many learner samples the organisation submitted for national external moderation. Moderation Results The assessor judgements about learner performance reflect the national standard for 1 out of 3 Samples Tick one box The assessment materials meet the national standard. The assessment materials require modification. The assessment materials do not meet the national standard. Note: NZQA will send a summary of moderation results advising of any further moderation requirements. Figure 1: Moderation Results section In the moderation report for Literacy or Numeracy unit standards, there will be no reference to or moderation result for assessment materials. This is because these standards are assessed on the basis of naturally occurring evidence, and setting assessment activities for the purposes of assessing these standards is inappropriate. The overall moderation decision will only refer to the number of assessor judgements about learner samples the moderator has verified. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 15 Moderation Results The assessor judgements about learner performance reflect the national standard for 1 out of 4 samples. This report relates only to learner evidence and associated assessor judgements. Note: NZQA will send a summary of moderation results advising any further moderation requirements. Figure 2: Moderation Results in Literacy or Numeracy moderation report A 0/0 moderation result for assessor judgements may be given when: • no learner work was submitted • no assessor judgements/results are shown on the moderation coversheet, and your TEO has been unable to provide further clarification to TAM • the assessor decisions could not be verified (for example because the learner evidence is illegible or un-viewable, or because there isn’t enough submitted evidence of learner performance for the moderator to see how the assessor made their judgement). Overall decisions about assessment materials Moderators reflect on the assessment materials overall when making their decision. Specifically, whether the outcome in the title and purpose of the standard has been met. Moderators use the following bulleted indicators to determine whether the assessment materials meet the national standard, if they require modification or they do not meet the national standard. Moderator decision: The assessment materials meet the national standard Any issues identified in the moderation report are very minor, or phrased as recommendations. Likely indicators for this decision: • Special/explanatory notes and all of the outcomes/elements have been covered. • Range statement requirements and evidence requirements/performance criteria have been appropriately covered. • The only “No” decisions in the moderation report are for minor issues in sections 1 and 3 (i.e. decisions in sections 2, 4 and 5 must all be “Yes”). Moderator decision: The assessment materials require modification The assessment materials require revision or some redevelopment, but issues identified can easily be addressed (i.e. the moderator is satisfied that, if the modifications specified in the moderation report are made, materials will meet the national standard). Likely indicators for this decision: Special/explanatory notes and all outcomes/elements have been covered. There are only minor omissions in the assessment materials and/or schedule, for example either the evidence or judgement statements in the schedule are missing or unclear, or model answers have been referred to but not included for moderation. • Most of the range statement requirements and most of the evidence requirements/performance criteria have been appropriately covered. • There are a sufficient number of “Yes” responses in the assessment materials and schedule sections of the moderation report to validate the assessment materials. • • National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 16 Moderator decision: The assessment materials do not meet the national standard The assessment materials require significant redevelopment. The issues are widespread within the materials (note: some examples of the issues will be given in the moderation report rather than an exhaustive list). A complete review of the materials is needed. Likely indicators for this decision: • A significant number of special/explanatory notes and/or outcomes/elements have not been covered. • There are serious omissions in the assessment materials and/or schedule. • A significant number of range statements and/or evidence requirements/performance criteria have not been covered. • There are insufficient “Yes’s” in the assessment materials and schedule sections of the moderation report to validate the assessment materials. TEO follow-up on results If the moderator has ticked “The assessment materials meet the national standard”: • address any issues or consider areas for improvement that the moderator may have commented on. If the moderator has ticked “The assessment materials require modification”: The assessment materials must be modified before they are used again. The moderation report will detail what changes are required for the assessment materials to meet the national standard, or specify where the materials do not meet the standard. • The standard may be chosen again for moderation as a resubmission in the same year, or in the following year. • Please do not resubmit the materials once you have modified them unless TAM has asked you to (in the letter accompanying your National External Moderation Results report will contain this information – refer to Section Seven of this manual). • • If the moderator has ticked “The assessment materials do not meet the national standard”: • The assessment materials must be significantly altered before they can be used again. • The moderation report will detail what changes are required for the assessment material to meet the national standard. • NZQA will notify your TEO of what further action will be required for this assessment in a letter sent with the National External Moderation Results report (see Section Seven). National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 17 Assessment Materials This section of the moderation report, comments on the outcomes of the moderation of assessment activities, conditions and the assessment schedule. Assessment Materials Assessment Materials (tick relevant boxes below): Own Commercial materials modified MOE/TKI/NZQA Other Assessment Materials for Learners 1 Is the standard to be assessed correctly identified (number, version, outcomes)? Comments If the moderator’s response to this section is “Yes”, there may not be a comment. If the response is “No”, a reason will be given. 2 3 Does the brief, event, activity, task (etc) provide learners with the opportunity to meet the requirements of the standard? Specify Outcome No. Y/N Comments or A, M, E Criteria Outcome/element Y The moderator may not comment. number listed N The moderator will provide the reason(s) for a “No” decision. Are the assessment conditions clear and appropriate? Comments Assessment Schedule 4 Are there statements provided that specify evidence expectations that meet the requirements of the standard (evidence statements)? Specify Outcome No. or A, M, E Criteria Comments Y/N Outcome/element Y The moderator may not comment. number listed N The moderator will provide the reason(s) for a “No” decision. 5 Are statements provided that clearly describe performance levels (quality and, where relevant, quantity) that meet the requirements of the standard (judgement statements)? Specify Outcome No. or A, M, E Criteria Comments Y/N Outcome/element Y The moderator may not comment. number listed N The moderator will provide the reason(s) for a “No” decision. Figure 3: Assessment materials section National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 18 Assessed Work This section of the moderation report, comments on the outcomes of the moderation of assessor decisions about learner evidence. Both the assessor judgements of the learner evidence (as noted on the Tertiary moderation cover sheet) and the moderator decisions about the assessor judgements are recorded in this section. In the example below, the moderator agreed with the assessor decisions for one out of three samples (learner 2) and disagreed with the decision for learner 1 and learner 3. This information is transferred to the Moderation Results section of the moderation report. Assessed Work Do assessor judgements reflect the national standard? Assessor judgement Learner Moderator judgement 1 N A 2 A A 3 A N The moderator agrees with 1 out of 3 assessor judgements. Comment Learner 1 has presented sufficient evidence to meet the requirements of elements 1 and 2. Insufficient evidence has been presented for element 2. Specific examples of learner contributions and behaviour need to be recorded, to support the assessor/ observer ticks on the checklist. The moderator indicates the reason for not agreeing with the assessor’s judgements. Figure 4: Assessed work section of the moderation report What to do when you receive the moderation report The moderation liaison should ensure all relevant people in your TEO get a copy of the moderation report. If the moderation report states that the assessment materials require modification or do not meet the national standard, modify the assessment material as indicated in the moderation report. This needs to be done before the assessment materials are used again. We also recommend that the feedback in all NZQA moderation reports is used to inform assessment practice within your TEO as well as your organisation’s assessment design and internal pre- and post-assessment moderation processes. The National External Moderation Results report and accompanying letter from TAM will detail anything else the TEO has to do (for example resubmit material and/or an action plan). If your organisation has questions or concerns about the results or comments contained in a moderation report, please have your TEO’s moderation liaison contact TAM at [email protected]. Do not contact the moderator directly. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 19 Assessment Materials Not Received (AMNR) report As mentioned in the Section Three of this manual, if your organisation receives an AMNR report, do not then send assessment materials to the moderator. However, if your TEO did send the assessment materials to the moderator and still received an AMNR report, please contact TAM at [email protected]. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 20 Section Five: Moderation clarifications and appeals Clarifying moderation reports If your TEO is unclear about the meaning of comments in a moderation report or the basis on which the overall moderation decision has been made, contact TAM for clarification. Depending on the type of query, your organisation may need to provide different information or material (see below). Appeals If your TEO has concerns about moderation decisions you can appeal the decision(s). However, it is recommended that your organisation contacts TAM to seek clarification about moderator comments or moderator decisions before formally appealing. Please do not contact the moderator directly. When appealing moderation decisions, please provide details of your specific concerns in a letter and send this to TAM, together with: • a completed Tertiary moderation clarification or appeal cover sheet available at: http://www.nzqa.govt.nz/assets/Providers-and-partners/Assessment-and-moderation/TertiaryModeration/Tertiary-moderation-clarification-appeal-form.doc • the assessment materials as originally sent to the moderator • assessed learner work as originally sent to the moderator • a copy of the moderation report. Your TEO may appeal moderation decisions any time after the moderation report has been received and up to three weeks after the date of the National External Moderation Results report letter (refer to Section Seven of this manual). NZQA actions after an appeal TAM will acknowledge to your TEO’s moderation liaison receipt of each appeal and request additional information if required. NZQA will then process the appeal, which may take up to six weeks. When a decision has been made NZQA will return the materials along with a moderation appeal results letter to your TEO moderation liaison. This will include a revised moderation report if the appeal is successful or the original moderator’s comments have been clarified. Otherwise, the original report stands. The outcome of this appeal is final. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 21 Section Six: Resubmitting assessment material If your TEO needs to resubmit materials for national external moderation within the current moderation year, this will be confirmed in the letter accompanying the National External Moderation Results report (refer to Section Seven of this manual). TAM will already have discussed availability of learner samples and a resubmission date with your organisation’s moderation liaison. What to send when resubmitting assessment material When resubmitting, your moderation liaison must send the following to the moderator: • Tertiary moderation cover sheet available at: http://www.nzqa.govt.nz/assets/Providers-andpartners/Assessment-and-moderation/Tertiary-Moderation/Tertiary-moderation-cover-sheet.doc • modified assessment materials and assessment schedules (including evidence and judgement statements) • learner work samples relating to the modified materials • version of the standard assessed. If the assessment materials and/or assessor decisions do not meet the national standard after resubmission, NZQA may make additional requirements. TAM will notify your moderation liaison of the decision and any further requirements by letter. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 22 Section Seven: National external moderation results NZQA advises TEOs of their national external moderation results for NZQA-managed assessment standards with the following: • the National External Moderation Results report (NEMR) • an accompanying letter • collated national external moderation results for the last three years. The National External Moderation Results report The NEMR summarises the national external moderation results for that particular submission date across all systems that were moderated for the TEO. The NEMR report is sent to a TEO and emailed to the moderation liaison after the last moderation report for that moderation round has been received by NZQA. This is usually within 30 working days of the submission date. Normally, an organisation will receive only one NEMR a year. However, another NEMR is sent after a resubmission round, and a revised NEMR is sent after a successful appeal. The accompanying letter A letter accompanying the NEMR report summarises the moderation results. Where some or all moderation results do not meet the national standard, the letter will also detail any actions required to address issues identified by moderation. If TAM finds non-compliance with moderation requirements, actions might include: requesting revised assessment materials and new learner samples to be submitted for moderation • requesting an action plan to address issues identified • referring the TEO to the relevant Quality Assurance Body (QAB) to take action under legislation. • Collated national external results for the last three years Collated national external moderation results for the TEO for the last three years are enclosed with the letter and NEMR report. Your organisation’s moderation liaison is encouraged to contact TAM and seek clarification on the NEMR report and/or the contents of the accompanying letter if required. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 23 Section Eight: Non-compliance Non-compliance (in this context) means not meeting national external moderation requirements. As stated in the introduction to this manual, to meet national external moderation requirements for NZQA-managed standards, TEOs must: • provide an accurate assessment plan for the year and update it during the year if required • meet moderation deadlines • provide assessment materials and make assessor judgements that are fair, valid and consistent, and reflect the national standard. NZQA contact with non-compliant organisations TAM will contact non-compliant TEOs by letter, outlining any concerns relating to the results of moderation. TEOs are expected to respond to these concerns with a written action plan that addresses the issues raised within the time specified. Please refer to Section Nine for information regarding action plans. Who should be involved? Within an organisation, the Chief Executive Officer (CEO) – or the appropriate person with delegated authority within the TEO – should liaise with TAM over non-compliance regarding moderation. The moderation liaison person should also be involved. Ongoing non-compliance TAM will report ongoing non-compliance to the appropriate QAB and the CEO or equivalent authority of the TEO. NZQA is the QAB for institutes of technology and polytechnics, industry training organisations, private training establishments, wānanga and government training establishments. The Committee for University Approvals and Programmes (CUAP) is the QAB for universities. Ongoing unresolved non-compliance may ultimately result in the withdrawal of consent to assess against standards. Other restrictions may also be imposed on the TEO. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 24 Section Nine: Action plans Where national external moderation reveals issues that materially affect the fairness, validity or consistency of assessment, TAM requires TEOs to submit an action plan to address the issues. Assessment and moderation action plans TEOs must submit an assessment and moderation action plan when: • major, or a significant number of, assessment issues are identified in moderation reports within a system or across systems in the same moderation year, or • recurring or different assessment issues have been identified within or across systems for more than one year. The decision to request an action plan depends on: • the number and nature of assessment issues identified • the number and/or range of standards being assessed • the TEO’s moderation history. Examples of assessment issues Assessment issues may include (but are not limited to): Assessment design, • assessment design does not reflect intent of standard activities, conditions, • outcome(s) of standard not addressed guidance for learners • outcomes not assessed at appropriate level (i.e. too low) • inappropriate assessment conditions (e.g. practical performance outcomes assessed by written test, inappropriate use of group work, classroom simulation rather than actual workplace activity, too much assessor guidance given, resubmission rather than further assessment opportunity inappropriately provided) • explanatory notes specifying assessment requirements not taken into account in assessment activities or conditions and/or not communicated to learners • instructions/guidance for learners unclear or inadequate • the quality and quantity of evidence expected not provided to learners Assessor guidance • • • • Assessor decisions • • • • • no (or insufficient) evidence requirements specified evidence expectations inappropriate (e.g. at too low a level) or inaccurate no indicators for quality of outcome required (judgement statements) assessment criteria inconsistent with information given to learners authenticity issues not identified valid assessment schedules not applied lack of clarity about the basis for decisions (e.g. insufficient evidence that outcomes have been met) inconsistent decisions across learner samples inadequate, incorrect or inappropriately low-level evidence assessed as competent Any of the above issues may also indicate gaps in relevant policy, processes (e.g. internal pre- and post-moderation, lack of systematic moderation scheduling) or staff development. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 25 Administrative issues affecting moderation results Administrative issues may not, in themselves, justify a request for an action plan. However, if they contribute to poor moderation results or ineffective moderation samplings, actions to address them are expected to be included in the action plan. Administrative issues may include: • not submitting assessment materials (due to lack of internal communication of moderation requirements and deadlines) • lack of communication with NZQA • incomplete submission of assessment materials (e.g. no assessment schedule, no workplace attestations, no guidance to learners re RPL/RCC assessment conditions and evidence requirements) • lack of internal distribution of moderation reports to those with responsibility for ongoing assessment of the standard • absence of a coherent internal moderation plan • inaccuracies or omissions in the assessment plan for NZQA-managed standards that affects the validity of sampling for national external moderation. Action plan template TAM has developed an action plan template for TEOs to complete. The template can be downloaded from: http://www.nzqa.govt.nz/providers-partners/assessment-and-moderation/tertiary-moderation/ TAM criteria for accepting the action plan TAM will accept the action plan if it: • specifies actions and who is carrying them out and gives time frames • appears to address the issues identified in the moderation reports and by the TEO’s subsequent investigations • appears likely that successfully implementing the plan will improve national external moderation results. How the action plan is monitored TAM follows-up with the TEO to ensure that the action plan is effective in improving the TEO’s assessment and moderation outcomes. Action plan follow-up may include: earlier submission date set for national external moderation in the coming year telephone discussion to check on actions completed to date and their success meeting with the TEO for more in-depth discussion of action plan implementation request to submit evidence relevant to implementation of the action plan (e.g. internal and/or external moderation reports, improved processes, completed staff training or workshops) • including assessment and moderation as a discussion point or focus area in any pending external evaluation review process. • • • • Where action plans are judged to have been ineffective, TAM will consider referring the TEO to the relevant QAB. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 26 Appendix: Guidance on assessment design and practice Effective assessment design and practice focusses on ensuring any assessment: • covers all relevant content and parts of the standard • allows the learner to show enough depth and/or breadth of knowledge or skills to achieve the outcomes/elements • collects relevant and sufficient evidence of learner achievement for the assessor to make valid, fair and consistent judgements • complies with any restrictions on or regulatory requirements for the activities, including health and safety • uses the most suitable situation for assessment • has appropriate and relevant support materials and resources for learners and assessors • addresses possible problems with ensuring the authenticity of learner work. You can find more advice and guidance about designing assessment activities at: http://www.nzqa.govt.nz/providers-partners/assessment-and-moderation/assessment-ofstandards/generic-resources/designing-assessment-activities This appendix has guidance on: • the unit standard the learner is being assessed against • assessment conditions • types of assessment • assessment materials and resources • further assessment opportunities and resubmissions The unit standard Version of unit standard to be used Where possible, your TEO should use the latest version of the standard. The moderator may, through the moderation report, bring to your attention that a new version has been published. Some version changes, including safety issues or legislation, are effective immediately. You can find further information about new versions of standards in Framework Developments at: http://www.nzqa.govt.nz/about-us/publications/newsletters-and-circulars/us-qualification-changes/ http://www.nzqa.govt.nz/about-us/publications/newsletters-and-circulars/framework/ Implications of range statements for assessment design When a range statement: • is stated in the special/explanatory notes, the range items must be included in assessment for all outcomes/elements of the unit standard • appears immediately below an outcome/element, the range items must be included in assessment for all evidence requirements/performance criteria in that outcome/element • appears immediately below an evidence requirement/performance criterion, the range items must be included in assessment for that evidence requirement/performance criterion. For further information, please refer to Unit standard definitions and explanations, available at: http://www.nzqa.govt.nz/providers-partners/assessment-and-moderation/assessment-ofstandards/generic-resources/unit-standard-definitions-and-explanations/ National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 27 Assessment conditions and valid assessment For assessment activities to be valid, the assessment conditions (including resources needed/available) must be appropriate for the outcome/element being assessed. The assessment activities must allow learners to demonstrate the required level of knowledge, skills and/or understanding for the outcome/element assessed. Assessments in some subject areas (such as mathematics and accountancy) may require responses that are ‘exact’ and reflect the model answers. However, where assessment activities/questions set may lead learners to provide responses that are very similar to those in the resources used, it needs to be clear in the instructions to learners and in the assessment schedule that answers must be in the learner’s own words to show sufficient depth of understanding. ‘Open book’ conditions It may be appropriate in some assessments for learners to have access to reference material such as texts, manuals, learning resources or their workbooks. In these cases the reference material should not contain the exact answers to the assessment questions, but include information that can assist learners (so long as they have an appropriate level of knowledge) to respond. Unless the skills being assessed are the learners’ ability to locate and/or transcribe specific information, learners should not be allowed to copy the answers directly from their workbooks, course notes or reference texts, or from a power point presentation or overhead transparencies. Recording observed or oral evidence Where assessed learner performance has been observed or is oral (i.e. is not written) and is not electronically recorded, the learner evidence must be sufficiently documented. This could occur through the use of an observation sheet. It is important that specific examples of learner performance, contributions or comments are recorded in the observation sheet, and that the observation sheet is signed and dated by the observer. Where the observer is not the assessor, the assessor should also sign off learner evidence. For some standards, observed or oral evidence will need to be recorded digitally. For information about submitting audio and visual recorded evidence for moderation, refer to Section Three of this manual. You can find advice and guidance about gathering evidence of achievement at: http://www.nzqa.govt.nz/providers-partners/assessment-and-moderation/assessment-ofstandards/generic-resources/gathering-evidence-of-achievement Group work Group work must be appropriate for the outcome being assessed. For example it would be inappropriate to assess a report writing standard by group work, but it may be appropriate for the group to share the research/investigation work that underpins a written report. Group work conditions and instructions must be clear. Learners need to know what is expected and how their contribution will be marked. Other considerations for group work: • Who did what must be clear to the assessor (and the moderator). • The assessor must make the overall decision. • There should be a process in place for how individuals can complete the assessment if the group falls apart. • Assessment activities could be broken into two parts – with individual and group work components. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 28 • • A post-assessment interview would help ensure that learners are (individually) competent. It may be simpler to confine group work to classroom/training activities as opposed to formal assessment activities. Attestations Attestations may be appropriate as contributing evidence for the assessment of some standards. Where used, attestations must be supported by other valid and robust evidence sources. Attestations: • must be in line with the outcome/element requirements of the standard • must be from a credible and trustworthy person – this may be a supervisor, client, kaumatua or workplace colleague, among others • ideally will be supported by examples of actual learner performance from that context • may confirm that the learner’s performance or behaviour has been consistently at the required level for the required period of time • must be signed and dated by the person making the attestation (i.e. attestor). Authenticity You can find advice about ensuring the authenticity learner work at: http://www.nzqa.govt.nz/providers-partners/assessment-and-moderation/assessment-ofstandards/generic-resources/authenticity and also at: http://www.nzqa.govt.nz/providers-partners/assessment-and-moderation/preventing-detectingacademic-fraud/ Assessment materials and resources Clarification and assessment support materials and resources Clarifications and assessment support material for various standards are available on the NZQA website. These give guidance about the requirements of those standards and should inform your TEO’s assessment design and practice. Some of the resources available include sample assessments, evidence exemplars and assessment schedules. TEOs are responsible for ensuring the authenticity of learner work, which means these resources must be modified in some way – for example different case studies, data sources, or contexts could be used. You can access the relevant resources at: http://www.nzqa.govt.nz/providers-partners/assessment-andmoderation/assessment-of-standards/assessment-support-material/ Assessment resources for achievement standards Assessment resources have been developed for the newly registered achievement standards. These are available under each subject area, which you can access through the NCEA subject resources page at: http://www.nzqa.govt.nz/qualifications-standards/qualifications/ncea/nceasubject-resources/ Assessment materials from commercial suppliers and other sources Your TEO is responsible for the validity of any assessment materials for standards it reports results for and that are reported using your TEO’s provider code, whether these materials are selfdesigned or not. This includes materials that are commercially produced, ITO-provided, or gained from other sources. All assessment material, no matter its source, should go through an internal moderation process to determine whether it is fit for purpose and allows learners the opportunity to meet the national standard. National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 29 Commercial materials, ITO-provided materials, or materials gained from other sources may include a moderation report and/or a certificate verifying that the materials have been internally moderated by the vendor or supplier. This does not mean that the materials have met the national standard or that NZQA has verified the materials. No materials used, leading to the reporting of credits, are exempt from national external moderation, apart from those which have been awarded QAAM (Quality Assured Assessment Material) status by NZQA. You can find further information about QAAM at: http://www.nzqa.govt.nz/providerspartners/assessment-and-moderation/assessment-of-standards/quality-assured-assessmentmaterials-qaam-trademark/ Further assessment opportunities and resubmission of assessed learner work TEOs are responsible for establishing their own policies for further assessment opportunities and resubmissions. A further assessment opportunity is when a new, quality assured assessment is provided for learners – after their first assessment opportunity and after further learning has taken place. The need for further assessment can be minimised by tutors and assessors by making sure that learners have obtained the necessary knowledge and skills to undertake the assessment. The TEO decides how many assessment opportunities will be given. However, if a learner does not achieve the required standard after one further assessment opportunity, the tutor or assessor should reconsider if the learner is ready for assessment. Resubmission of assessed learner work A resubmission is when a learner has the opportunity to correct simple errors or omissions in their assessed work. Resubmission: • should be limited to specific aspects of the assessment and no more than one resubmission should be provided • must take place before the assessor gives overall feedback to the learner on the work done. If more teaching has occurred after the first assessment opportunity, resubmission is not possible • should be closely supervised to manage authenticity • should be offered only where an assessor judges that a mistake has been made by the learner, which the learner should be capable of discovering and correcting themselves. For example, the learner may have handed in the assessment, but may not have made a particular calculation correctly. In such cases, the assessor may consider if it is appropriate to allow a learner to resubmit a specific part of the assessment. The amount of information an assessor provides to a learner in identifying the error is important in this context. In the case above, the assessor might say “your method is fine but there is a problem with your calculations….” The assessor would not, however, say “there is a problem with your use of brackets in this calculation.” National external moderation manual for Tertiary Education Organisations 2014 © New Zealand Qualifications Authority 2014 30
© Copyright 2025