Preparation for the 2014â15 DLM Assessment, Part Three
Preparing for the Administration of the Spring 2015 Dynamic Learning Maps (DLM) in English Language Arts and Mathematics Part Three Do Not View Until Completion of Parts One and Two March 25, 2015 Version NJ DLM Winter Training Part Three 2015 1 Clarifications and New Topics The following slides include new topics as well as clarifying information on Parts One and Two. ◦ This presentation may seem disjointed as it includes brief information on a variety of issues. You must use all DLM materials along with Parts One, Two, and Three of the PPT. presentations in order to prepare for testing. NJ DLM Winter Training Part Three 2015 2 Required Test Window Testing may not begin until April 13. ◦ Ensure teachers do not start testing prior to this date. Testing must be completed by May 15. ◦ Ensure teachers do not test after this date. Testing conducted outside the New Jersey testing window will be invalidated. ◦ Students will not receive results, and districts will be in breach of the required testing conditions. NJ DLM Winter Training Part Three 2015 3 LEP ELA Exemption If a student has entered the United States after July 1, 2014, AND is currently enrolled in a language assistance program, this student is EXEMPT from the DLM ELA assessment. This student must participate in the DLM math test. NJ DLM Winter Training Part Three 2015 4 DLM Non-Participants and Data Record Requirement If a student is not able to participate based on the Office of Assessment’s testing policies, or due to parent refusal, he/she still must be included in the DLM data file. ◦ For example students who are ill and not receiving instruction during the five week testing window. All DLM students, including those can’t participate, must have their name and other data included in the district/school enrollment and roster files. ◦ This ensures the student is captured in the assessment data file. ◦ You do not need to complete a First Contact and PNP survey for those students who you know in advance will not participate. NJ DLM Winter Training Part Three 2015 5 Demo Practice Testlets Refer to the Test Administrator’s manual for information on available practice testlets. Generic practice testlets related to different PNP selections are available. These start with demo for the login info. Personalized practice testlets are not available in the DLM system. The practice test button on the DLM does not function. Do not login to the student’s account as there are no practice tests associated with his/her login ID. NJ DLM Winter Training Part Three 2015 6 Prompting Not Allowed Verbal, gestural, model, and physical prompting is not allowed in the DLM system. Students may not be given any help to answer the questions. If a student does not answer a question, the test administrator may repeat the test question and then pause an appropriate amount of time for a student to process the question and select an answer. If a student does not answer the question the teacher must mark “no response” when it is listed as one of the response options. If a student does not answer the question but “no response” is not a response option, then do not mark any option. Continue to the next test question after leaving the prior answer blank. 7 NJ DLM Winter Training Part Three 2015 Clarification Allowed if Needed Some test item directions ask the teacher to say “Show me the ….” This may not be the language you typically use when asking a student a question. When necessary, after stating the phrase “Show me the …,” you may restate the phrase for clarification by saying either of the following: ◦ “Look at the …” ◦ “Point to the …” ◦ “Touch the …” For example, the teacher may say “Show me the red marker.” Then for clarification the teacher says “Point to the red marker.” 8 NJ DLM Winter Training Part Three 2015 PNP and Computer Read Aloud As you know from the previous presentation, computer, synthesized read aloud is no longer available. Districts do not need to change a PNP if computer (synthesized) voice was selected for testlet read aloud. ◦ DLM will change NJ students’ PNPs from computer read aloud to teacher read aloud where necessary. ◦ This should occur after March 13, 2015. The test administrator will provide the testlet read aloud for students, regardless of whether the PNP indicates synthesized or teacher read aloud feature. NJ DLM Winter Training Part Three 2015 9 Who Can Administer the DLM? The student’s primary certified special education teacher The student’s certified math or English teacher The student’s long term substitute teacher who holds a NJ teaching certificate and has a district employment contract The student’s primary teaching assistant ONLY IF he/she holds a NJ teaching certificate ◦ These teaching assistants are fully certified teachers and are not employed as full time classroom teachers but employed as assistants The student’s primary SLP who works with the student on a weekly basis 10 NJ DLM Winter Training Part Three 2015 Who Can Not Administer the DLM? Any individual without a NJ teaching certificate such as a nurse or nursing aide non-certified teaching assistant administrative assistant teaching intern and other similar school personnel Also any individual that does not have direct interaction with the student on a regular basis may not administer the DLM, regardless of holding a NJ teaching certificate Test Administrators must be a NJ certified teacher with whom the student is familiar. 11 NJ DLM Winter Training Part Three 2015 Test Administrators and Rosters The student’s primary certified special education teacher, the student’s certified math or English teacher, or the student’s certified long term substitute teacher will be the primary test administrator. He/she must have a student roster submitted with the names of the students for whom they will administer the test. ◦ This generates a list of students associated with the teacher who delivers the ELA and math instruction. ◦ The roster is used to provide access to a student’s test ticket. The teacher will use his/her Educator Portal login ID and password to retrieve each students’ test tickets for every generated testlet. ◦ The roster will be used to generate score report data at the classroom level. NJ DLM Winter Training Part Three 2015 12 Test Administrator Info Schools with a high number of DLM students have asked for clarification regarding test administrators. The following slides are to be considered in conjunction with the previous presentations, and should provide additional details on certain testing scenarios. NJ DLM Winter Training Part Three 2015 13 Additional Test Administrators If a district with large numbers of students testing needs to enlist additional staff members to administer the DLM, certain requirements apply. ◦ Additional staff members who may be authorized to administer the DLM include: the student’s primary teaching assistant ONLY IF he/she holds a NJ teaching certificate, the student’s primary SLP who works with the student on a weekly basis, and a Child Study Team members who holds a teaching certificate. These staff members are eligible ONLY IF they regularly work with the student, AND ONLY IF the student is comfortable with the staff member. These staff members must complete all training requirements including completion and passing of the seven test administrator modules, reviewing all DLM materials, and signing the test security agreements. NJ DLM Winter Training Part Three 2015 14 Additional Test Administrators The additional staff members authorized to administer the DLM may test students in their classrooms, or in another setting, as determined by the classroom teacher/primary test administrator. Please note students tested by the additional authorized test administrator will remain on the primary classroom teacher’s DLM roster. A separate roster will not be produced for additional staff members conducting the DLM administration for the primary teacher. Primary teachers of DLM students will obtain the student test tickets and TIPS pages needed by the authorized additional test administrator. ◦ This information must be given to the authorized test administrator, along with any needed manipulatives or other test materials, immediately prior to the administration. NJ DLM Winter Training Part Three 2015 15 Test Ticket Info In order to retrieve a testlet, the test administrator must have the student’s login ID and password. This gives you access, under the Test Management tab, to the code associated with the testlet. This code allows one to obtain the Test Information Page that lists the manipulatives/objects needed for testing and other important information. NJ DLM Winter Training Part Three 2015 16 Test Ticket Retrieval Only the primary test administrator may access the test ticket (obtain the testlet code using the student login ID and password). Only the primary test administrator may access the TIPs page in order to gather the necessary objects and manipulatives needed during testing. The information for the first testlet in each subject may be obtained no more than one week in advance. The remaining testlet info will be obtained as soon as it is needed, though not before one week of the administration. NJ DLM Winter Training Part Three 2015 17 Security of Test Tickets and TIPS Pages All student test tickets and all TIPS pages must be kept secure at all times. Student test tickets and TIPS pages must only be viewed by the student’s teacher/Primary Test Administrator, and when necessary, the additional Test Administrator. No other district staff may view the test tickets or TIPS pages. These tickets and TIPS must be given to the additional test administrator right before the test administration, and all pages must be returned to the teacher immediately after testlet completion. This paperwork may not be copied or retained in any way. Assessment Coordinators must collect all student tickets and TIPS pages from the test administrators and destroy them. You may choose to do this daily or weekly, but you must ensure its security until destroyed. NJ DLM Winter Training Part Three 2015 18 Can Anyone Assist the Test Administrator During Testing? Only under specific circumstances is another staff member allowed to give assistance during the DLM administration. All staff members involved with DLM to any degree must sign the role specific New Jersey DLM Test Security Agreement and give it to the Assessment Coordinator. 19 NJ DLM Winter Training Part Three 2015 Can Anyone Assist the Test Administrator During Testing? Allowable Assistance Including Purposely Viewing the Testlets in order to Translate: A staff member may translate all directions and test information into American Sign Language, other signed language, or foreign language when necessary. ◦ Test translators are the only other staff members who may purposely view the 20 DLM testlets. NJ DLM Winter Training Part Three 2015 Can Anyone Assist the Test Administrator During Testing? Allowable Assistance Without Purposely Viewing the Testlets If a student needs an adult present for safety, behavioral, or medical needs, he/she may be present but may not deliberately view the screen, may not read the testlets, and may not document or reveal in any way the information overheard during the administration. ◦ Sometimes it is necessary for the support person to sit directly behind or next to the student. Doing so may naturally place the computer screen in the person’s view. If this cannot be avoided then it is the person’s responsibility not to actively read the contents on the screen. The support person may not interfere or assist with the test administration in any way. This includes but is not limited to assisting the student answer test questions, prompting the student, reminding the student that he/she has learned this skill, etc. He/she may only assist the student with non-testing needs as necessary. The assistant must be under the direction and in the presence of the test administrator at all times. ◦ Staff acting as assistants may include a nurse or nursing assistant, teacher’s aide, student’s one-to-one personal aide, etc. 21 NJ DLM Winter Training Part Three 2015 Test Security and Staff Any educator not authorized to be a test administrator MAY NOT observe, view, access, etc., DLM secure materials for any students at any time. ◦ Secure materials include the testlets both before and after completion, student tickets, and TIPS pages. Any educator authorized to be a test administrator BUT not in the process of a test administration MAY NOT observe, view, access, etc., DLM test materials for students not on their roster. See the previous slides for details on test administrator assistants. Assessment Coordinators may only view the computer screen if and when a technical issue arises that must be addressed. ◦ He/she may not observe individual test sessions and may not have access to any secure test materials. Assessment Coordinators may observe testing from a distance if necessary to ensure schedule adherence but may not view the computer screen nor have access to any secure materials/information. Technical Liaisons may only view the computer screen if and when a technical issue arises that must be addressed. 22 NJ DLM Winter Training Part Three 2015 Test Security and Staff Anyone that does not have an authorized role in the DLM administration may not have access to any secure test materials, may not observe testing, and may not substitute for any test administrator. Even those who have authorized roles have restrictions on secure material access, including primary and additional test administrators, Assessment Coordinator, Data Steward, Technical Liaison, and support staff needed for safety, behavioral, or medical needs of students. ◦ See prior slides for restrictions for authorized staff. NJ DLM Winter Training Part Three 2015 23 Required Signatures on Test Security Agreements All staff members involved with DLM to any degree must sign a Test Security Agreement and give it to the Assessment Coordinator. This includes primary and additional test administrators, test administration assistants for student support, Assessment Coordinators, Technical Liaisons, Data Stewards, etc. Test Administrators will have to sign both an online DLM form and a paper NJ DLM agreement. Separate signed test security agreements are required for student support assistants, Assessment Coordinators/Technical Liaisons/Data Stewards, and other administrators. All test security agreements will be posted to the DLM NJ webpage by the end of March. Everyone must sign their applicable agreement as soon as it is distributed in district, but no later than April 6, 2015. NJ DLM Winter Training Part Three 2015 24 Additional Schedule Form You must document in writing which staff member administered each testlet to each student. The schedule form included in Part Two helped you plan who would administer and when the tests would occur. The form on the next slide helps you document who the test administrator was and to see at a glance the status of student testing. You can model this form using Word, Excel, or any basic publishing program. NJ DLM Winter Training Part Three 2015 25 Simple Form to Track Completion Grade 4 DLM Students - Mrs. Mont’s Class John Simon Lakeisha Mary Juan ELA Math ELA Math ELA Math ELA Math ELA Math Testlet One 4/15 Sue Mont 4/15 Sue Mont 4/16 a.m. J. Mouse 4/15 J. Mouse 4/13 a.m. Sue Mont 4/13 a.m. Sue Mont 4/21 S. Mont 4/21 S. Mont 4/23 S. Mont 4/23 S. Mont Testlet Two 4/20 4/20 4/16 p.m. 4/23 a.m. 4/13 p.m. 4/13 p.m. 4/22 4/22 4/24 4/24 Sue Mont Sue Mont J. Mouse J. Mouse Sue Mont Sue Mont J. Mouse J. Mouse S. Mont S. Mont 4/22 4/22 4/23 p.m. Sue Mont Sue Mont J. Mouse Testlet Three Testlet Four Testlet Five Testlet Six Testlet Seven This form allows you to see at a glance which testlets have been administered. NJ DLM Winter Training Part Three 2015 26 Simple Form to Track Who Administers Test Grade 4 DLM Students - Mrs. Mont’s Class John Simon Lakeisha Mary Juan ELA Math ELA Math ELA Math ELA Math ELA Math Testlet One 4/15 Sue Mont 4/15 Sue Mont 4/16 a.m. J. Mouse 4/15 J. Mouse 4/13 a.m. Sue Mont 4/13 a.m. Sue Mont 4/21 S. Mont 4/21 S. Mont 4/23 S. Mont 4/23 S. Mont Testlet Two 4/20 4/20 4/16 p.m. 4/23 a.m. 4/13 p.m. 4/13 p.m. 4/22 4/22 4/24 4/24 Sue Mont Sue Mont J. Mouse J. Mouse Sue Mont Sue Mont J. Mouse J. Mouse S. Mont S. Mont 4/22 4/22 4/23 p.m. Sue Mont Sue Mont J. Mouse Testlet Three Testlet Four Testlet Five Testlet Six Testlet Seven Districts must document which authorized staff member administered the testlets to each student. NJ DLM Winter Training Part Three 2015 27 Engagement Activities Engagement activities are present in the math and ELA reading testlets. The engagement activities do not require a student response to a DLM test question. The test administrator will engage the student in the activity and may ask factual questions. The activities are meant to give the student a context for the questions, taps and activates prior knowledge and experience, and/or introduces the concept(s) to be addressed. NJ DLM Winter Training Part Three 2015 28 Engagement in Math Each math testlet will have an engagement activity prior to the first test question. The test administrator may choose to ask the student factual questions about the text and graphics to facilitate interaction with the material. The engagement activity does not require a response; it is meant to give the student a context for the questions and activate prior knowledge. NJ DLM Winter Training Part Three 2015 29 Engagement in ELA - Reading The first time the text is read acts as the engagement activity. This first read-through is considered a shared reading activity. The test administrator may ask factual questions about the text and graphics. This is to facilitate student interaction and engagement with the information, with the hope of promoting student comprehension. ◦ For example, “what is the boy holding in the picture?”, “how many turtles are on the rock?”, etc. NJ DLM Winter Training Part Three 2015 30 ELA Reading Engagement – Video of Classroom in Westampton The next slide includes a video of a fourth grade student and his teacher, Ms. Katie Hicks. She is engaging the student in the first read of the text. As you listen to the video, notice the factual questions she asked her student about the text and graphics. Reminder that you may not provide the same level of interaction the second time the student reads the text. ◦ The second read is strictly for assessment purposes, and the student must read/listen to the text and answer the questions without teacher engagement. NJ DLM Winter Training Part Three 2015 31 ELA Reading Engagement – Video of Classroom in Westampton Click on the box below to run the video. Click again to pause/restart, or to stop. NJ DLM Winter Training Part Three 2015 32 Writing Testlets Each student will receive one writing testlet. DLM assess both emergent writing and conventional writing; each student is assessed on one of the two types. Writing testlets are similar to DLM teacher administered testlets in reading and math. The test administrator engages the student in a scripted activity outside of the KITE system. The test administrator then enters observations and ratings into the system. Writing testlets take 10 to 20 minutes. See the Frequently Asked Questions about DLM writing on the website location www.dynamiclearningmaps.org/sites/default/files/docu ments/ERP/writing_FAQ_SP15YE.pdf NJ DLM Winter Training Part Three 2015 33 Submission of Testlets Only the test administrator may use the Submit button when each testlet is completed. A testlet cannot be retrieved and reopened once it is submitted. If a student could not answer a test question and it was left blank, the DLM system will still allow the testlet to be submitted once all questions are viewed and the student answered as many questions as he/she could. NJ DLM Winter Training Part Three 2015 34 Emergency Plan Each school must have a plan to ensure a smooth test administration for all students. That includes ◦ Not planning fire drills, practice school lock downs, or other drills during the test window. ◦ Having a plan in place to adjust test schedules or use authorized alternate test administrators during unexpected absences of the primary teacher/test administrator. ◦ Ensure all teachers understand how to handle temporary test disruptions and completion of testlets based on the DLM training materials. NJ DLM Winter Training Part Three 2015 35 Test Security Test security including submitting accurate and authentic student responses, maintaining confidentiality of the test materials, following DLM procedures, and properly implementing all DOE Office of Assessments policies are the responsibility of all school and district staff. All staff must fulfill their roles and responsibilities, including participating in training and reviewing all applicable test materials, in order to correctly and accurately conduct DLM testing. ◦ Failure to review and or implement the training requirements does not alleviate one the responsibility of maintaining all requirements. Improper test administrations can result in professional and financial consequences for school and district staff. NJ DLM Winter Training Part Three 2015 36 Test Security Agreements • All staff involved in the DLM must sign a test security agreement. •All agreements will be reviewed and kept by the Assessment Test Coordinator. •Failure to sign an agreement does not prevent the implementation of professional and/or financial consequences in the event of a test breach. •Test security agreements will be available on the DLM NJ page at the end of March. NJ DLM Winter Training Part Three 2015 37 Prevention of Security Breaches All security breaches are preventable when all staff are trained and implement all required procedures. Assessment Coordinators and other school administrators should ensure that all staff understand the need and requirement for proper test procedures. The following slides indicate some but not all issues resulting in a security breach. 38 NJ DLM Winter Training Part Three 2015 Types of DLM Security Breaches Testing outside the DOE scheduled window Prompting the Student Helping the student answer the questions Removing/reducing answer choices Submitting answers that the student did not provide Changing a student’s answer Cueing the student through words, inflection of words, through use of manipulatives, etc. Asking the test question again after the student already responded 39 NJ DLM Winter Training Part Three 2015 Types of DLM Security Breaches Completing testlets for the student, with or without his/her presence (not the same as scribing a student’s answers) Viewing the testlet, teaching to the contents, then testing the students Leaving computer/tablet unattended with testlet open Allowing staff members who are not the test administrator to see the test questions, directions, TIPS pages, etc. Allowing a staff member to be a test administrator when they do not meet the DOE requirements. Retaining in any form secure test materials including test items, TIPS pages, DLM testlet code numbers, etc. 40 NJ DLM Winter Training Part Three 2015 Types of DLM Breaches Knowingly providing inaccurate information on the First Contact survey Providing too much information during the engagement activities for ELA. ◦ Example, during the second read of the ELA passage, providing assistance on the comprehension of the text and graphics. Any other action that provides inauthentic student work/test responses Any other action that violates the test security agreements regardless of whether it was signed 41 NJ DLM Winter Training Part Three 2015 Security Breach Reporting Contact [email protected] immediately if a security breach is suspected or has occurred. Provide your CDS code, district, school, and contact name, and include the suspected/known nature of the test breach. Include the words Test Security Breach in your email subject line NJ DLM Winter Training Part Three 2015 42 Irregularity Reporting vs. Information Used for Score Interpretation For the DLM, some test administration information is best kept as a record in district to assist during score interpretation. Other information needs to be reported to the Office of Assessments as an irregular test administration. The next two slides differentiate these two concepts. NJ DLM Winter Training Part Three 2015 43 Information for Use When Interpreting Scores Some issues may occur testing which a district will want to document but does not require informing the Office of Assessments. These issues may or may not impact a student’s score. Issues such as the following may be documented in district using the NJ DLM teacher observation form: ◦ changing testing locations due to noise or other factors, changing test administrators, pausing testing to assist student with medical, personal care, or behavioral needs, cancelling and rescheduling a test administration, etc. More information on documenting these types of issues will be provided with the NJ DLM teacher observation form. NJ DLM Winter Training Part Three 2015 44 NJ DLM Teacher Observation Form This form is also used to make notes about the student’s test circumstances in order to consider future testing needs. Info such as where the student was tested, and if the location was conducive to testing, is one example of observation notes. Another example is to indicate any PNP change you think would be appropriate for the future, based on the current test features. This form and directions will be available on the DLM NJ webpage by April 6. NJ DLM Winter Training Part Three 2015 45 Irregularity Reporting An irregularity report must be completed and a copy sent to the Office of Assessments when a test accessibility feature is not delivered based on the student’s PNP, when the test technology fails or significantly delays a test, and when the testlet does not provide all components. This form, along with directions for completion, will be placed on the DLM NJ website on April 6. NJ DLM Winter Training Part Three 2015 46 Irregularity Reporting Complete an irregularity report and send a copy to the Office of Assessments if any of the following occur: If a test accessibility feature is not delivered. First check the PNP for confirmation of selection of the feature. If it is selected and it was not delivered, complete the report If the KITE status systems indicates a green light (system is functioning), but the test technology fails or significantly delays a test, complete the report. If the online testlet not provide all components (e.g. response options are missing, etc.), complete the report. If a test administrator failed to provide the student the required manipulatives, objects, or other necessary materials, complete the report. If the wrong student login ID and password were used for a test administration, complete the report. See the completion directions for more information, posted on the DLM NJ webpage on April 6. NJ DLM Winter Training Part Three 2015 47 Three Year Document Storage All test security agreements, documentation of which educator administered each testlet, copies of irregularity reports, and teacher observation forms must be securely retained in district for a minimum of three years. The teacher observation forms may be shared across teachers when planning future DLM administrations including adjusting student PNPs, etc. NJ DLM Winter Training Part Three 2015 48 Check for Updates Often View the DLM NJ webpage often to obtain test material updates. This is also where you will obtain the test security agreements, irregularity report form, and test administrator observation form. DLM continues to update their information and it is a district’s responsibility to use all of the newest documents. Go to www.dynamiclearningmaps.org\newjersey for all materials and updates often NJ DLM Winter Training Part Three 2015 49 Acknowledgments I would like to thank the many dedicated educators who assisted the Office of Assessments in preparing for the transition to DLM. Your assistance with field testing, the development of new policies, reviewing test materials, and providing guidance on a variety education topics, is greatly appreciated! NJ DLM Winter Training Part Three 2015 50
© Copyright 2024