Insider’s View of the Regenerated
Audiology and SLP Praxis® Tests
April 2015
Audiology: Janet Koehnke, Lisa Lucks Mendel
SLP: Fran Hagstrom, Melissa Passe
Praxis: Kathy Pruner
Copyright© 2014 by Educational Testing Service. All rights reserved. ETS, the ETS logo, LISTENING. LEARNING. LEADING., PRAXIS and THE PRAXIS SERIES are registered trademarks of Educational Testing Service (ETS). 27141
Panel Members
• Dr. Lisa Lucks Mendel, CCC-A – University
of Memphis
• Dr. Janet Koehnke, CCC-A – Montclair
State University
• Ms. Melissa Passe, CCC-SLP – Truman
State University
• Dr. Fran Hagstrom, CCC-SLP – University
of Arkansas – Fayetteville
• Ms. Kathy Pruner, MBA – Educational
Testing Service
Panel Topics
• Audiology
–
–
–
–
–
NAC Update
Curriculum crosswalk
Interactive practice test launch
Resources for test preparation
Latest performance data
• SLP
– Development of Regenerated Test
– Standard Setting Study Experience
– Results of Study and Performance To Date
• Praxis Update
– Test Dates
– Supporting Students
– Tools for Programs
Praxis® Audiology Test
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Audiology NAC Update
• 2014 meeting activities
• NSSLHA Day Panel Session Report
• Interactive Practice Test launched
December 2014
• Current and upcoming NAC work
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Audiology Curriculum Crosswalk
New
Interactive Practice Test
Interactive Practice Tests
•
Detailed explanations for correct answers to the
practice questions
• Content category scores indicating the number of
questions answered correctly in each content category to
help students understand their performance level
• Real test directions and questions similar to those seen
on test day
• A timer that simulates the actual test experience
• $17.95 for 10 uses or 90 days ($19.95 starting 6/1/15)
• Institutions - discount of 20% with purchase of 2 or more
http://www.ets.org/s/praxis/pdf/praxis_interactive_test_order_form.pdf
9
Interactive Practice Test Sample Screen
10
Resources
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Resources for Students
• Foundations, Prevention and Identification,
Assessment, Professional Issues
– Handbook of Clinical Audiology (2009)
• Katz, Medwetsky, Burkard, & Hood
– Audiology Diagnosis (2000)
• Roeser, Valente, & Hosford-Dunn
– Audiology Workbook (2008)
• Kramer & Guthrie
– The Audiogram Workbook (1988)
• Hepfner
– Balance Function Assessment and Management (2008)
• Jacobson & Shepard
– Vestibular Disorders: A Case-Study Approach to Diagnosis and
Treatment (2010)
• Furman, Cass, & Whitney
Resources for Students
• Intervention
– Foundations of Aural Rehabilitation (2008)
• Tye-Murray
– Hearing Aids (2012)
• Dillon
– Audiology Practice Management (2000)
• Hosford-Dunn, Roeser, Valente
Audiology Performance Data
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Audiology Pass Rates
Test
Code
N
Highest
Score
Pass Rate
N
First
Attempt
Pass Rate
September 2014 – March 2015 (partial year)
5342
585
82.7%
494
79.4%
September 2013 – August 2014
5342
&
0342
786
83.2%
579
75.1%
When Should Students Take the Test?
• Factors:
– Test design
– Exposure to clinical experiences
– Length of program
– Curriculum structure
Regeneration of the
Praxis Speech-Language
Pathology Test
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Regeneration: Our Commitment to Quality
Regeneration is a commitment to the highest quality and
most psychometrically sound assessments possible
• Speech-Language Pathology test reviewed on an annual
basis
• Ensures tighter alignment with national and
professional standards
• Incorporates the most current and critical research in
the field
• Maintains SLP test to be current, rigorous, and
psychometrically sound assessments.
• This translates to a legally defensible licensure program.
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
THE PRAXIS PROGRAM IN HAWAII
Creating Quality Assessments
• A National Advisory Committee (NAC) comprised of
practitioners is convened for both SLP and Audiology tests
– ETS solicits ASHA to provide nominations
• Annual Panel Meeting – 1st Regeneration Meeting
– ASHA standards and professional needs are considered
– Specifications focused on core knowledge essential for
beginning practitioner are formulated (test blueprint)
• Practice and Curriculum Analysis conducted
• 2nd Panel Meeting
– Finalizes test blueprint based on survey results
• Outside Item Writing Committee write items matched to
specifications
– Thoroughly reviewed by NAC, ETS test developers, ETS editors, and others
• Test form is assembled
Standard Setting Study for
SLP Test
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Standard Setting Study Highlights
•
•
•
•
1 panel met in Princeton, NJ in January 2014
16 states participated in the 2-day meeting
17 panelists in total
Panel composition:
– Speech-language pathologists practicing in
schools, private practice and medical facility
– College faculty who prepare SLPs
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Standard-Setting Process
The Test
Take the Test
Discuss the Test
The Training
Standard-Setting Training
Practice
The Judgments
Round 1 (Independent)
Discussion & Round 2
Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS. 22441
22
Determining the Target Candidate
• Who was the target candidate?
• Target candidate – just qualified to begin
practice safely and effectively
• Defining knowledge and skills for target
candidate
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Target Candidate Defined
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Standard Setting Judgments
What is the likelihood (probability or chance)
that a Target Candidate would answer the
question correctly?
No
Chance
0
Even
Chance
Certainty
.05 .10 .20 .30 .40 .50 .60 .70 .80 .90 .95
Very Likely
Very Unlikely
25
1
Results of Standard Setting
Study
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
What Does the Standard Setting Study
Report Provide for Setting the Score
• Recommended study value (RSV) is given on the raw
score metric, along with the percentage it represents
of the total available raw score points
– 74 out of an available 108 points which is 68.5%
• Scaled score associated with a raw score of 74 is a
162 on a 100-200 scale.
• ETS recommends staying within +/- 2 SEM’s (standard
error of measure) of the RSV and will provide the
scores representing +1, +2, -1 and -2 SEM’s above
and below the RSV
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
CFCC Determined ASHA’s
Operational Cut Score
• ASHA reviewed the information in the report and
provided all information to CFCC
• CFCC deliberated
– Review the results of the report
– Review a copy of the content specifications and a
form of the test(s)
– Factor in other considerations relevant to the field
of practice
• CFCC Decision - set 162 as required score
28
SLP Test Performance and
Interactive Practice Test
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
SLP – New and Old Test
Performance Comparison
Test
Code
N
Highest
Score
Pass Rate
N
First
Attempt
Pass Rate
September 2014 – March 2015
5331
4,948
90.9%
4,948
87.6%
September 2013 – August 2014
5330
&
0330
9,221
93.9%
8,607
93.6%
Interactive Practice Test for SLP
Copyright © 2013 by Educational Testing Service. All rights reserved. ETS, the ETS logo and LISTENING. LEARNING. LEADING. are registered trademarks of Educational Testing
Service (ETS). PRAXIS and THE PRAXIS SERIES are trademarks of ETS.
Praxis Update
Background on ETS
• Non-profit organization, founded in 1947; combined ACE,
Carnegie Foundation and College Entrance Examination
Board
• Mission: advance quality and equity in education for all
people worldwide
• ETS develops, administers, and scores
– 50+million assessments in
– 180 countries at over
– 9,000 locations worldwide
Copyright© 2014 by Educational Testing Service. All rights reserved. ETS, the ETS logo, LISTENING. LEARNING. LEADING., PRAXIS
and THE PRAXIS SERIES are registered trademarks of Educational Testing Service (ETS). 27141
33
Remaining 2015 Testing Schedule
Audiology Testing
Windows:
• 6/15/15 – 6/26/15
SLP Testing Windows
•
•
•
•
5/11/15 – 5/22/15
6/15/15 – 6/26/15
7/13/15 – 7/25/15
8/10/15 – 8/22/15
With computer tests,
students can register up to
3 days before test day and
not pay a late fee.
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
2015-2016 Praxis Testing Schedule
SLP Testing Windows:
• 9/8/15 – 9/19/15
• 10/5/15 – 10/17/15
• 11/2/15 – 11/14/15
• 11/30/15 – 12/12/15
• 1/4/16 – 1/16/16
• 2/1/16 – 2/13/16
• 3/7/15 – 3/19/1
• 4/4/16 – 4/16/16
• 5/2/16 – 5/14/16
• 5/30/16 – 6/11/16
• 7/4/16 – 7/16/16
• 8/1/16 – 8/13/16
Audiology Testing Windows:
• 9/8/15 – 9/19/15
• 11/30/15 – 12/12/15
• 2/1/16 – 2/13/16
• 4/4/16 – 4/16/16
• 5/30/16 – 6/11/16
Continuous testing project
underway. Audiology and SLP
tests will be offered on a
continuous basis in the future.
Supporting Students
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Did you know we offer…?
• ACCOMMODATIONS for students with disabilities or
health-related needs:
http://www.ets.org/praxis/register/disabilities?WT.ac=
praxishome_disabilities_121126
• EXTENDED TIME for students who primary language
is not English (PLNE):
http://www.ets.org/praxis/register/accommodations/
• FEE WAIVERS for students who may qualify due to
financial need:
http://www.ets.org/praxis/about/fees/fee_waivers/
• BULK REGISTRATION VOUCHERS http://www.ets.org/praxis/institutions/about/voucher_
orders/
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Important Test Prep Video for Students –
Computer-Delivered Testing Demo
38
Navigation Buttons on Test Screen
Copyright© 2014 by Educational Testing Service. All rights reserved. ETS, the ETS logo, LISTENING. LEARNING. LEADING., PRAXIS
and THE PRAXIS SERIES are registered trademarks of Educational Testing Service (ETS). 27141
Test Review Screen Assists Time Management
Copyright© 2014 by Educational Testing Service. All rights reserved. ETS, the ETS logo, LISTENING. LEARNING. LEADING., PRAXIS
and THE PRAXIS SERIES are registered trademarks of Educational Testing Service (ETS). 27141
Information for Programs
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Score Reporting Update
• Four free score reports – candidate select
recipients prior to test day
– For students planning to practice in school district,
many state education departments are automatic
score recipients
(http://www.ets.org/praxis/institutions/scores/receiv
ing/)
• Scores are sent to score recipients approximately
10 days after the close of the testing window
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Score Reporting Update 2.0
• Email notice now sent to institution’s
score reporting contact when scores are
available
• New program? – contact me to receive a
unique Praxis code separate from your
institution’s College of Education
• Not getting student scores?
– Is your Praxis code published on department
literature on website and does staff instruct
students to select you as a score recipient?
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Score Reporting 3.0
• Test takers see an unofficial score at the
conclusion of testing
• If a new form of the test is launched for
that test window, test takers receive raw
score category performance only.
– *When the total score appears as NS (No Score),
this means that further analysis must be
conducted before scoring can be completed. A
total score of NS does NOT indicate any problem
with the administration of your test and will NOT
result in any delay in the reporting of your official
scores.
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
SLP Curriculum Crosswalk
Sample Data Manager Report
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Category Performance Data Can Assist
Program Review
Copyright© 2011 Educational Testing Service. All rights reserved. ETS, the ETS logo and LISENTING. LEARNING. LEADING.
are registered trademarks of Educational Testing Service (ETS). THE PRAXIS SERIES is a trademark of ETS.
Important Support Links
• Institutional support: Denee West
– Phone: (866) 243-4088
– Email: [email protected]
• Praxis Connections Newsletter - sign up:
http://www.pages03.net/ets/PraxisMailingList/IHEOptIn/
• ETS Data Manager for The Praxis Series™
– http://www.ets.org/praxis/institutions/services_tools/data_mana
ger/
– For assistance with account set up or access, contact
[email protected]
Kathy Pruner,
Client Relations Director for ASHA and
CSD Programs
[email protected]
Copyright© 2014 Educational Testing Service. All rights reserved. ETS, the ETS logo, LISENTING. LEARNING. LEADING., Praxis and the Praxis
Series are registered trademarks of Educational Testing Service (ETS).
Questions?