1. No category

CAA SITE VISITS 2011
WHAT TO EXPECT
HOW TO PREPARE
Thursday, 11/18/10
12:00 – 1:00 pm
Marriott Hotel, Franklin Hall, Level Three - Room 8
CAA Site Visit Subcommittee
ƒ
ƒ
ƒ
ƒ
ƒ
ƒ
ƒ
ƒ
Dan Halling, chair
Michele Anderson
Jane Baran
Newell Decker
Elaine Frank
Candace Ganz
Judith Page
Rosalind Scudder
2
Today’s Objectives
ƒ
ƒ
ƒ
ƒ
Site Visit -- purpose & timing in review
Agenda Development & Logistics
Preparing documentation
After the Site Visit
z
z
z
Site Visit Report
CAA’s final review and decisions
Evaluations and performance feedback
ƒ Update on CAA activities and policies
3
Purpose of the Site Visit
ƒ One of several mechanisms used by CAA to
determine compliance with the Standards for
Accreditation
ƒ Review by a team of peers
z
z
z
verifies the accuracy of information provided in the
application about each accreditation standard
resolves any questions or concerns that resulted from
review of the application
provides additional information to CAA to make
accreditation decisions
4
Purpose of the Site Visit
ƒ Past verification looked only at
the process.
ƒ Now, in addition to reviewing
the policies and processes, we
look at
z
z
how well the program meets its
goals
whether the program is successful
with respect to student
achievement
5
A few basic questions...
ƒ What should your graduates
look like?
ƒ How did you determine this?
ƒ Did you share this vision with
all students, faculty, and
supervisors?
ƒ How are these elements
assessed and improvements
made?
6
Prior to the Site Visit
ƒ CAA reviews application & provides initial
observations back to the program
ƒ Program has opportunity to respond to
observations and provide updates about
new faculty hires.
ƒ Site visit team is given access to the
application materials, CAA’s initial
observations, & the program’s response
7
Does the program have input on
when the visit occurs?
ƒ YES. The program identifies the dates
for site visit team to come to campus.
z
Team expected to see “typical” days in the program
• Don’t provide dates during Spring Break or Final Exams!
z
Bear in mind dates of other accreditation site visits that
may affect the program (e.g., NCATE)
• CAA is happy to coordinate simultaneous visits with sufficient
notice.
ƒ Potential dates should be provided to
Accreditation Office staff when application is
submitted.
z
Send to R’Chelle Mullins ([email protected])
8
Team Composition
How many people are coming to campus?
ƒ Standard team (single professional area) = 3 members
z
z
z
2 academics + 1 practitioner
Team for SLP-only = 3 SLPs
Team for audiology-only = 3 Audiologists
ƒ Standard team for SLP & audiology
= 4 members
z
z
1 academic from each professional area +
1 practitioner from each professional are
ƒ Trainees or observers may accompany team
9
Does the program have input on
who serves on the team?
YES!
ƒ Program is asked to eliminate individuals from the
site visitor roster that pose a conflict of interest
before the visit is scheduled.
ƒ In addition, site visitors are asked to identify
programs that may be a conflict of interest for them
to serve as a site visitor.
10
Observers on Site Visits
ƒ Members of the CAA routinely observe site
visits to
z
z
complete CAA members’ education
allow opportunity for assessment of site visit
process for consistency, best practices, and ideas
for training and continuing professional
development for pool of site visitors
ƒ Individual programs are not the focus of the
observers participation in the visit
z
CAA has established precautions to protect
program if/when an observer is assigned
11
Myth vs. Fact #1
ƒ Site visitors have the authority to
recommend accreditation status for a
program, including probation.
ƒ No, the above statement is a MYTH. The role of the
site visitors is to verify evidence of a program’s
compliance with accreditation standards.
The CAA has the sole authority to make accreditation
decisions, considering information contained in the
site visit report, as well as any updates provided by
the program in its response to the site visit report.
12
Agenda Development &
Logistics
ƒ Who is responsible
for what?
ƒ And when?
13
Who’s responsible for
developing the agenda?
ƒ Program Director should take the lead to prepare a draft
z
z
Build-in time for breaks and travel between locations if events are
scheduled in different buildings
Sample agendas provided in the Site Visit Manual
(http://www.asha.org/academic/accreditation/svmanual/ )
ƒ Consult with the Site Visit Team Chair at least 30 days in
advance
z
z
Share draft agenda
SV Team Chair will make recommendations
about order of events, logistics, people, or time
ƒ SV Team Chair has final authority
for agenda
14
On-site Scheduling
ƒ Site visitors can be separated:
z
z
to visit with individual faculty and supervisors, if
time permits
for public and/or student meeting(s), as
appropriate
ƒ Site visitors should be scheduled together for
meetings with Program Director, Dean,
Provost, etc.
ƒ It is not necessary to schedule observations
in the clinic.
15
How long will the team be
visiting?
ƒ Standard visit is 2 full days
z
z
Monday-Tuesday
Thursday-Friday
ƒ Days may be added if the
program
z
z
z
Has multiple campuses
Has satellite campus(es)
Is part of a consortium
16
Who participates in the visit?
ƒ Program Director, Clinic Director, Dept. Chair (if
different than program director)
ƒ
ƒ
ƒ
ƒ
ƒ
ƒ
ƒ
ƒ
Full- and part-time academic faculty
Clinical educators & supervisors (on- & off-campus)
Administrators: deans, provost, president
Students & Alumni
Support staff
Employers
Clients & their families
Members of the campus or local communities...
17
What do I need to do about organizing a
“public meeting”?
ƒ CAA policy requires programs to schedule meetings for
students and consumers
z
separate meetings may be held for each
ƒ Must “widely” publish an announcement
z
z
no later than 15 days prior to the site visit
program determines vehicle (campus/local newspaper, clinic or
campus flyers, etc.)
ƒ Announcement should indicate
z
z
date, time, & place of meeting(s) with site visitors
how CAA Standards and/or Policy on Public Comment may be
obtained
ƒ Access policy online:
http://www.asha.org/academic/accreditation/svmanual/part4.htm#pu
18
blic_comment2
Public Comments
ƒ Can programs solicit public comments
for submission to CAA before the visit?
ƒ Yes. Programs may contact students, alumni, clients,
community members, etc. to inform them about the
options to provide comments before or during the
site visit. CAA’s Policy on Public Comment
outlines the process for submitting information to the
CAA.
ƒ Written comments must be signed and include
contact information to allow for verification.
ƒ Any comments are not shared directly with
programs; rather they are considered as part of the
aggregate data.
19
Will the team need to go off-campus to
conduct reviews/interviews?
ƒ Not necessarily. Phone interviews can be
conducted with external supervisors,
employers, or alumni.
ƒ If there is not an on-campus
clinic, teams prefer to go to
regularly used clinical site(s)
close to campus, if possible.
20
Logistics for site visit team
ƒ Secure work space/office
ƒ Access to computer with
printer & Internet
ƒ Access to phone for
interviews
ƒ Restaurant/food options
ƒ Assistance with
transportation
21
Logistics: Hotel Accommodations
ƒ Program director
z
z
selects hotel, makes reservations
will provide visitors with hotel contact
information
ƒ Site visitors
z
z
may need to contact hotel to guarantee
room
will pay for room (and is then reimbursed
by ASHA/CAA)
22
Myth vs. Fact #2
ƒ The program should provide evening
entertainment while the site visitors are in
town.
ƒ The above statement is a MYTH! The site visitors are
expected to meet with their teammates in the
evenings to prepare for the next days’ events. Also,
social activities may be perceived as a conflict of
interest for the visitor during the time of the visit.
ƒ Other examples of conflicts for site visitors would be:
z
z
z
z
z
z
Asking for or accepting gifts
Accepting or requesting a sample of wares
Accepting payment for meals
Recruiting instructional staff
Recruiting students
Accepting employment positions
23
Documentation
ƒ What will site visitors
be looking for?
ƒ Information that
provides evidence that
the program is
complying with all
standards.
24
Documentation on-site is used by
site visitors to:
ƒ verify information from
application
ƒ ensure policies are in
practice – and practices
are in policies
ƒ confirm student
achievement/progress
tracking
25
What will they expect to see?
ƒ Documentation should be prepared for the site
visitors.
z
Two key online resources that help identify these can
be found on the Site Visit section of the Web site
• Review Materials for CAA Site Visit
• 2008 Sources of Data (in Site Visit Manual)
ƒ Examples of on-site documentation include:
z
z
z
z
Handbooks (University/Department/Program)
All course syllabi
Assessment instruments and data
Lists of student files, current and past 3 years
26
Documentation Prep/Access
ƒ Consider making
key documentation
available to the Site
Visit team in
advance of the visit.
z
z
z
Virtual
Workroom/library
Web site
Flash Drive
27
Access to files
ƒ FERPA - students
z
z
Allows access to student files for purposes of
accreditation
Site visitors will not record or report any identifying
information.
ƒ HIPAA - clinic “covered entity”
z
z
Need release forms to access client files or site visitors
may sign a form acknowledging confidentiality
Program may prepare files to strip all identifying
information, but it is not necessary.
28
Myth vs. Fact #3
ƒ Site visitors will expect to find a “KASA”
form for each student.
ƒ The above statement is a MYTH. The CAA does not
require programs to keep a Knowledge and Skills
Acquisition (KASA) summary form in each student file.
[The KASA form was developed to assist in tracking for
ASHA certification process.]
However, evidence should exist for tracking a student’s:
z
z
z
z
acquisition of knowledge and skills
supervised clinical practicum hours
progress toward graduation
progress toward state and national credentials
29
Myth vs. Fact #4
ƒ Site visitors’ in-depth knowledge of the
program is typically limited to the current
accreditation application and related
resources, (e.g., program’s Web site).
ƒ The above statement is a FACT. The site visit team
is not provided past applications or annual reports for
their review for the visit. Nor is a history of the
program’s identified strengths and limitations provided.
Site visitors are encouraged to review the Web pages
of the program and university to verify data and its
currency.
30
Site Visit Report
ƒ Site visit team is required to generate a
report of the site visit.
ƒ Site visit report
z
z
becomes official record of team’s
observations
considered a critical element by the CAA to
make fair, impartial, and informed
decisions on program’s accreditation
31
Report of the Site Visit
ƒ Presented twice to the program:
z
z
orally at end of visit (Exit Report)
written and submitted to
Accreditation Office within 30 days
of the visit
ƒ Program can expect to receive
their written copy 6-8 weeks after
visit
32
Myth vs. Fact #5
ƒ Observations reported by the team may
be different than those identified by the
CAA in its initial review of the
application.
ƒ The above statement is a FACT. The Site
Visit team has access to documentation onsite that the CAA does not have while
conducting its initial review of the application.
As a result, the site visitors may offer a
different perspective on the program’s ability
to document compliance.
33
Site Visit Report response
ƒ Copies of the site visit report are sent to:
z
z
Program Director
President or designee, such as the provost or
dean - whoever signed the application
authorization
ƒ Both entities are offered opportunity to
provide written response within 30 days
regarding the accuracy of the site visitors'
observations before the CAA makes a final
accreditation decision.
34
CAA Decisions
ƒ CAA makes most final accreditation
decisions at face-to-face meetings
2x/year
z
z
Spring site visits = July meeting
Fall site visits = February meeting
ƒ Programs can typically expect decisions
3-5 months after site visit; 12 months
after application submission
z
… and no later than 30 days after the meeting
35
Myth vs. Fact #6
ƒ The site visit team’s findings are the only
data used by CAA for final accreditation
decision and citations.
ƒ The above statement is a MYTH.
z
z
The CAA considers all information, from the
accreditation application through the program’s
response to the site visit report and any program
updates, to determine a program’s compliance with
each standard and the resulting accreditation
decision.
The CAA’s final decision and citations may differ
from SV team observations, as the CAA has access
to updated information from the program after the
site visit.
36
Evaluations
ƒ Complete and return your Site Visitor
Evaluations immediately following the
site visit, in order to provide
performance feedback on each
member of your site visit team.
ƒ The new evaluation form includes a
numeric rating system along with
consolidated knowledge and skill
areas, as tied to specific roles,
responsibilities, and expected
behaviors of site visitors.
ƒ It can be accessed online as an
appendix to the Site Visit Manual.
37
Myth vs. Fact #7
ƒ Returning completed site visitor
evaluations before the final decision is
rendered will affect the results of the
accreditation decision.
ƒ The above statement is a MYTH! The
evaluations are used to improve the site visit
process and performance of site visitors.
Evaluation materials are not considered when
the CAA renders accreditation decisions.
38
Update on CAA Activities
ƒ
ƒ
ƒ
ƒ
ƒ
ƒ
New Reporting Requirements
Policy Updates
Higher Education Data System
Accreditation Decisions
CAA Volunteer Opportunities
New Online Resources
39
New Reporting – Standard 4.5
ƒ Standard 4.5 – NEW STANDARD
z
z
all programs must submit documentation of
compliance after January 1, 2011
addendum available online at
http://www.asha.org/academic/accreditatio
n/CAAHES.htm
ƒ Spring 2011 site visits –
z
provide an addendum 30 days in advance of site
visit
ƒ Fall 2011 site visits –
z
submit addendum by February 1 (same time as
application is due)
40
New Reporting – Standard 6.1
ƒ CAA is required by USDE to regularly
monitor financial stability of its programs.
z
Application for Accreditation
• Questions about financial information are included
in the HES.
z
Annual Report
• Programs must file addendum with annual report,
as questions are NOT included in HES for annual
reports currently.
41
Policy Update
ƒ Change in Program
Director
z
z
Program must file
notice of change no
later than 30 days
after the change,
including sabbaticals
New reporting form is
available online
42
Policy Update
ƒ Change in Administrative
Structure
z
z
z
Program must file notice of
change no later than 30 days
after the change
Include new organizational chart,
description of continued
compliance with standards,
effective date
Details of policy and procedures
are in Accreditation Manual.
43
Policy Update
ƒ Requests for Submission Extension
z
Submit request no SOONER than 30 days
before due date with:
• Rationale
• Description of progress made so far on report
• Estimate of needed time (up to 45 days beyond
due date)
z
Extensions will not be granted for more
than 75 days from original submission
date.
44
CAA Reporting in the Higher
Education Data System (HES)
ƒ CAA Application
z
z
now open in HES through Feb. 1, 2011
Next round open April 1st -August 1st 2011
ƒ CAA Annual Reports
z
Now open in HES through Feb. 1, 2011
ƒ Access to CAA instruments in HES restricted
based on due dates/report type due
45
CAA Volunteer Opportunities
) Want to learn more about the accreditation
peer review process?
) Apply to become a site visitor
Accepting applications through January 2011
•
•
Apply to become a CAA member (term to begin
January 2012)
Call for Nominations in early 2011 for 3 positions:
•
•
3 academic audiologists
46
Practice Analysis & Curriculum Study
ƒ SLP study completed
2010
ƒ Audiology study
completed 2008
ƒ Full reports available
for sale at ASHA
Bookstore
(www.asha.org/eweb)47
SITE VISIT RESOURCES
ƒ Site Visit Manual
z
http://www.asha.org/academic/acc
reditation/svmanual/
ƒ Web site - www.asha.org
ƒ National Office staff
z
1-800-498-2071
• R’Chelle Mullins x5766
[email protected]
• Sue Flesher x5781
[email protected]
48
Visit Accreditation Staff
• Where?
•
at ASHA Member Services Center in the
Exhibit Hall
• When?
•
until 3:00pm Saturday
• [email protected]
49
QUESTIONS
50