How Young Learners Learn Languages and how to Test them Shelagh Rixon

How Young Learners Learn
Languages and how to Test them
Shelagh Rixon
© Copyright ALTE 2012
OR …
‘I can’t describe the perfect YL test in 40 minutes but I can try to open
discussion about
1.
2.
3.
2
the ways in which we want to educate Young Learners in foreign
languages
realistic goals to match age and language level
the test and assessment characteristics which we therefore need
consciously to promote and to talk about with the learners as
part of their learning to learn languages development.’
© Copyright ALTE 2012
Two definitions of ‘Young Learners’
 Ages 6 to 12 app
(covers primary school in
many contexts) – This is the least visited and
researched age group for testing (but not for
assessment in general)
 Ages 6 – 16 app
(covers compulsory schooling
in many contexts) – Testing teenagers is more
familiar than testing children
3
© Copyright ALTE 2012
Testing and assessment
Assessment -
an umbrella term covering
any systematic means of discovering and recording
how well someone is able to do something,
(including observation of normal classroom activity and
scrutiny of work done)
Testing - more formal challenges, usually with the
learner working outside the normal classroom modes.
Includes exams.
4
© Copyright ALTE 2012
Sources of information and ideas
 Two world surveys (Cambridge and British
Council) with questions on assessment
practices with Young Learners
 Examples of Young Learners Tests from the
ALTE group
 Acting as volunteer Teachers Assistant in UK
5
primary school where ‘Assessment for Learning’
© Copyright ALTE 2012
is strongly practised
Cambridge ESOL Survey on Testing and Teaching: 55
countries, 36 L1s, 726 respondents
6
© Copyright ALTE 2012
The British Council 2011 Survey on Policy and Practice
at Primary School Level: 64 countries, and counting ..
Expanding Circle
Algeria
Argentina
Azerbaijan
Brazil
Outer Circle
Denmark
Sri Lanka
Greece
Namibia
Egypt
India,
South India
Poland
Japan
France
China
Inner
Inner
Circle
Circle
UK USA
UK USA
India,
Tamil Nadu
Czech
Republic
Serbia
Bangladesh Hong Kong
Venezuela
Spain
Yemen
Bahrain
Senegal
Croatia
Sweden
Armenia
Turkey
Taiwan
Russia
Zambia
Uganda
Georgia
India,
Goa
Indonesia
Cyprus
Italy
Israel
Sierra Leone
Kazakhstan
Cameroon
Colombia
Peru
Lithuania
Kosovo
Latvia
Palestine
Uzbekistan
Saudi Arabia
7
Germany
Portugal
Qatar
Mexico
North Cyprus
© Copyright ALTE 2012
Cambridge ESOL survey: the balance of assessment
types by age group
Assessment of students in respondents' context
90%
Percentage of respondents
80%
70%
60%
50%
Tested formally with standardised tests
Tested informally in the class
40%
30%
20%
10%
0%
Students aged 6-11
8
Students aged 12-16
© Copyright ALTE 2012
Cambridge ESOL survey: assessment types in
primary and secondary
schools
Tests given in the textbook used
Rank order
in secondary
Tests produced by class
teacher
number of respondents
400
350
Standardised tests &
examinations
300
250
Self-assessment
200
150
Collection of students’ work in a
file or portfolio
100
50
0
age 6-11
age 12-16
Total use
9
in class
Observation & written
description of learner
performance
Peer-assessment
© Copyright ALTE 2012
Many assessment types, many purposes
e.g. accountability, certification, placement,
selection
Our focus today ‘Assessment for Learning’
which essentially means that …
10
© Copyright ALTE 2012
Testing and Classroom Assessment should work in
harmony with teaching and to some purpose
e.g.





11
to enable current teachers to notice patterns in learning
and behaviour and act accordingly
to raise learners’ awareness of what they can do and
need to do
to sharpen learners’ metacognitive skills
to introduce ways of demonstrating skills that also work
as frameworks for teaching
to inform other teachers what to expect from learners
© Copyright ALTE 2012
To inform other teachers what to expect from learners?
The British Council survey revealed a
depressing and not new waste of
testing/assessment effort between primary
and secondary school levels
12
© Copyright ALTE 2012
British Council Survey: Is information from assessment passed
on from primary to secondary schools?
always
often
quite often
sometimes
rarely
Never
0
13
5
10
15
20
25
30
© Copyright ALTE 2012
British Council Survey: Do primary and secondary
school English teachers meet to discuss transition
pupils?
14
never
27
rarely
16
sometimes
10
quite often
3
often
2
always
2
© Copyright ALTE 2012
…
to introduce ways of demonstrating skills that also
work as frameworks for teaching
15

High-status external tests have had an impact on
teaching content and focus in some school
systems

The introduction of oral tests of English from
Cambridge (or Trinity College) has shifted the
focus to speaking

The design of test tasks (e.g. interactive, not
rehearsed recitation) can also shift teaching focus to
a particular quality of speaking
© Copyright ALTE 2012
My assumption for today
That the Young Learners tests we are discussing
are professionally constructed but that we are
always striving to make them a ‘best fit’ for the
age groups in the following ways:
 What we think our learners can achieve
 The ways in which they can demonstrate it
 In what particular areas we want our learners to
achieve
16
© Copyright ALTE 2012
Weir’s contribution
17
© Copyright ALTE 2012
Our Focus Today
How to respect TEST-TAKER CHARACTERISTICS
Particularly AGE
and choose from an appropriate range of
COGNITIVE and LANGUAGE demands for the
ages of the learners
18
© Copyright ALTE 2012
Moving from being able to claim and show this …

19
© Copyright ALTE 2012
‘Chunk’ use with children
It is a common beginner strategy to speak in
memorised ‘chunks’ such as:
I like …
My name is x
My favourite ….. is …….
There is a ….
At what point in oral testing do we require, set up
challenges for, and reward ‘creative’ language use?
20
© Copyright ALTE 2012
At the ‘higher’ levels of age and language level, what
choices do we make?
 The next activity is a good example of one which
sets up a richer interplay of challenge but still at
a low (A1) language level
21
© Copyright ALTE 2012
DELF A1 Scolaire et Junior (12+)
Dialogue simulé (ou jeu de role) (2 minutes environ)
Instructions to the candidate:
Vous voulez obtenir un bien ou un service (acheter un objet, passer une commande...).
A partir des images que l'examinateur vous a remises, vous vous informez sur le(s)
produit(s), le prix avant d'acheter. Pour payer vous disposez de pieces de monnaie et de
billets fictifs. Vous montrerez que vous êtes capable d'utiliser les formules d'accueil, de
congé et les formules de politesse de base.
You want to obtain a good or a service (buy something, ask for something ..) Using the
pictures that the examiner has given you, find out about the products, and their prices
before buying them. In order to pay you have some imitation coins and notes. You need
to show that you are able to use the proper language for greetings and leave-taking and
other basic social language.
22
© Copyright ALTE 2012
Some ‘chunks’ but other challenges too.
23

The learner is expected to initiate
and structure the role play

The examiner is the interlocutor
and may prompt/support if needed

The learner has to manipulate
mentally several visual sources of
information

The learner is expected to use
social formulae
© Copyright ALTE 2012
Moving to being able to do this …..
(FCE for Schools Oral Test Part 3. Instructions for a group
of 3 or 4 students interacting)
Interlocutor: Now I’d like you to talk about something together
for about 3 minutes. Here are some activities that students
often do during their school day.
First, talk to each other about why it might be important to do
these different activities at school. Then decide which two
activities are not important for students to do at school.
Alright?
24
© Copyright ALTE 2012
25
© Copyright ALTE 2012
SO, it’s not all language. Other challenges can be
lessened or increased
Discourse:
 Maintaining interaction with other interlocutors (not ‘led’
by examiner) and ‘staying in the discussion’
Cognitive:
 Considering hypothetical possibilities (not all activities
may be part of the candidate’s own school experiences)

26
Weighing advantages and disadvantages and
expressing them in a reasoned fashion
© Copyright ALTE 2012
Piaget’s Four Stages of Cognitive Development – a
start but not the whole answer
27
Sensorimotor
Sensory experiences – Birth to 2 years
physical actions
Pre-operational
Beginning to represent
2 to 7 years
the world in words and
images, moving towards
symbolic thinking
Concrete operational
Logical reasoning about
concrete events begins.
Child can classify
objects into sets
7 to 11 years
Formal operational
Abstract reasoning and
logic. Hypothetical
thought
11 years onwards
© Copyright ALTE 2012
O'Sullivan’s (2000: 71-72) test-taker characteristics add
in some vital elements
Physical/Physiologi
Psychological
Experiential
Personality
Education
cal
Age
Memory
Gender
Examination
Short term ailments
Cognitive style
preparedness
Longer term disabilities
Affective schemata
Examination experience
Concentration
Communication
Motivation
Emotional state
experience
Target Language-country
residence
28
Topic
knowledge/
Knowledge of
the world
© Copyright ALTE 2012
Some vital roles of ‘Education’
For many educators (e.g. Donaldson, 1978) Piaget’s 4th
(Formal Operational) stage is not an inevitable
development driven by biological maturation.
Much of primary education is devoted to fostering its
development, giving access to the ‘unnatural’ world of
academic discourse, and promoting metacognition as
well as to developing World and General Knowledge.
29
© Copyright ALTE 2012
Applying what goes on in General Education to think
Foreign
Language
and Testing
… Language
Learning
… LanguageLearning
Testing
Generalabout
Education
Subject-specific
input
Influence of
growing literacy
Varying quantity and quality of L2 Amount of L2 input is a very crude guide to the ‘level’ of external test that might be
input
realistically aimed at
Is high literacy in L2 a goal?
This may affect which language modes are tested and how, but BEWARE using
written tests for oral purposes
Additions to
General
Knowledge/
Knowledge of
the world
Is information and Affective
Content also valued in language
learning? (e.g. CLIL might be
one strong case where content is
important)
Issues of reliability and ‘fairness’ often mean that tests use information and cultural
content supposed to be equally ‘known’ or ‘unknown’ to most candidates
Induction into
academic modes
of language use
and recognised
genres
Guidance
towards
operating in
certain cognitive
and
metacognitive
BICS (Basic Interpersonal
Communication Skills)?
CALP (Cognitive Academic
Language Proficiency)?
Or both?
A very important choice, especially in setting requirements for reading and writing
tests
rote learning versus ‘learning by
using’.
Are learners aware of lesson
objectives? Are learners able
realistically to self-assess?
Is reflection on learning
encouraged? Do they receive
individual formative advice?
A high degree of metacognition leading to ‘Test Wiseness’ is an advantage when
facing high stakes tests. This is different from ‘over-preparation’ for tests.
.
modes
30
© Copyright ALTE 2012
Aspects of General Education and how they may feed
into Language Learning
 Subject-specific input
 Influence of growing literacy
 Additions to General Knowledge/ Knowledge of


31
the world
Induction into academic modes of language use
and recognised genres
Guidance towards operating in certain cognitive
and metacognitive modes.
© Copyright ALTE 2012
Carry-over from General Education to Language
Teaching …
Language input (varying quality and quantity)
Is developing high literacy skills in L2 a goal?
Is information and other content also valued in language learning? (e.g. CLIL
might be one strong case where content is important)
Is BICS (Basic Interpersonal Communication Skills) what you aim at in the
foreign language? Or CALP (Cognitive Academic Language Proficiency)? Or
both?
Metacognition? Are learners aware of lesson objectives? Are learners able
realistically to self-assess? Is reflection on language learning encouraged? Do
learners receive individual formative advice?
32
© Copyright ALTE 2012
… and then into Language Testing





33
Internationally, the amount of L2 input is a very crude guide to the ‘level’ of
external test that might be realistically aimed at
Goals for L2 literacy may affect which language modes are tested and how,
but BEWARE of using written tests for oral purposes
Issues of reliability and ‘fairness’ often mean that tests use information
and cultural content supposed to be equally ‘known’ or ‘unknown’ to most
candidates, that can be, banal and ‘empty’.
BICS and/or CALP is a very important choice in terms of test cognitive
demands
A high level of metacognition leading to ‘Test Wiseness’ is an advantage
when facing high stakes tests. This is different from ‘over-preparation’ for
tests by simply practising past papers
© Copyright ALTE 2012
Working towards known tests or assessment
instruments – some interesting issues:
The CEFR (Common European Framework of Reference
for Languages) and the related Portfolio Materials provide
an excellent start point for metacognition and reflection.
They offer great ideas for teaching
‘ I CAN ……..’
But …
34
© Copyright ALTE 2012
CEFR was not designed for use with children and
young people
35

Many good ‘local’ Junior versions of the Portfolio have been
produced BUT for more in-depth and detailed use there are issues:

Many school systems specify A1 or A2 for the end of primary
schooling, but what about stages ‘on the way’? Levels need to be
distinguished in a meaningful way within the current descriptions
provided by the CEFR at the lowest levels.

The Japanese version of the CEFR (the CEFRJ) does divide the
learning goals into 3 levels within each A band (e.g. A1.1, A1.2,
A1.3) (Negishi, Takada, Tono 2011). Worth considering.
© Copyright ALTE 2012
Test-wiseness and metacognition (‘thinking about
learning’)
If Test-Constructors can build in different challenges,
Test-Takers benefit from being able to deconstruct them
36

In other words, to build ‘Test-Wiseness’ in a positive
manner we need to link:



classroom learning
classroom assessment and
awareness of the demands of high-stakes tests
© Copyright ALTE 2012
Metacognition in the classroom
Much modern teaching attempts to offer springboards for
developing
METACOGNITIVE SKILLS AND AWARENESS
(even/especially for the younger learners)
However what works for younger usually works for older
and the UK strategy spans primary and secondary
37
© Copyright ALTE 2012
Extract from UK government Assessment for
Learning Strategy
1.
2.
3.
Learning objectives made explicit and shared with
pupils
Peer and self-assessment in use
Pupils engaged in their learning and given immediate
feedback
My note: feedback = advice on what to do next, not just
on ‘how well you did’
38
© Copyright ALTE 2012
This wall is mostly about Assessment for Learning
39
© Copyright ALTE 2012
WALT = We Are Learning To …
40
© Copyright ALTE 2012
WILF gets them from WALT into the teacher’s mind
41
© Copyright ALTE 2012
Not to speak of WAGOLL
42
What
A
Good
One
Looks
Like
© Copyright ALTE 2012
Traffic lights in exercise books to signal to the teacher
 Red =
Help! I really
don’t ‘get’ it
 Amber = I need some
more support
 Green =
I’m
confident with this
43
© Copyright ALTE 2012
‘Never be afraid to think about your learning’
Register/ Circle time. Each child says a sentence about
what they found tricky, interesting, frustrating, confusing, in
the last week about a school topic, or where they had a
TRIUMPH in the past week.
Often happens with maths e.g. ‘I think place value
charts are really AWFUL’ but this approach could
equally be applied to language learning
44
© Copyright ALTE 2012
Children sometimes are VERY aware of what they need
to do in order to get the grades

Me: What’s that?
(meaning can the child
name the semi-colon
punctuation mark)

45
;
Child: That’s Level 5,
that is! (meaning that he
knows that using a semicolon correctly is one
criterion for Level 5 work)
© Copyright ALTE 2012
‘That’s great. You are all working at Level 5 this week’
‘Levels 4 and 5’ are the Golden Treasure Assessment
and Test Grades for all UK primary teachers and 10-11
year old children, and increasingly, they all know what
they have to do to get there …
It’s easy to mock but IF the test-wise teachers and
children are talking about wise tests, the teaching-testing
gap can happily be narrowed.
46
© Copyright ALTE 2012
Thanks
47
© Copyright ALTE 2012
We would like to acknowledge the help of
following colleagues in the two surveys:
Hanan Khalifa, Cambridge ESOL
Evelina Galaczi, Cambridge ESOL
Roger Hawkey, Cambridge ESOL consultant
Lucy Chambers, Cambridge ESOL
Debbie Howden, Cambridge ESOL
John Knagg, British Council
Tom Poole, British Council
48
© Copyright ALTE 2012
Thanks also to:
Grange Farm Primary School
and
Stanton Bridge Primary School
Coventry
49
© Copyright ALTE 2012
50
© Copyright ALTE 2012
51
© Copyright ALTE 2012
Slide heading
Statement template. Insert your text in this space.
Statement template. Insert your text in this space.
Statement template. Insert your text in this space.
Statement template. Insert your text in this space.
Statement template. Insert your text in this space.
52
© Copyright ALTE 2012
Type in your slide title here
 template of bullet point text
 highlight the text to edit
 template of bullet point text
 highlight the text to edit
 template of bullet point text
 highlight the text to edit
53
© Copyright ALTE 2012
Example of how to present
numbered lists
1.
template numbered list
2.
highlight text to edit
3.
template numbered list
4.
highlight text to edit
54
© Copyright ALTE 2012
Example of how to present tables
55
template
example
example
example
Adjust box and lines
example
With hand cursor
example
example
example
© Copyright ALTE 2012
Cambridge ESOL Levels
Example template 2
Example
A1
Edit rules with hand cursor
Example text example text
Example
B2
Example
C3
Example text example text example
Example text example text example text
Example
D4
Example text example text example text
Example text example text example text
Example
E5
Example text example text example text
Example
F6
Example text example text example text
Example text example text example text
56
Council of Europe Levels
© Copyright ALTE 2012
57
© Copyright ALTE 2012