CLOSED LOOP
TRAINING SYSTEMS
WITH INTEGRATED SOCIAL AND
GAMING OPTIONS
CAPTAIN Lou Nemeth, Chief Safety Officer, CAE
Agenda
Introduction
Closed Loop Training Systems
 What do we really need
to close the loop?
?
Learning-related ‘Big Data’ technologies
 Data from informal learning and experience
 xAPI … the experience API
CAE’s TSILE Case Study….so far
Collaborative research and development opportunities
Summary
Training System Integration Objective
Individual
Learning Environment
• Learning Platform
Synthetic
Learning Environment
• Training
• Debriefing
Live
Learning Environment
• Flying
• Assessing
Training
Curriculum
Student Data Analytics
SIM Recordings
Sim Parameters & Data
Training Findings
CAE Inc. Proprietary Information and/or Confidential
FDR Recordings
Safety and Maintenance
Findings
What’s missing: much better data
and much better insight
?
How
can
a
training
department…maybe
even
an
An example from personal learning experience
Integrated Learning Environment…get
detailed data about my personal
learning experience
in the aviation domain
in a standardized way
?
xAPI … the Experience API
An emerging standard
Developed at Advanced Distributed Learning (ADL)
A component of the Training and Learning Architecture (TLA)
An open specification…
….that developers can implement…
…to create a learning experience tracking service
Supports mobile devices; supports ‘external’ learning experiences
outside the ‘traditional’ LMS / browser
We started with an instructor-led classroom session
For example, aircraft performance charts for rarely used procedures in
highly automated aircraft (i.e. Max Performance T/O & Landings)
Even in a modern electronic classroom with a well-developed curriculum:
CAE Inc. Proprietary Information and/or Confidential
•
The instructor
controls the
lesson ‘flow’;
•
Students get
exposed to the
material only
once;
•
Only the ‘cases’
from the
prepared lesson
are taught…and
(maybe) learned.
e-learning of aircraft performance charts offers
multiple representations and paths
Scenario-based e-learning lesson to
introduce the material
E-learning examples can be
repeated as-often as
necessary…anywhere the
‘learner’ desires
Electronic free-play anytime and
anywhere with all the charts
The learner controls the lesson
flow…and gets instant feedback on
competence
The instructor is available for direct,
relevant, 1-on-1 interaction
CAE Inc. Proprietary Information and/or Confidential
Addition of a relevant game environment adds social and
competitive motives…reinforcing frequent refresher learning
CAE Inc. Proprietary Information and/or Confidential
TSILE Case Study Phase 1
Learning Environment Transformation
New Self-Paced E-lesson:
 In-lesson web-compatible simulation
 Access to supplementary content and
discussion forum
 Mini-game for mastery of learning
 Learners’ experience data tracking
xAPI
9
We would like to thank our current R&D Collaboration partners
Understanding the
cognitive components of
aviation training in the
context of e-learning,
advanced simulation, and
live aircraft learning
environments
Analytics
xAPI
extensions and
profile for the
aviation
domain
PRELIMINARY RESULTS
E-Lesson User Trial Experiment
TR2
TR3
TR4
TR5
TR6
TR7
TR8
“…these practical lessons are
probably the best computer based
learning I have used. “
Question TR1
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
Pilot Feedback
Two users, Module Duration
E-Lesson Performance Effectiveness
160
140
 Successful-calculation-speed
increased by 40%.
120
Test
Time (min)
100
 3X percentage improvement
in post-test accuracy
5
4
80
3
2
60
1
40
20
0
T8
T10
Participant
T7 - Time Between Exp Verbs
1
8
15
22
29
36
43
50
57
64
71
78
85
92
99
106
113
120
127
134
141
148
155
162
169
176
183
190
197
204
211
218
225
232
239
246
253
260
267
274
281
288
295
302
309
316
 advanced tracking of detailed
learning experience
Series1
T8
0:12:58
0:11:31
0:10:05
0:08:38
0:07:12
0:05:46
0:04:19
0:02:53
0:01:26
0:00:00
1
8
15
22
29
36
43
50
57
64
71
78
85
92
99
106
113
120
127
134
141
148
155
162
169
176
183
190
197
204
211
218
225
232
239
246
253
260
267
274
281
288
295
302
309
xAPI Data and analytics
0:12:58
0:11:31
0:10:05
0:08:38
0:07:12
0:05:46
0:04:19
0:02:53
0:01:26
0:00:00
Series1
1
Integrated Learning Environment
Case Study …. What’s next?
Operational Data
Safety Data
12
CAE Inc. Proprietary Information and/or Confidential
Summary
Objective, comprehensive, standardized
‘Big Learning Experience Data’ and analytics will provide the insight we
need to confidently ‘close the loop’
Development of useful analytics depends on good relevant Use Cases
CAE is continuously seeking collaborative partners to help us transform
the aviation training domain into a data-driven science!
Resilience Engineering
Adaptations necessary to cope with real world complexity