CSX Remote Control Operations Training Program: Information Requirements Scenario 03: Doubling Together a 4-Block Train Laura H. Barg-Walkow Cale M. Darling Richard D. Swette Georgia Institute of Technology OVERVIEW ● Analyses and Assumptions ● Information requirements ○ Applications ● Conclusion INTRODUCTION TASK ANALYSIS: SCENARIO 03-Doubling Together a 4-Block Train 1. Read switch list 2. Orient to environment 3. Determine order for assembling trains 4. Determine how to maneuver locomotive to set of cars for coupling 5. Operate OCU to begin moving locomotive into coupling position with designated cars 6. Control speed at appropriate levels 7. Couple cars 8. Check handbrakes 9. Determine current status of train assembly 10. Determine whether or not train assembly is complete ASSUMPTIONS & ANALYSES ASSUMPTIONS - already a locomotive operator -> Remote Control Operator - training - 40 hours classwork - 40 hours on the job - Final 2 hour evaluation PERSONS: All ages cognitive and physical ability ORGANIZATION: seniority - people get moved around cultural influence > organizational policy 4 stages of measuring proficency 1. SAFETY + SAFETY + SAFETY - moving around the yard safely 2. basic decision making - read switch list and determine an order 3. operating - getting the train to do what you want it to do 4. expertise - expertise can have great impact on speed INFORMATION REQUIREMENTS 1. Deliberate Practice 2. Cognitive Load 3. Simple-to-Complex Sequencing 4. Decreasing Support 5. Part and Whole Task 6. Increasing Contextual Interference 7. Error Training 8. Feedback 9. Evaluation DELIBERATE PRACTICE "practice ≠ perfect" Information Requirement: 1. The trainee shall be given a task list with specific goals outlined for the task. 2. The trainee’s performance shall be measured by feedback (see feedback section) on all tasks. 3. Trainees shall be given extra time between and during trials (stopping the trial) to analyze opportunities for improvements when experiencing errors. Application: ● "Master the task list" ● culture of deliberate practice ○ stopping trials = :) ○ Replay how an expert would 'determine order of assembling' trains (task 3 of scenario 3) COGNITIVE LOAD Information Requirement: The training program shall only include information (skills or knowledge) identified in the cognitive task analysis for Scenario 03. Application: ● Only the features of the OCU that are required to complete the task should be explained to the trainee. SIMPLE-TO-COMPLEX Information Requirements: 1) The training program shall begin with a simple sequence (single way to correctly complete the task) and shall end with a complex sequence (multiple ways to correctly complete the task). 2) The training program shall progressively present tasks of greater or equal complexity than the previous tasks. Application: ● Simple tasks (mounting the locomotive and moving it down the track in the proper direction) precede to more complex tasks (determining where to slow the locomotive or how to order the cars). DECREASING SUPPORT Information Requirement: 1) Trainees shall progress from highly structured examples of tasks (trainer completes the task; trainee only observes) to partiallycompleted tasks (only part of the task is completed by the trainee) to independent completion of the whole task (trainee completes the entire task). 2) Trainees shall advance to the next state of supported task when they complete structured tasks with 100% accuracy and within a time frame deemed reasonable by the trainer. Application: ● Trainer demonstrates how to build a train ● Trainer observes and provides support ● Trainer observes but doesn't provide support PART AND WHOLE TASK Information Requirement: The trainee shall spend at least 50% of all time training on whole-task training, where they will perform Scenario 03 in its entirety, as opposed to only focusing on one or more--but not all--sub-tasks of the scenario. Application: ● Trainee spends a little time learning to operate the OCU ● Trainee spends more time using OCU to complete scenario CONTEXTUAL INTERFERENCE "make it harder on them" Information Requirement: 1. The training system shall, for training consisting of more than one discrete task, randomly order tasks presented to the trainee. 2. The training system shall provide trainees with a buffer (e.g., temporal spacing, presenting a different concept) between presentations of the same information (skills or knowledge). Application: ● 3 hour block of training? - 3 one hour blocks? or 9 twenty minute blocks? ● 3 total hours? 3 hours on monday. or 1 hour on Monday Wednesday Friday?" ERROR TRAINING Information Requirement: 1) The training system shall introduce (as opposed to naturallyoccurring errors) a base level of errors (equal in frequency and complexity) to each trainee as deemed reasonable by the trainers. 2) Trainees shall face errors representative of those most frequently faced in an operational setting as determined by the trainers. 3) Trainers shall provide support and directed feedback for each trainee as trainee corrects the error. Application: ● Training system incorrectly places switches for each trainee ● Trainer helps correct switches and gives feedback FEEDBACK Information Requirement: Trainers shall provide the trainees with immediate feedback (with no temporal buffer) on performance during their initial exposure to the task; however, repeated attempts at such tasks shall include delayed feedback (with a temporal buffer) instead of immediate feedback. Application: ● Trainer provides detailed immediate feedback for all errors ● Trainer waits until trainee has completed the task EVALUATION Information Requirement: 1) Trainees shall be tested on both procedural and declarative knowledge with a final evaluation at the end of the training program. 2) Trainees shall pass all sections with pre-determined performance standards set by subject matter expert(s) (e.g., Trainer). 3) The training program shall be re-evaluated by trainers and their supervisors should the average final evaluation scores fall below predefined metrics of acceptable performance. Application: ● Trainer takes written and practical test at end of training ● Current metrics: ○ Score ≥ 85% for declarative ○ Completion = 100% for procedural CONCLUSION 1. Deliberate Practice 2. Cognitive Load 3. Simple-to-Complex Sequencing 4. Decreasing Support 5. Part and Whole Task 6. Increasing Contextual Interference 7. Error Training 8. Feedback 9. Evaluation REFERENCES Acknowledgements: We would like to acknowledge the assistance we received from CSX Transportation employees while creating this document: Steve Ammons, Ken Glover, Emma Moser, and Mike Perdue. Anderson, J. R. (1982). Acquisition of cognitive skill. Psychological Review, 4, 369-406. Helander, M. (2006). A Guide to Human Factors and Ergonomics (2nd), Boca Raton: CRC, pp. 273-292. Lewandowsky, S., & Thomas, J. L. (2009). Expertise: Acquisition, limitations, and control. In F. T. Durso (Ed.) Reviews of Human Factors and Ergonomics (Vol. 5), Santa Monica, CA: HFES, pp. 140-165. Merrill, M. D. (2002). First principles of instruction. Educational Technology Research and Development, 50(3), 43-59. Paas, F., & van Gog, T. (2009). Principles for designing effective and efficient training of complex cognitive skills. In F. T. Durso (Ed.) Reviews of Human Factors and Ergonomics (Vol. 5), Santa Monica, CA: HFES, pp. 166-194. Patrick, J. (2003). Training. In P. S. Tsang & M. A. Vidulich (Eds.), Principles and Practice of Aviation Psychology, Mahwah, NJ: LEA, pp. 397-434. Rogers, W. A., Campbell, R. H., & Pak, R. (2001) A systems approach for training older adults to use technology. In N. Charness, D.C. Park, and B.A. Sabel (Eds.), Communication, technology, and aging: Opportunities and challenges for the future (pp. 187-208). New York: Springer. Sackett, P. R., & Mullen, E. J. (1993). Beyond Formal Experimental Design: Towards an Expanded View of the Training Evaluation Process. Personnel Psychology, 46, 613-627. Schneider, W. (1985). Training High-Performance Skills: Fallacies and Guidelines. Human Factors, 27(3), 285-300. Salas, E., Wilson, K. A., Priest, H. A., & Guthrie, J. W. (2006). Design, delivery, and evaluation of training systems. In G. Salvendy (Ed.), Handbook of Human Factors and Ergonomics (3rd). Hoboken, NJ: Wiley, pp. 472-512. Thorndike, E. L., & Woodworth, R. S. (1901). The influence of improvement in one mental function upon the efficiency of the other functions. Psychological Review, 8, 247-261; 384-395; 553- 564.