Human Performance Knowledge, Models, & Tools for Naval Personnel Development
Office of Naval Research | Transition funded by the USMC Weapons Training Battalion

This project was an outgrowth of marksmanship research that was conducted under Office of Naval Research funding. The initial marksmanship research was conducted at two United States Marine Corps (USMC) locations with approximately 500 Marine test subjects. The USMC College of Continuing Education funded transition of the research tools to an operational training product, the Rifle Marksmanship Coaches Course Toolset.

Outcomes
The Rifle Marksmanship Coaches Course Toolset, consists of four components:

1. The Evaluation of Shooting Positions module is a Web-based tool that allows the user to manipulate a virtual shooter on a computer display to judge whether the shooter's position is proper or improper. If the user judges any element to be improper, the Marine can adjust the shooter to the proper position. Scoring is automated to enable cost-effective online use in distance learning.

2. The Data Book Training module, developed by CRESST and its partner the University of Southern California Center for Cognitive Technology, provides Web-based interactive training on the use of the data book, used by every Marine to record actual shooting performance and consequent adjustments of rifle sights based upon wind conditions, distance to target, and firing speed. The module also provides interactive training on sight picture, battle sight zero (BZO) and shot group analysis. Learner performance is scored automatically.

3. The Marksmanship Knowledge Mapper assesses deep understanding of marksmanship knowledge, concepts and procedures and how they're related, with automated scoring to make it cost-effective. There are three separate applications: Fundamentals of Marksmanship, assessing knowledge of the cause-effect relations among marksmanship fundamentals; Shot-to-Shot Explanation, which measures the learner's knowledge of the relation of shot patterns to shooter problems, e.g., breath control; and Data Book Procedure, assessing a student's understanding of how to use the data book.

4. The Marksmanship Inventory Knowledge Assessment module is a Web-based survey measuring a student's knowledge of marksmanship fundamentals that can be quickly administered with automated scoring prior to or following instruction.

Related Publications
Chung, G. K. W. K., Delacruz, G. C., de Vries, L. F., Bewley, W. L., & Baker, E. (2006). New directions in rifle marksmanship research. Military Psychology, 18(2): pp. 161-179.

Chung, G. K. W. K., Delacruz, G. C.,& Bewley, W. L. (2004). Performance assessment models and tools for complex tasks. International Test and Evaluation Association (ITEA) Journal, 25(1), 47-52.

Chung, G. K. W. K., Baker, E. L., Brill, D. G., Sinha, R., Saadat, F.,& Bewley, W. L. (2003). Automated assessment of domain knowledge with online knowledge mapping. Proceedings of the I/ITSEC, 25, 1168-1179. Download here

Chung, G. K. W. K., Delacruz, G. C., Dionne, G. B.,& Bewley, W. L. (2003). Linking assessment and instruction using ontologies. Proceedings of the I/ITSEC, 25, 1811-1822.

Delacruz, G. C., Chung, G. K. W. K.,& Bewley, W. L. (2003). Identifying learning phases using the human performance knowledge mapping tool (HPKMT) and microgenetic analysis. Proceedings of the I/ITSEC, 25, 1802-1810. Download here

Chung, G. K. W. K., Baker, E. L., Delacruz, G. C., Bewley, W. L., Elmore, J.,& Seely, B. (2008). A computational approach to authoring problem-solving assessments. In E. L. Baker, J. Dickieson, W. Wulfeck,& H. F. O'Neil (Eds.), Assessment of problem solving using simulations (pp. 289-307). Mahwah, NJ: Erlbaum.

Chung, G. K. W. K., Delacruz, G. C., Dionne, G. B.,& Bewley, W. L. (2003, December). Linking assessment and instruction using ontologies. Proceedings of the Interservice/Industry Training, Simulation and Education Conference, Orlando, FL.

Chung, G. K. W. K., O'Neil, H. F., Jr., Delacruz, G. C.,& Bewley, W. L. (2005). The role of affect on novices' rifle marksmanship performance. Educational Assessment, 10, 257-275.

Lee, J. J., Delacruz, G. C., Elmore, J.,& Bewley, William L. (2008, March.) Video-based assessment of a coach's ability to fault check performance. Paper presented at the annual meeting of the American Educational Research Association, New York, NY.


For more information please contact:
Bill Bewley, Ph.D., Assistant Director of Technology
Phone: 310-825-7995
Email: bewley@Senior Researchercse.ucla.edu

Models, Devices, Assessment, and Remediation Research and Development to Support a Versatile,
Instrumented Small Arms Training and Practice Environment Naval Postgraduate School

The Office of Naval Research (ONR) funded the Naval Postgraduate School (NPS) to conduct a research program to develop an advanced training aid for the coaching of basic marksmanship skills. CRESST supported NPS by developing a prototype software package providing automated evaluation of basic marksmanship skills.

Outcomes
CRESST developed a wireless sensor package based on prior CRESST marksmanship sensor software that will attach to any standard service weapon (M16 and M4) and provide quantifiable data on five measureable components of marksmanship, trigger pull, cant angle, butt stock pressure, cheek wield and breath control.

For more information please contact:
Roy Stripling, Ph.D., Assistant Director for Assessment
Phone: 310-794-9166
Email: stripling@cse.ucla.edu

Interactive Neuro-Educational Technology (I-NET): Accelerating Training of Marksmanship,
Advanced Brain Monitoring, Inc.

CRESST provided technical consultation and advice to Advanced Brain Monitoring, Inc. (ABM) supporting their Phase 2 Accelerated Learning project "Interactive Neuro-Educational Technology (I-NET): Accelerating Training of Marksmanship," funded by the Defense Advanced Research Projects Agency (DARPA). CRESST work included review and advice on marksmanship study designs and implementation, consulting on analytical models and approaches to data analysis, and review and advice on technical reports.

Outcomes
In a pilot study using technology integrating brain monitoring into paced instructional tutorials, sensor-based feedback to accelerate novice-to-expert transition, and neurocognitive factors allowing early triage and interventions, ABM found evidence for an improved learning trajectory in a novice population.

Related Publications
Raphael, G., Berka, C., Popovic, D. Chung, G. K. W. K., Nagashima, S. O., Behneman, A., Davis, G.,& Johnson, R. (2009). I-NET®: Interactive neuro-educational technology to accelerate skill learning. Proceedings of the 31st Annual International Conference of the IEEE Engineering in Medicine& Biology Society, Minneapolis, MN.

Nagashima, S. O., Chung, G. K. W. K., Espinosa, P. D.,& Berka, C. (2009). Sensor-based assessment of basic rifle marksmanship. Proceedings of the I/ITSEC, Orlando, FL.

Nagashima, S. O., Chung, G. K. W. K., Espinosa, P. D.,& Berka, C. (2009). Validity evidence for a model of rifle marksmanship skill performance using sensor-based measures. Proceedings of the 53rd Annual Meeting of the Human Factors and Ergonomics Society, San Antonio, TX.

Berka, C., Behneman, A., Johnson, R., Pojman, N., Raphael, G., Chung, G. K. W. K.,& Nagashima, S. O. (2009). Using interactive neuro-educational technology to increase the pace and efficiency of rifle marksmanship training. Proceedings of the Annual Meeting of the Society of Neuroscience, Chicago, IL.
>br /> Raphael, G., Berka, C., Popovic, D., Chung, G. K. W. K., Nagashima, S. O., Behneman, A., Davis, G.,& Johnson, R. (2009). Adaptive Performance Trainer (APT): Interactive neuro-educational technology to increase the pace and efficiency of rifle marksmanship training. Proceedings of the 5th International Conference on Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience (Held as Part of HCI International 2009), San Diego, CA.

Pojman, N., Behneman, A., Kintz, N., Johnson, R., Chung, G. K. W. K., Nagashima, S. O., Espinosa, P.,& Berka, C. (2009). Characterizing the psychophysiological profile of expert and novice marksmen. Proceedings of the 5th International Conference on Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience (Held as Part of HCI International 2009), San Diego, CA.

Chung, G. K. W. K., Nagashima, S. O., Espinosa, P. D., Berka, C.,& Baker, E. L. (2008). An exploratory investigation of the effect of individualized computer-based instruction on rifle marksmanship performance and skill (CRESST Tech. Rep. No. 754). Los Angeles: University of California, National Center for Research on Evaluation, Standards, and Student Testing.

Chung, G. K. W. K., Nagashima, S. O., Espinosa, P. D., Berka, C.,& Baker, E. L. (2009). The influence of cognitive and non-cognitive factors on the development of rifle marksmanship skills (CRESST Tech. Rep. No. 753). Los Angeles: University of California, National Center for Research on Evaluation, Standards, and Student Testing.

Nagashima, S. O., Chung, G. K. W. K., Espinosa, P. D., Berka, C.,& Baker, E. L. (2009). Assessment of rifle marksmanship skill using sensor-based measures (CRESST Tech. Rep. No. 755). Los Angeles: University of California, National Center for Research on Evaluation, Standards, and Student Testing.

Espinosa, P. D., Nagashima, S. O., Chung, G. K. W. K., Parks, D.,& Baker, E. L. (2009). Development of sensor-based measures of rifle marksmanship skill and performance (CRESST Tech. Rep. No. 756). Los Angeles: University of California, National Center for Research on Evaluation, Standards, and Student Testing.

For more information please contact:
Greg Chung, Ph.D., Senior Researcher
Phone: 310-794-4392
Email: greg@ucla.edu