Publications

 

Journal Articles, Book Chapters, Major Reports

 

Hoffman, R. R., Deal, S. V., Potter, S. and Roth, E. (2010). The practitioner’s Cycles, Part 2: Solving Envisioned World Problems. IEEE Intelligent Systems, 25 (3), 6-11. 
 
Roth, E. M., Pfautz, J. D., Mahoney, S. M., Powell, G. M., Carlson, E. C., Guarino, S. L., Fichtl, T. C., and Potter, S. S. (2010) Framing and contextualizing information requests: problem formulation as part of the intelligence analysis process. Journal of Cognitive Engineering and Decision Making, volume 4, number 3, Fall 2010, pp. 210 – 239.
 
Roth, E. M. and Eggleston, R. G. (2010). Forging new evaluation paradigms: Beyond statistical generalization. In Patterson ES, Miller J. (Eds.) Macrocognition Metrics and Scenarios: Design and Evaluation for Real-World Teams. Ashgate Publishing. ISBN 978-0-7546-7578-5. (pp. 203-219).
 
Patterson, E. S., Roth, E. M., Woods, D. D. (2010). Facets of complexity in situated work. In Patterson ES, Miller J. (Eds.) Macrocognition Metrics and Scenarios: Design and Evaluation for Real-World Teams. Ashgate Publishing. ISBN 978-0-7546-7578-5. (pp. 221- 251).
 
 
Bisantz, A. M. , Stone, R. T. , Pfautz, J., Fouse,  A., Farry, M., Roth, E., Nagy, A., & Thomas, G. (2009).  Visual representations of meta-information.  Journal of Cognitive Engineering and Decision Making, 3 (1), 67-91.
 
Roth, E. M., Multer, J. and Scott, R. (2009).  Understanding and contributing to resilient work systems.  In Nemeth, C. P., Hollnagel, E., and Dekker, S. (Eds) Resilience Engineering Perspectives Volume 2: Preparation and Restoration. Burlington, VT: Ashgate Publishing Company.
 

Roth, E. M. and Pew, R. W. (2008). Integrating cognitive engineering in the systems engineering process: Opportunities, Challenges, and Emerging Approaches. Introduction to the Special Issue. Journal of Cognitive Engineering and Decision Making, 2 (3), 161-164.  

 

Evenson, S., Muller, M. and Roth, E. M. (2008).  Capturing the context of use to inform system design. Journal of Cognitive Engineering and Decision Making, 2 (3), 181-203.

 

Roth, E. M. (2009).  Understanding Cognitive Strategies for Shared Situation Awareness Across a Distributed System:  An Example of Strategies Analysis.  In Ann M. Bisantz and C. M. Burns (Eds) Applications of Cognitive Work Analysis. Boca Raton, FL:  CRC Press, Taylor & Francis Group.  129 - 147

 

Roth, E. M. (2008).  Uncovering the Requirements of Cognitive Work. Human Factors, 50 (3), 475-480.  (Golden Anniversary Special Section on Discoveries and Developments).   

 

Bisantz, A. and Roth, E. M.  (2008).  Analysis of Cognitive Work.  In Deborah A. Boehm-Davis (Ed.) Reviews of Human Factors and Ergonomics Volume 3.  Santa Monica, CA: Human Factors and Ergonomics Society. 1-43.

 

Saleem JJ, Patterson ES, Militello L, Anders S, Falciglia M, Wissman J, Roth EM, Asch S. (2007).  Impact of clinical reminder redesign on learnability, efficiency, usability, and workload for nursing personnel. J Am Med Inform Assoc., 14, 632-640.

 

Endsley, M. R., Hoffman, R., Kaber, D. and Roth, E. (2007).  Cognitive engineering and decision making:  An overview and future course.  Journal of Cognitive Engineering and Decision Making, 1(1), 1-21.

 

Pfautz, J. and Roth, E. M. (2006).  Using cognitive engineering for system design and evaluation:  A visualization aid for stability and support operations. International Journal of Industrial Ergonomics, 36 (5), 389-407.

 

Greenberg, C. C., Roth, E. M., Sheridan, T. B., Gandhi, T. K., Gustafson, M. L., Zinner, M. J., and Dierks, M. M. (2006).  Making the operating room of the future safer.  The American Surgeon, 72 (11), 1102-1108.

 

Roth, E., M., Scott, R., Deutsch, S., Kuper, S., Schmidt, V., Stilson, M. And Wampler, J. (2006).  Evolvable work-centered support systems for command and control:  Creating systems users can adapt to meet changing demands.  Ergonomics, vol.  49, #7, 688-705.

 

Patterson, E.S., Woods, D.D., Roth, E.M., Cook, R.I., Wears, R.L. (2006).  Three key levers for achieving resilience in medication delivery with information technology.  Journal of Patient Safety. 2(1).  33-38.

 

Christian, C. K., Gustafson, M. L., Roth, E. M., Sheridan, T. B., Gandhi, T. K., Dwyer, K., Zinner, M. J., and Dierks, M. M. (2006).  A prospective study of patient safety in the operating room. Surgery, vol. 139, #2, pp 159-173.

 

Roth, E. M., Multer, J., and Raslear, T. (2006).  Shared situation awareness as a contributor to high reliability performance in railroad operations. Organization Studies, 27(7), 967-987. DOI: http://dx.doi.org/10.1177/1054773804271935

 

O’Hara, J. M. and Roth, E. M. (2005). Operational concepts, teamwork, and technology in commercial nuclear power stations.  In Clint Bowers, Eduardo Salas and Florian Jentsch (Eds) Creating High-Tech Teams: Practical guidance on work performance and technology.  (pp. 139-159).Washington, D. C.: American Psychological Association.

 

Sheridan, T. B., Christian, C. K., Dierks, M. M. and Roth, E. M. (in press).  Factors Contributing to Surgical Risk.  In Marilyn Sue Bogner (Ed.) Human Error in Medicine.  Second Edition.  Mahwah, NJ: Lawrence Erlbaum Associates.

 

Scott, R., Roth, E. M., Deutsch, S. E., Malchiodi, E., Kazmierczak, T., Eggleston, R. and Kuper, S. R., Whitaker, R.  (2005). Work-Centered Support Systems: A Human-Centered Approach to Intelligent System Design.  IEEE Intelligent Systems, vol. 20, issue 2, pp. 73-81.

 

Elm, W. C., Roth, E. M., Potter, S. S., Gualtieri, J. W. and Easter, J. R. (2005).  Applied Cognitive Work Analysis (ACWA). In   Neville Stanton, Alan Hedge, Karel Brookhuis, Eduardo Salas and Hal Hendrick (Eds.)  Handbook of Human Factors and Ergonomics Methods. (pp. 36-1 – 36-9) Boca Raton, FL: CRC Press.

 

Roth, E. M. and Patterson, E. S. (2005). Using observational study as a tool for discovery: Uncovering cognitive and collaborative demands and adaptive strategies.  In Montgomery, H., Lipshitz, R., & Brehmer, B. (Eds.) How professionals make decisions. (pp. 379 – 393) Mahwah, NJ: Lawrence Erlbaum Associates.

 

Burns, C. M., Bisantz, A. M., and Roth, E. M. (2004).  Lessons from a Comparison of Work Domain Models: Representational Choices and Their Implications.  Human Factors, 46 (4), Winter 2004, pp 711-727.

 

Dierks, M. M., Christian, C., K., Roth, E. M. and Sheridan, T. B. (2004).  Healthcare safety:  The impact of disabling ‘safety” protocols.  IEEE Transactions on Systems, Man and Cybernetics.  Part A: Systems and Humans.  Special Issue on Using Field Studies to Understand Healthcare Technical Work. 34 (6), 693-698.

 

Patterson, E.S., Roth, E.M., Woods, D.D., Chow, R., Gomes, J.O.  (2004). Handoff strategies in settings with high consequences for failure: lessons for health care operations.  International Journal for Quality in Health Care, 16(2), 1-8.

 

Vicente, K. J., Mumaw, R. J., and Roth, E. M. (2004). Operator Monitoring in Complex Dynamic Work Environment:  A Qualitative Cognitive Model Based on Field Observations.  Theoretical Issues in Ergonomic Science, 5(5), 359-384.

 

Wreathall, J., Bley, D., Roth, E., Multer, J. and Raslear, T. (2003). Using an integrated process of data and modeling in Human Reliability Analysis.  Reliability Engineering and System Safety, special issue on  HRA Data Issues and Errors of Commission, 83, 221-228.

Roth, E. M., Christian, C. K., Gustafson, M., Sheridan, T. B., Dwyer, K., Gandhi, T. K., Zinner, M. J., and Dierks, M. M. (2004).  Using field observations as a tool for discovery:  Analyzing cognitive and collaborative demands in the operating room.  Cognition, Technology and Work, 6, 148 – 157.

 

Wreathall, J. Roth, E., Bley, D. and Multer, J. (2003).  Human Reliability Analysis in Support of Risk Assessment for Positive Train Control.   U. S. Department of Transportation, Federal Railroad Administration, Office of Research and Development: Washington, D. C. (DOT/FRA/ORD-03/15) Available online at:  http://www.fra.dot.gov/downloads/Research/ord0315.pdf

 

Bisantz, A. M., Roth, E. M., Brickman, B., Gosbee, L., Hettinger, L. and McKinney, J. (2003).   Integrating Cognitive Analyses in a Large Scale System Design Process.  International Journal of Human Computer Studies, 58, 177-206.

 

Elm, W.C., Potter, S.S., Gualtieri, J.W., Roth, E.M., & Easter, J.R. (2003).  Applied Cognitive Work Analysis:  A pragmatic Methodology for Designing Revolutionary Cognitive Affordances.  In E. Hollnagel (Ed) Handbook for Cognitive Task Design. ( pp. 357- 382). London:  Lawrence Erlbaum Associates, Inc.

 

Roth, E. M. and O’Hara, J. (2002) Integrating Digital and Conventional Human System Interfaces:  Lessons Learned from a Control Room Modernization Program.  Washington, D. C. : U. S. Nuclear Regulatory Commission. (NUREG/CR-6749 also BNL-NUREG-52638) Available online at: http://www.nrc.gov/reading-rm/doc-collections/nuregs/contract/cr6749/6749-021104.pdf

 

Roth, E. M., Patterson, E.S. & Mumaw, R. J. (2002).  Cognitive Engineering: Issues in User-Centered System Design. In J. J. Marciniak (Ed.), Encyclopedia of Software Engineering, 2nd Edition (pp 163 – 179).  New York: Wiley-Interscience, John Wiley & Sons.

 

Potter, S. S.,  Elm, W. C., Roth, E. M., Gualtieri,  and J., Easter, J.,  (2002). Bridging the Gap between Cognitive Analysis and Effective Decision Aiding.  In M. D. McNeese and M. A. Vidulich (Eds)  State of the Art Report (SOAR): Cognitive Systems Engineering in Military Aviation Environments:  Avoiding Cogminutia Fragmentosa! Wright-Patterson AFB, OH: Human Systems Information Analysis Center. (pp 137- 168).   Available online at:  http://iac.dtic.mil/hsiac/. 

 

Woods, D. D., Patterson, E. S., and Roth, E. M. (2002).  Can we ever escape from data overload?  A cognitive systems  diagnosis.  Cognition, Technology and Work, 4 (1), 22-36.

 

Patterson, E. S., Roth, E. M. and Woods, D. D. (2001).  Predicting vulnerability in computer-supported inferential analysis under data overload.  Cognition, Technology and Work, 3, 224 – 237.

 

 

Vicente, K. J., Roth, E. M., Mumaw, R. J. (2001).  How do operators monitor a complex, dynamic work domain? The impact of control room technology.    International Journal of Human Computer Studies, 54, 831-856.  Available online at:  http://www.idealibrary.com

 

Roth, E. M., Malsch, N. and Multer, J. (2001).  Understanding how train dispatchers manage and control trains:  Results of a cognitive task analysis.  Washington, D. C.: U. S. Department of Transportation/Federal Railroad Administration.  (DOT/FRA/ORD-01/02)  Available online at:  http://www.fra.dot.gov/downloads/Research/ord0102.pdf

 

Roth, E. M., Lin, L., Kerch, S., Kenney, S. J., & Sugibayashi, N.  (2001) Designing a first-of-a kind group view display for team decision making: a case study.  In Salas, E. & Klein, G. (Eds) Linking Expertise and Naturalistic Decision Making (pp. 113-135).  Mahwah, New Jersey:  Lawrence Erlbaum Associates, Inc.

 

Mumaw, R. J., Roth, E. M., Vicente, K. J. & Burns, C. M. (2000).  There is more to monitoring a nuclear power plant than meets the eye. Human Factors, vol 42, # 1, 36-55.

 

Potter, S. S., Roth, E. M., Woods, D. D. & Elm, W. (2000).   Bootstrapping multiple converging cognitive task analysis techniques for system design.  In J. M. Schraagen, S. F. Chipman & V. L. Shalin (Eds.) Cognitive Task Analysis (pp. 317-340).  Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

 

Patterson, E. S.,  Roth, E. M., and Woods, D. D.  (1999).  Aiding The Intelligence Analyst in Situations of Data Overload:  A Simulation Study of Computer-Supported Inferential Analysis Under Data Overload.  Institute for Ergonomics/Cognitive Systems Engineering Laboratory Report ERGO-CSEL-99-02 Prepared for Armstrong Laboratory Crew Systems Integration Branch (AL/CFHI)

 

Roth, E. M. (1998)  Book Review of ‘Human Factors in Nuclear Safety’ (Neville Stanton, Ed.), Ergonomics in Design, Vol. 6, No. 3, p. 33.

 

Potter, S. S., Roth, E. M., Woods, D. D. & Elm, W. C.  (1998). Toward the development of a computer-aided cognitive engineering tool to facilitate the development of advanced decision support systems for information warfare domains.  Technical Report. Wright-Patterson Air Force Base.

 

Roth, E. M., Malin, J. T. , & Schreckenghost, D. L.  (1997). Paradigms for Intelligent Interface Design.  In M. Helander, T. Landauer & P. Prabhu  (Eds.) Handbook of Human-Computer Interaction (2nd edition), Amsterdam: North-Holland. (pp. 1177-1201).

 

Taylor, J. H., O’Hara, J., Luckas, W. J., Parry, G. W., Cooper, S. E., Roth, E. M., Bley, D. C., an Wreathall, J.   FRAME-OF-REFERENCE MANUAL for ATHEANA:  A Technique for Human Error Analysis. Washington D. C.:  U. S. Nuclear Regulatory Commission, NRC technical report in preparation. (NUREG/CR-XXXX)

 

Roth, E. M. Analyzing Decision-Making in Process Control:  Multi-disciplinary approaches to understanding and aiding human performance in complex tasks. In C. Zsambok and G. Klein (Eds.) Naturalistic Decision-Making,  Lawrence Erlbaum Associates, 1997.

 

Roth, E. M. Analysis of Decision-Making in Nuclear Power Plant Emergencies:  An investigation of aided decision-making.  In C. Zsambok and G. Klein (Eds.) Naturalistic Decision-Making,  Lawrence Erlbaum Associates, 1997.

 

Vicente, K. J., Mumaw, R. J. & Roth, E. M. Cognitive Functioning of Control Room Operators - Final Phase.   (Final Report AECB).  Ottawa, Canada:  Atomic Energy Control Board, 1997.

 

Mumaw, R. J., Roth, E. M., Vicente, K. J., & Burns, C. M. A model of operator cognition and performance during monitoring in normal operations.  (Final Report AECB).  Ottawa, Canada:  Atomic Energy Control Board, 1996.

 

Mumaw, R. J., Vicente, K. J., Roth, E. M., & Burns, C. M. A Study of operator monitoring during normal operations.  (Final Report AECB).  Ottawa, Canada:  Atomic Energy Control Board, 1995.

 

Hoecker, D. G., Roth, E. M. & Chang, S. C.  User Interactions with a rapidly-prototyped multi-zone thermostat: test results.  (Final Report GRI).  Chicago, IL:  Gas Research Institute, 1995.

 

Woods, D. D. & Roth, E. M.  Symbolic AI-Based Computer Simulations as Tools for Investigating the Dynamics of Joint Cognitive Systems. In J-M. Hoc, P. C. Cacciabue, B. and E. Hollnagel, editors, Simulation of Cognition in Dynamic Environments,  Hillsdale, NJ: Lawrence Erlbaum Associates, 1995.

 

Roth, E. M., Mumaw, R. J., & Lewis, P. M.  An Empirical Investigation of

            Operator Performance in Cognitively Demanding Simulated Emergencies. Washington D. C.:  U. S. Nuclear Regulatory Commission, 1994.

             (NUREG/CR-6208)

 

Mumaw, R. J., Swatzler, D., Roth, E. M. & Thomas, W. A.  Cognitive skill training for nuclear power plant operational decision making. Washington, DC:  U. S. Nuclear Regulatory Commission, 1994. (NUREG/CR-6126).

 

Roth, E. M. & Mumaw, R. J. Cognitive Engineering: Issues in User-Centered System Design. In  J. J. Marciniak (Ed.),  Encyclopedia of Software Engineering.  New York:Wiley-Interscience, John Wiley & Sons, 110-123, 1994.

 

Stubler, W. F., Roth, E. M., & Mumaw, R. J.  Integrating Verification and Validation with the Design of Complex Man-Machine Systems. In Wise, J. A., Hopkin, V. D., & Stager, P. (Eds), Verification and Validation of  Complex Systems:  Human Factors Issues (Proceedings of the NATO Advanced Study Institute: Verification and Validation of Complex and Integrated Human-Machine Systems). NATO ASI Series, Berlin:Springer-Verlag, 159-172, 1993.

 

Roth, E. M., Woods, D. D. & Pople, H. E.  Cognitive Simulation as a tool for cognitive tasks analysis.  Ergonomics, special issue on Cognitive Engineering, vol. 35, no. 10,  1163-1198, 1992.

 

Roth, E. M., Woods, D. D., & Pople, H. Jr.  Cognitive Environment Simulation:  A tool for modeling operator cognitive performance during emergencies. In George Apostolakis (Ed.) Probabilistic Safety Assessment and Management :(Volume 2).  New York: Elsevier Science Publishing Co., Inc., 1991, pp. 959-964.  (Proceedings of the International Conference on Probabilistic Safety Assessment and Management  held February 4-7, 1991 in Beverly Hills, Ca.)

 

Woods, D. D., Pople, H. E., & Roth, E. M. Cognitive Environment Simulation:  A tool for modeling intention formation for human reliability analysis. Nuclear Engineering and Design., 134, 371-380, 1992.

 

Woods, D. D., Pople, H. E. & Roth, E. M. The Cognitive Environment Simulation as a Tool for Modeling Human Performance and Reliability.  Washington D. C.: U. S. Nuclear Regulatory Commission, June 1990 (NUREG/CR-5213).

 

Roth, E. M., Morgan, M.  G., Fischhoff, B. , Lave, L., & Bostrom, A. What do we know about making risk comparisons? Risk  Analysis., vol 10, no. 3., 375-387, 1990.  Reprinted in Lofstedt, R. and Frewer, L. (Eds)  Risk and Modern Society. London, UK: Earthscan Publications Ltd, 1998.

 

Woods, D. D., Roth, E. M. & Bennett, K. B. Explorations in Joint Human-Machine Cognitive Systems. In W. Zachary & S. Robertson (Eds.), Cognition, Computing and Cooperation. Norwood, NJ: Ablex Publishing, 123-158, 1990.

 

Roth, E. M. & Woods, D. D. Cognitive task analysis: an approach to knowledge acquisition for intelligent system design.  In Guida G. & Tasso, C. (Eds) Topics in Expert System Design. Elsevier Science Publishers B. V. (North-Holland), 233-264, 1989.

 

Woods, D. D. & Roth, E. M.  Cognitive Engineering: Human Problem Solving with Tools. Human Factors, 1988,  30  (4),  415-430 (a).

 

Woods, D. D., Roth, E. M. Cognitive Systems Engineering. In M. Helander (Ed.), Handbook of Human-Computer Interaction.  New York: North-Holland, 3-43, 1988 (b).

 

Roth, E. M., Bennett, K. & Woods, D. D. Human interaction with an 'intelligent' machine. International Journal of Man-Machine Studies, 1987, 27, 479-525.

            (Reprinted in G. Mancini, D. D. Woods, & E. Hollnagel (Eds), Cognitive Engineering in Complex Dynamic Worlds, Academic Press, 1988.)

           

Roth, E. M. & Woods, D. D.  Aiding human performance: I. Cognitive analysis. 

            Le Travail Humain, 1988, 51 (1), 39-64.

 

Woods, D. D. & Roth, E. M. Aiding human performance: II.  From cognitive analysis to

            support systems.  Le Travail Humain, 1988, 51 (2), 139-171.

 

Woods, D. D., Roth, E. M. & Pople, H. Jr.  Modeling human intention formation for human reliability assessment.  Reliability Engineering & System Safety, 1988, 22, 169-200.

 

Woods, D. D. & Roth, E. M. & Pople, H. Jr.  Cognitive Environment Simulation: An Artificial Intelligence System for Human Performance Assessment.  Washington D. C.: U. S. Nuclear Regulatory Commission, 1987. (NUREG-CR-4862).

 

Woods, D. D. & Roth, E. M. The Role of Cognitive Modeling in Nuclear Power Plant Personnel Activities.  Washington D. C.: U. S. Nuclear Regulatory Commission, 1986. (NUREG-CR-4532).

 

Roth, E. M. & Shoben, E.  The effect of context on the structure of categories. Cognitive Psychology, 1983, 15 (3), 346-378.

 

Roth, E. M. & Mervis, C. B. Fuzzy set theory and class inclusion relation in semantic categories.  Journal of Verbal Learning and Verbal Behavior, 1983, 22, 509-525.

 

Mervis, C. B. & Roth, E. M. The internal structure of basic and non-basic color categories.  Language, 1981, 57, 384-405.

 

Roth, E. M.  Facilitating insight in a reasoning task. British Journal of Psychology,

            1979, 70,  265-271.

 

 

Conference Proceedings

Mahoney, S., Roth, E., Steinke, K., Pfautz, J., Wu, C., Farry, M. (2010).  A cognitive task analysis for cyber situation awareness. Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting (pp. 279 – 283).  Santa Monica, CA: Human Factors and Ergonomics Society.

Roth, E. M., Easter, J., Hall, R., Kabana, L., Mashio, K., Hanada, S., Clouser, T. and Remley, G. (2010).  Person-in-the-loop testing of a digital paper plant control room. Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting (pp. 289 – 293).  Santa Monica, CA: Human Factors and Ergonomics Society.

 

Cao, D., Guarrera, T. K., Jenkins, M., Pennathur, P. R., Bisantz, A. M., Stone, R., Farry, M., Pfautz, J., and Roth, E. (2009).  Evaluating the creation and interpretation of causal influence models. In Proceedings of the Human Factors and Ergonomics Society 53rd Annual Meeting. (pp. 222-226). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Guarino, S. L., Harper, K., Liu, D., Roth, E., and Vincenzi, D. (2009).  Adaptive boundary aid in complex air combat scenarios. In Proceedings of the Human Factors and Ergonomics Society 53rd Annual Meeting. (pp. 66-70). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Pfautz, J., Koelle, D., Carlson, E., Roth, E. (2009).  Complexities and challenges in the use of Bayesian Belief Networks: Informing the design of causal influence models. In Proceedings of the Human Factors and Ergonomics Society 53rd Annual Meeting. (pp. 237-241). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Scott, R., Roth, E. M., Truxler, R., Ostwald, J., Wampler, J. (2009) Techniques for effective collaborative automation for air mission replanning. In Proceedings of the Human Factors and Ergonomics Society 53rd Annual Meeting. (pp. 202-206). Santa Monica, CA: Human Factors and Ergonomics Society

 

Roth, E., Scott, R., Whitaker, R., Kazmierczak, T., Truxler, R.,  Ostwald, J. , and Wampler, J. (2009).  Designing work-centered support for dynamic multi-mission synchronization.  Proceedings of the 2009 International Symposium on Aviation Psychology, April 27- 30, 2009 Dayton, Oh

 

Guarino, S., Harper, K., Liu, D., Bartosiewicz, M., Roth, E., and Vicenzi, D.  (2009). Assessing Novel Adaptive Displays Impact on Pilot Performance. Proceedings of the 2009 International Symposium on Aviation Psychology, April 27- 30, 2009 Dayton, Oh

 

Mahoney, S., Pfautz, J., Fichtl, T., Guarino, S., Carlson, E., Powell, G. and Roth, E. (2008).  Cognitive Systems Engineering for Evolvable Human-in-the-Loop Data Fusion. Proceedings of the Human Factors and Ergonomics Society 52th Annual Meeting.  (pp. 328 - 332). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Pfautz, J., Fouse, A., Farry, M., Bisantz, A., & Roth, E. (2007). "Representing Meta-Information to Support C2 Decision Making", to appear in the Proceedings of the International Command and Control Symposium (ICCRTS '07), June 19-21, Newport, Rhode Island.

 

Roth, E M., Scott, R., Whitaker, R., Kazmierczak, T., Forsythe, M., Thomas, G., Stilson, M. and Wampler, J. (2007).  Designing decision support for mission resource retasking.   Proceedings of the 2007 International Symposium on Aviation Psychology, April 23 – 26, 2007, Dayton, Ohio.

 

Potter, S. S., Woods, D. D., Roth, E. M., Fowlkes, J. and Hoffman, R. R. (2006).  Evaluating the effectiveness of a joint cognitive system:  metrics, techniques, and frameworks. Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting.  (pp. 314 - 318). Santa Monica, CA: Human Factors and Ergonomics Society.

 

 

Roth, E. M., Stilson, M., Scott, R., Whitaker, R., Kazmierczak, T., Thomas-Meyers, G. and Wampler, J. (2006).   Work-centered design and evaluation of a C2 Visualization Aid.  Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting.  (pp. 255- 259). Santa Monica, CA: Human Factors and Ergonomics Society.

 

 

Bisantz, A. M., Pfautz, J., Stone, R., Roth, E. M., Thomas-Meyers, G., and Fouse, A.  (2006).   Assessment of display attributes for displaying meta-information on maps.  Work-centered design and evaluation of a C2 Visualization Aid.  Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting.  (pp. 289- 293). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Pfautz, J., Roth, E., Powell, G., Fichtl, T., Guarino, S., and Carlson, E. (2006).  Cognitive complexities impacting army intelligence analysis. Work-centered design and evaluation of a C2 Visualization Aid.  Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting.  (pp. 452 - 256). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Wampler, J., Roth, E., Whitaker, R., Kendall, C., Stilson, M., Thomas-Meyers, G., and Scott, R. (2006).  Using work-centered specifications to integrate cognitive requirements into software development.  Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting.  (pp.240- 244 ). Santa Monica, CA: Human Factors and Ergonomics Society.

 

 

Roth, E. M. and Multer, J.  (2005). Fostering shared situation awareness and on-track safety across distributed teams in railroad operations.  Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting.  (pp.529-533). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Patterson, E. S., Roth, E. M., and Render, M. (2005).  Handoffs during nursing shift changes in acute care.  Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting.  (pp.1057-1061). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Pfautz, J., Fouse, A., Fichtl, T., Bisantz, A., Roth, E., and Madden, S. (2005). The impact of meta-information on decision-making in intelligence operations.  Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting.  (pp.214-218). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Scott, R., Roth, E., Deutsch, S., Kuper, S., Schmidt, V., Stilson, M., and Wampler, J. (2005). Envisioning evolvable work-centered support systems:  Empowering users to adapt their systems to changing world demands. Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting.  (pp.244-248). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Eggleston, R. G., Roth, E., Whitaker, R., and Scott, R. (2005).  Conveying work-centered design specifications to the software designer: A retrospective case analysis. Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting.  (pp.332-336). Santa Monica, CA: Human Factors and Ergonomics Society.

 

D'Amico, A., Whitley, K., Tesone, D., O'Brien, B., and Roth, E. (2005).  Achieving cyber defense situational awareness:  A cognitive task analysis of information assurance analysts.  Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting.  (pp.229-233). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Wampler, J., Whitaker, R., Roth, E., Scott, R., Stilson, M. and Thomas-Meyers, G. (2005). Cognitive Work Aids for C2 Planning:  Actionable Information to Support Operational Decision Making. In Proceedings of the 10th International Command and Control Research and Technology Symposium (June, 2005). Available online at: http://www.dodccrp.org/events/10th_ICCRTS/CD/search.htm

 

Roth, E. M., Hanson, M. L., Hopkins, C., Mancuso, V. and Zacharias, G. L. (2004).  Human in the Loop Evaluation of a Mixed-Initiative System for Planning and Control of Multiple UAV Teams.  Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting.  (pp. 280 – 284). Santa Monica, CA: Human Factors and Ergonomics Society.

Pfautz, J., Roth, E., Jones, K., Hudlicka, E., Fichtel, T., Karabaich, B. and Zacharias, G. Design and Evaluation of a Visualization Aid for Stability and Support Operations. In Vincenzi, D. A., Mouloua, M. and Hancock, P. A. (Eds) Human Performance, Situation Awareness, and Automation: Current Research and Trends, Volume II.  Mahwah, NJ: Lawrence Erlbaum Associates, .  2004, pp. 253-258.

 

Dierks, M. M., Christian, C. K., Roth, E. M., Sheridan, T. B., Dwyer, K.,  Gandhi, T. K., Gustafson, M. & Zinner, M. J. (2003).  Healthcare safety: The impact of disabling ‘safety’ protocols.   Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting.  (pp. 400 – 404). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Eggleston, R. G., Roth, E. M. and Scott, R. A (2003). A framework for work-centered product evaluation.  Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting.  (pp. 503 – 507). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Bisantz, A. M., Burns, C. M. and Roth, E. M. (2002).  Validating Methods in Cognitive Engineering:  A Comparison of Two Work Domain Models. In Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting.  (pp. 521-527) Santa Monica, CA: Human Factors and Ergonomics Society.

 

Lang, A. W., Roth, E. M., Bladh, K. and Hine, R. (2002).  Using a Benchmark-Referenced Approach for Validating a Power Plant Control Room:  Results of the Baseline Study.  In Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting.  (pp. 1878-1882) Santa Monica, CA: Human Factors and Ergonomics Society.

 

Roth, E. M., Gualtieri, J. W., Elm, W. C., and Potter, S. S. (2002).  Scenario Development for Decision Support System Evaluation.  In Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting.  (pp. 357-361) Santa Monica, CA: Human Factors and Ergonomics Society.

 

Scott, R., Roth, E. M., Deutsch, S. E., Malchiodi, E., Kazmierczak, T., Eggleston, R. G., Kuper, S. M., Whitaker, R.  (2002). Using Software Agents in a Work Centered Support System for Weather Forecasting and Monitoring.   In Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting.  (pp.433-437) Santa Monica, CA: Human Factors and Ergonomics Society.

 

Bisantz, M., Roth, E., Brickman, B., Gosbee, L., Hettinger, L. & McKinney, J. (2001).  Integrating cognitive analysis into a large scale system design process.  In Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting (pp. 434-438).  Santa Monica, CA: Human Factors and Ergonomics Society.

 

Patterson, E., Woods, D., Tinapple, D. & Roth, E (2001).   Using cognitive task analysis to seed design concepts for intelligence analysis under data overload.  In Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting (pp. 439-443).  Santa Monica, CA: Human Factors and Ergonomics Society.

 

Gualtieri, J. W., Elm, W. C., Potter, S. S., & Roth, E. M. (2001).  Analysis with a purpose: Narrowing the gap with a pragmatic approach.  In Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting (pp. 444-448).  Santa Monica, CA: Human Factors and Ergonomics Society.

 

Roth, E. M., Gualtieri, J., Easter, J., Potter, S. S. and Elm, W. C. (2000). Bridging the Gap between Cognitive Analysis and Cognitive Engineering.  Presented at the 5th Naturalistic Decision Making Conference held in Sweden, May, 2000.

 

Gualtieri, J. W., Roth, E. M., & Eggleston, R. G. (2000). Utilizing the abstraction hierarchy for role allocation and team structure design. Proceedings of HICS 2000 - 5th International Conference on Human Interaction with Complex Systems (pp. 219-223). Urbana-Champaign, IL: Beckman Institute.

 

Lenox, T., Hahn, S., Lewis, M. & Roth, E. M. (1999).  Improving performance: Should we support individuals or teams? . In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting (pp. 223-227). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Roth, E. M., Malsch, N., Multer, J., & Coplen, M. (1999).  Understanding how train dispatchers manage and control trains:  A cognitive task analysis of a distributed planning task. . In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting (pp. 218-222). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Roth, E. M. & O’Hara, J. (1999). Exploring the impact of advanced alarms, displays, and computerized procedures on teams. In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting (pp.158-162). Santa Monica, CA: Human Factors and Ergonomics Society. 

 

Woods, D. D., Patterson, E. S., Roth, E. M. & Christoffersen, K. (1999).  Can we ever escape from data overload? A Cognitive Systems Diagnosis. . In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting (pp.174-178). Santa Monica, CA: Human Factors and Ergonomics Society.

 

Lenox, T., Lewis, M., Roth, E., Shern, R., Roberts, L., Rafalski, T., & Jacobson, J.  Support of Teamwork in Human-Agent Teams.  Proceedings of the 1998 IEEE International Conference on Systems Man and Cybernetics, San Diego, CA, 1341-1346.

 

Roth, E. M., Lin, L., Thomas, V. M., Kerch, S., Kenney, S. J. & Sugibayashi, Nubuo (1998).  Supporting situation awareness of individuals and teams using group view displays. Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting. , (pp. 244-248).  Santa Monica, CA: HFES

 

Roth, E. M., Malsch, N., Multer, J., Coplen, M. & Katz-Rhoads, N. (1998). Analyzing Railroad Dispatchers’ Strategies:   A Cognitive Task Analysis of A Distributed Team Planning Task. Proceedings of the 1998 IEEE International Conference on Systems, Man, and Cybernetics, San Diego, CA, 2539-2544.

 

Potter, S. S., Roth, E. M., Woods, D. D. & Elm, W. C. A Framework for Integrating Cognitive Task Analysis into the System Development Process. Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting. , (pp. 395-399).  Santa Monica, CA: HFES

 

Sowb, Y. A., Loeb, R. G. & Roth, E. M.  (1998) Cognitive Modeling of Intraoperative Critical Events.  Proceedings of the 1998 IEEE International Conference on Systems, Man, and Cybernetics, San Diego, CA, 2533-2538.

 

Vicente, K. J., Mumaw, R.J. & Roth, E. M.  (1998).  More about operator monitoring under normal operations:  The role of workload regulation and the impact of control room technology.  Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, (pp. 229-333).  Santa Monica, CA: HFES.

 

Thomas, V. M., Sugibayashi, N., Lin, L. & Roth, E. M.  (1998).  Enhanced Operator Support through Integrated Resources and Large Wall Panel Display Application within a Compact Main Control Room. Proceedings of the 11th Pacific Basin Nuclear Conference, May '98, Information & Operational Feedback Systems session.

 

Potter,  S. S., Roth, E. M., Woods, D. D. , and Elm, W. C. Cognitive Task Analysis as Bootstrapping Multiple Converging Techniques.  Paper presented at the NATO-ONR Workshop on Cognitive Task Analysis, Oct. 30 –31, 1997, Washington, DC.

 

Roth, E. M., Mumaw, R. J., Vicente, K. J. & Burns, C. M.  (1997).  Operator monitoring during normal operations: vigilance or problem solving?  In Proceedings of the 41st Annual Meeting of the Human Factors and Ergonomics Society, (Albuquerque, New Mexico, Sept. 22-26).  Santa Monica, CA: Human Factors and Ergonomics Society. (pp. 158-162).

 

Roth, E. M., Brockhoff, C. S., Rusnica, L. A., Kenney, S., Kerch, S. P., Thomas, V. M. (1997).  Rapid prototyping and simulator evaluation of a wall panel overview display.  In Proceedings of the 1997 IEEE Sixth Conference on Human Factors and Power Plants. (Orlando, Florida, June 8 -13)  New York: Institute of Electrical and Electronic Engineers. (pp. 18-14 - 18-19).

 

Vicente, K. J., Mumaw, R. J., Roth, E. M., & Burns, C. M. (1996). A field study of operator monitoring: Strategies for adapting control room technology,"  Proceedings of Cognitive Systems Engineering in Process Control '96 (pp. 222-229). Kyoto, Japan: Kyoto University.

 

Vicente, K. J., Burns, C. M., Mumaw, R. J. & Roth, E. M. How do operators monitor a nuclear power plant?:  A field study.  In Proceedings of the American Nuclear Society International Topical Meeting:  Nuclear Plant Instrumentation, Control, and Human-Machine Interface Technologies, State College, PA., 1996, (pp. 1127-1134).

 

Hoecker, D. G. & Roth, E. M.  Operators’ use of alternative soft control prototypes in a simulated control-room task. In Proceedings of the American Nuclear Society International Topical Meeting:  Nuclear Plant Instrumentation, Control, and Human-Machine Interface Technologies, State College, PA., 1996, (pp. 209 - 216).

 

Hoecker, D. G. & Roth, E. M.  Using models of operator performance to support MMIS Design:  An example in the use of procedural aids. In Proceedings of the American Nuclear Society International Topical Meeting:  Nuclear Plant Instrumentation, Control, and Human-Machine Interface Technologies, State College, PA., 1996, (pp. 1135 - 1140).

 

Carrera, J. P., Easter, J. R. & Roth, E. M.  Simulator testing of the Westinghouse AWARE alarm management system. In  Proceedings of the IAEA Specialists meeting on Experience and Improvements in Advanced Alarm Annunciation Systems in NPPs, Sept. 16-20, 1996.

 

Roth, E. M. & Mumaw, R. J. Using Cognitive Task Analysis to Define Human Interface Requirements for First-of-a-Kind Systems.  Proceedings of the Human Factors and Ergonomics Society 39th Annual Meeting, San Diego, CA, Oct. 9-13, 1995.  (pg. 520-524).

 

Mumaw, R. J. & Roth, E. M.  Training Complex Tasks in a Functional Context. Proceedings of the Human Factors and Ergonomics Society 39th Annual Meeting, San Diego, CA, Oct. 9-13, 1995. (pg. 1253-1257)

 

Roth, E. M. Crew Performance In Complex Simulated Emergencies:  What Simulator Data Can Tell Us About Contributors to Human Reliability and Human Error.   Proceedings of the workshop on Human Reliability Models: Theoretical and Practical Challenges, Stockholm, Sweden, August 22-24, 1994 (In press.)

 

Roth, E. M., Mumaw, R. J. & Lewis, P. M.  Enhancing crew performance in complex Emergencies: What we can learn from simulator data. American Nuclear Society Embedded Topical Meeting on “Computer-Based Human Support Systems:  Technology, Methods and Future”,  Philadelphia, PA, June 25-29, 1995.

 

Roth, E. M, Mumaw, R. J., & Lewis, P. M.  Operator use of procedures during simulated emergencies.  Proceedings of the 22nd Water Reactor Safety Information Meeting, October 24-26, 1994.

 

Roth, E. M. Operator performance in cognitively complex simulated emergencies:  Implications for computer-based support systems.  Proceedings of the 38th Annual Meeting of the Human Factors and Ergonomics Society,  October 24-28, 1994.

 

Hoecker, D. G., Corker, K. M., Roth, E. M., Lipner, M. H. & Bunzo, M. S. Man-Machine Design and Analysis System (MIDAS) applied to a computer-based procedure-aiding system.  Proceedings of the 38th Annual Meeting of the Human Factors and Ergonomics Society,  October 24-28, 1994.

 

Hoecker, D. G. & Roth, E. M.  MIDAS in the Control Room:  Applying a flight deck cognitive modeling design tool to another domain.  In Proceedings of the Third International Workshop on Human-Computer Teamwork, Sept. 1994.

 

Mumaw, R. J. & Roth, E. M.  Design of group overview displays to support operator performance.  Transactions of the 1994 Annual Meeting of the American Nuclear Society, June 19-23, 1994, New Orleans, Louisiana, (Vol. 70 p. 115.)

 

Mumaw, R. J., Roth, E. M., & Schoenfeld, I.  Analysis of complexity  and errors in nuclear power severe accident management. Proceedings of the 37th  Annual Meeting of the Human Factors and Ergonomics Society, October 11-15, 1993, Seattle, WA.

 

Mumaw, R. J., Roth, E. M. & Schoenfeld, I.  Human factors issues in severe accident management:  Training for decision making under stress.  Proceedings of the 21st Water Reactor Safety Information Meeting,  Bethesda, MD, 1993.

 

Roth, E. M. & Mumaw, R. J. Operator Performance in Cognitively Complex Simulated Emergencies. Paper presented at the American Nuclear Society Topical Meeting on Nuclear Plant Instrumentation, Control, and Man-Machine Interface Technologies, Oak Ridge, Tennessee, April 18-21, 1993.

 

Roth, E. M., Mumaw, R. J., Pople, H. E., Lewis, P. M.  Cognitive Demands in Complex Simulated Emergencies:  Some Results of the CES Project.  Proceedings of the Twentieth Water Reactor Safety Information Meeting, Bethesda, Maryland, Oct. 21-23, 1992.

 

Roth, E. M., Mumaw, R. J., & Pople, H. E. Enhancing the training of cognitive skills for improved human reliability: Lessons learned from the cognitive environment simulation project.  Proceedings of the 1992 IEEE Fifth Conference on Human Factors and Power Plants, Monterey, Cal., June 7-11, 1992.

 

Roth, E. M., Mumaw, R. J., & Stubler, W. F. Human factors evaluation issues for advanced control rooms: A research agenda.  Proceedings of the 1992 IEEE Fifth Conference on Human Factors and Power Plants, Monterey, Cal., June 7-11, 1992.

 

Mumaw, R. J. & Roth, E. M. How to be more devious with a training simulator: Redefining scenarios to emphasize cognitively difficult situations.  1992 Simulation MultiConference: Nuclear Power Plant Simulation and Simulators, Orlando, FL, April 6-9, 1992.

 

Roth, E. M., Pople, H. E., & Mumaw, R. J.  Expanding the Modeling Capabilities of the Cognitive Environment Simulation.  In Transactions of the Nineteenth Water Reactor Safety Information Meeting,  U. S. Nuclear Regulatory Commission, Office of Nuclear Regulatory Research  (NUREG/CP-0118) , 1991 (conference held in Bethesda, Maryland, October 28-30, 1991).

 

Stubler, W. F., Roth, E. M., & Mumaw, R. J.  Evaluation issues for computer-based control rooms.  Proceedings of the Human Factors Society.  35th Annual Meeting, 383-387, 1991.

 

Mumaw, R. J., Roth, E. M. & Stubler, W. F.  An analytic technique for framing control room evaluation issues.  Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, 1355-1360, 1991. 

 

Roth, E. M. & Woods, D. D. Analyzing the cognitive demands of problem-solving environments: An approach to cognitive task analysis.   Proceedings of the Human Factors Society.  34th Annual Meeting, 1314-1317, 1990.

 

Woods, D. D., Roth, E. M. , Stubler, W. F. & Mumaw, R. J.  Navigating through large display networks in dynamic control applications.   Proceedings of the Human Factors Society.  34th Annual Meeting, 396-399, 1990.

 

Woods, D. D., Roth, E. M. & Pople, Jr.  Modeling Operator Performance in Emergencies.Proceedings of the Human Factors Society.  34th Annual Meeting, 1132-1136, 1990.

 

Woods, D. D.,  Pople, H. Jr. & Roth, E. M. The cognitive environment simulation

            as a tool for modeling human performance and reliability.   Proceedings of the 17th Water Reactor  Safety Information Meeting, 1989.

 

McKinley, E. K., Mauldin, M. L. & Roth, E. M. An expert "critiquer" for propulsion gear design:  A case study in intelligent decision support.  Proceedings of the Human Factors Society.  33rd Annual Meeting, 404- 407, 1989.

 

Roth, E. M., Woods, D. D., Elm, W., & Gallagher, J. M. Jr. Providing on-line advice for a dynamic control task: A case study in intelligent support system design.  In Proceedings of the Human Factors Society. 31st Annual Meeting,  36-40,1987.

 

Roth, E. M., Woods, D. D., & Gallagher, J. M. Jr. Analysis of expertise in a dynamic control task. In Proceedings of the Human Factors Society.  30th Annual Meeting, 179-181, 1986.

 

Woods, D. D. & Roth, E. M.  Modeling cognitive behavior in nuclear power plants: An overview of contributing theoretical traditions.  In Proceedings of the International Topical Meeting on Advances in Human Factors in Nuclear Power Systems.  American Nuclear Society/European Nuclear Society, 1986.

 

Bennett, K. B., Woods, D. D., Roth, E. E., & Haley, P. H.  Predictor displays for complex, dynamic tasks: a preliminary investigation. In Proceedings of the Human Factors Society.  30th Annual Meeting, 684-688, 1986. 

 

Roth, E. M., Butterworth, G., II, & Loftus, M. J.   The problem of explanation: placing computer generated answers in context.  In Proceedings of the Human Factors Society.  29th Annual Meeting, 1985. Vl. II.

 

Roth, E. M., Elias, G. S., Mauldin, M. L., & Ramage, W. W. Toward joint person-machine cognitive systems: A prototype expert system for electronics troubleshooting.   In Proceedings of the Human Factors Society.  29th Annual Meeting, 1985. Vol. I.

 

Roth, E. M. & Woods, D. D. Designing joint person-machine cognitive systems.  In Proceedings of the Workshop on Military Applications of Expert Systems, Army Research Office, 1985.

 

Woods, D. D. & Roth, E. M.  The pragmatics of intelligent tools.  In Proceedings of Aerospace Applications of Artificial Intelligence, 1985.

 

Roth, E. M. & Bernard, T. E. A psychophysiological technique for evaluation of television images.  Society  for Information Display International Symposium Digest of Technical Papers, 1985, XVI, 108-110.

 

Salem, H., Roth, E. M. & Fornango, J.  A comparison of automated data collection and manual data collection for toxicology studies.  Arch. Toxicol., Suppl., 1983, 6, 361-364.