Jonathan Dodge

jxd6067 (at) psu (dot) edu


Hi, I recently completed my Ph.D. in computer science at Oregon State University, advised by Dr. Margaret Burnett and co-advised by Dr. Tom Dietterich. In July 2022 I joined the faculty at Pennsylvania State University in the College of IST.

While my research interests have varied, my PhD dissertation centers on eXplainable AI (XAI) problems from both the human side and the system side. Broadly speaking, XAI is concerned with any tools or techniques used by the wide variety of people who assess AI-infused systems, from expert developers to novice end users.

Before returning to OSU as a Ph.D. student, I obtained my M.S. in 2009 from the graphics department, where I was advised by Dr. Ron Metoyer. My MS thesis project focused on understanding and supporting the needs of exercise prescribers in creating rich media to support their patients.

Google Scholar Profile

My CV

Degrees

2022 Ph.D., Oregon State University, School of Electrical Engineering and Computer Science. Dissertation title: Explanations and Processes to Enable Humans to Assess AI with Respect to Manipulable Properties. Topics: HCI and AI.

2009 M.S., Oregon State University, School of Electrical Engineering and Computer Science. Thesis title: Studies to inform a visual language for authoring interactive exercise prescriptions. Topics: HCI and Graphics.

2006 B.S., Harvey Mudd College, Computer Science.

Awards

Best Reviewer Award (2021, given by conference organizers for insightful and supportive feedback on submissions to User Modeling, Adaptation, and Personalization UMAP)

Graduate Research Assistant Award (2021, given by Oregon State University's College of Engineering for outstanding achievement as a graduate research assistant)

Outstanding Paper Award (2019, given by IUI conference organizers for Explaining Models: An Empirical Study of How Explanations Impact Fairness Judgment by Dodge et al.)

The Aerospace Corporation Spot Award (2005, outstanding performance on our HMC Clinic project)

Wing Tam Award (2004, Given by Harvey Mudd College annually to a student or student team for demonstrating excellence in software design and development)

Paul Kafrissen CS Award (2002, from Wyoming Seminary for excellence in the study of CS)

National Merit Commended Scholar (2002)

Eagle Scout Award (2000, Project: Constructed a building for the Lightstreet Fire Hall, from pouring the foundation to shingling)

Trustee Achievement Scholarship (1999, from Wyoming Seminary to students who combine outstanding performance on a competitive exam with a solid record of citizenship and achievement.)

Journal Publications

J06. R. Khanna, J. Dodge, A. Anderson, R. Dikkala, J. Irvine, Z. Shureih, K. Lam, C. Matthews, Z. Lin, M. Kahng, A. Fern, and M. Burnett. Finding AI's Faults with AAR/AI: An Empirical Study. ACM Transactions on Interactive Intelligent Systems (TIIS). 2022.

J05. J. Dodge, A. Anderson, R. Khanna, J. Irvine, K. Lam, D. Tabatabai, A. Ruangrotsakun, Z. Shureih, M. Kahng, A. Fern, and M. Burnett. From “no clear winner” to an effective Explainable Artificial Intelligence process: An empirical journey. Applied AI Letters. 2021.

J04. J. Dodge, R. Khanna, J. Irvine, K. Lam, T. Mai, Z. Lin, N. Kiddle, E. Newman, A. Anderson, S. Raja, C. Matthews, C. Perdriau, M. Burnett, and A. Fern. After-Action Review for AI (AAR/AI). ACM Transactions on Interactive Intelligent Systems (TIIS). 2021.

J03. S. Penney, J. Dodge, A. Anderson, C. Hilderbrand, L. Simpson, and M. Burnett. The Shoutcasters, the Game Enthusiasts, and the AI: Foraging for Explanations of Real-Time Strategy Players. ACM Transactions on Interactive Intelligent Systems (TIIS). 2021.

J02. A. Anderson, J. Dodge, A. Sadarangani, Z. Juozapaitis, E. Newman, J. Irvine, S. Chattopadhyay, M. Olson, A. Fern, and M. Burnett. Mental Model of Mere Mortals with Explanations of Reinforcement Learning. ACM Transactions on Interactive Intelligent Systems (TIIS). 2020.

J01. B. Bentow, J. Dodge, A. Homer, C.D. Moore, R.M. Keller, M. Presley, R. Davis, J. Seidel, C. Lee, and J. Betser. Grid-enabling a vibroacoustic analysis toolkit. International Journal of High Performance Computing and Networking. 2008.

Conference Publications

C13. J. Dodge, A. Anderson, M. Olson, R. Dikkala, and M. Burnett. How Do People Rank Multiple Mutant Agents? ACM Conference on Intelligent User Interfaces (IUI). 2022.

C12. (short) D. Tabatabai, A. Ruangrotsakun, J. Irvine, J. Dodge, Z. Shureih, K. Lam, M. Burnett, A. Fern, and M. Kahng. “Why did my AI agent lose?”: Visual Analytics for Scaling Up After-Action Review. IEEE Visualization and Visual Analytics (VIS). 2021.

C11. R. Dikkala, R. Khanna, C. Matthews, J. Dodge, S. Raja, C. Hu, J. Irvine, Z. Shureih, K. Lam, A. Anderson, M. Kahng, A. Fern and M. Burnett Doing COVID-era Controlled Studies with Humans: Tales from the Trenches. IEEE/ACM Cooperative and Human Aspects of Software Engineering (CHASE). 2021.

C10. T. Mai, R. Khanna, J. Dodge, J. Irvine, K. Lam, Z. Lin, N. Kiddle, E. Newman, S. Raja, C. Matthews, C. Perdriau, M. Burnett, and A. Fern. Keeping It "Organized and Logical": After-Action Review for AI (AAR/AI). ACM Conference on Intelligent User Interfaces (IUI). 2020.

C09. A. Anderson, J. Dodge, A. Sadarangani, Z. Juozapaitis, E. Newman, J. Irvine, S. Chattopadhyay, A. Fern, and M. Burnett. Explaining Reinforcement Learning to Mere Mortals: An Empirical Study. International Joint Conference on Artificial Intelligence (IJCAI). 2019.

C08. J. Dodge, Q. V. Liao, Y. Zhang, R. Bellamy, and C. Dugan. Explaining Models: An Empirical Study of How Explanations Impact Fairness Judgment. ACM Conference on Intelligent User Interfaces (IUI). 2019. (Outstanding Paper)

C07. J. Dodge, S. Penney, C. Hilderbrand, A. Anderson, L. Simpson, and M. Burnett. How the Experts Do It: Assessing and Explaining Agent Behaviors in Real-Time Strategy Games. ACM Conference on Human Factors in Computing Systems (CHI). 2018.

C06. S. Penney, J. Dodge, C. Hilderbrand, A. Anderson, and M. Burnett. Toward Foraging for Understanding of StarCraft Agents: An Empirical Study. ACM Conference on Intelligent User Interfaces (IUI). 2018.

C05. S. Greydanus, A. Koul, J. Dodge, and A. Fern. Visualizing and Understanding Atari Agents. International Conference on Machine Learning (ICML). 2018.

C04. K. Vergin, N. Jhirad, J. Dodge, C. Carlson, and S. Giovannoni. Marine bacterioplankton consortia follow deterministic, non-neutral community assembly rules. Aquatic Microbial Ecology. 2017.

C03. Y. Riche, J. Dodge, and R.A. Metoyer. Studying always-on electricity feedback in the home. ACM Conference on Human Factors in Computing Systems (CHI). 2010.

C02. J. Dodge, R.A. Metoyer, and K. Gunter. Implications for an Exercise Prescription Authoring Notation. IEEE Symposium on Visual Languages and Human-Centric Computing (VLHCC). 2009.

C01. R.A. Metoyer, S. Stumpf, C. Neumann, J. Dodge, J. Cao, and A. Schnabel. Explaining How to Play Real-Time Strategy Games. 29th SGAI International Conference on Artificial Intelligence. 2009.

Workshop Publications

W08. J. Dodge. Position: The Case Against Case-Based Explanation. IUI Workshop on Transparency and Explanations in Smart Systems (TExSS). 2022.

W07. J. Dodge. Position: Who Gets to Harness (X)AI? For Billion-Dollar Organizations Only. IUI Workshop on Transparency and Explanations in Smart Systems (TExSS). 2021.

W06. K. Lam, Z. Lin, J. Irvine, J. Dodge, Z. Shureih, R. Khanna, M. Kahng, and A. Fern. Identifying Reasoning Flaws in Planning-Based RL Using Tree Explanations. IJCAI-PRICAI 2020 Workshop on Explainable Artificial Intelligence. 2020.

W05. J. Dodge and M. Burnett. Position: We Can Measure XAI Explanations Better with Templates. Explainable Smart Systems and Algorithmic Transparency in Emerging Technologies (ExSS-ATEC). 2020.

W04. J. Dodge, S. Penney, A. Anderson and M. Burnett. What Should Be in an XAI Explanation? What IFT Reveals. Workshop on Explainable Smart Systems (ExSS). 2018.

W03. S. Greydanus, A. Koul, J. Dodge, and A. Fern. Visualizing and Understanding Atari Agents. NIPS 2017 Interpretability workshop. 2017.

W02. C. Neumann, A. Schnabel, J. Dodge, R. A. Metoyer, S. Stumpf. How Experts Explain Strategic Behavior During Real-Time Strategy Games. Association for the Advancement of Artificial Intelligence Workshops (AAAI). 2007.

W01. B. Bentow, J. Dodge, A. Homer, C.D. Moore, R.M. Keller, M. Presley, R. Davis, J. Seidel, C. Lee, and J. Betser. Grid-Enabling a Vibroacoustic Analysis Application. IEEE/ACM International Workshop on Grid Computing. 2005.

Other Publications

O06. (Dissertation) J. Dodge. Explanations and Processes to Enable Humans to Assess AI with Respect to Manipulable Properties. PhD Dissertation for Oregon State University. 2022.

O05. T. Kuflik, J. Dodge, S. Kleanthous Loizou, B. Lim, C. Negreanu, A. Shulner-Tal, S. Stumpf. TExSS: Transparency and Explanations in Smart Systems. IUI Proceedings Extended-Abstract. 2022.

O04. A. Smith-Renner, S. Loizou, J. Dodge, M.K. Lee, B. Lim, T. Kuflik, A. Sarkar, A. Shulner-Tal, and S. Stumpf. TExSS: Transparency and Explanations in Smart Systems. IUI Proceedings Extended-Abstract. 2021.

O03. J. Dodge, M. Hilton, R. A. Metoyer, J. Hunter, K. Smeltzer, C. Vijay, and A. Atkinson. Deriving Age Diverse Personas from a Participatory Design Study on Home Electricity Feedback. CHI Conference Extended Abstracts on Human Factors in Computing Systems. 2017.

O02. (Thesis) J. Dodge. Studies to inform a visual language for authoring interactive exercise prescriptions. Master's Thesis for Oregon State University. 2009.

O01. (Symposium slides) B. Bentow, J. Dodge, A. Homer, C.D. Moore, R.M. Keller, M. Presley, R. Davis, J. Seidel, C. Lee, and J. Betser. System Management for Grid-Enabling a Vibroacoustic Analysis Application. IEEE/IFIP Network Operations and Management Symposium (NOMS). 2006.