“What does ChatGPT Know about Information Systems?” accepted for publication at the Communications of the AIS

I recently worked on a research project with Dan O’Leary, Veda Storey, Aaron French, Joseph Buckman, Cecil Chua, Grace Gu, Fred Niederman, Francis Pereira, Gary Templeton, and Linda Wallace that explored how well ChatGPT would do with exam and quiz questions used by faculty in Information Systems (IS) courses. I’m happy to report that our work has been accepted for publication in the Communications of the AIS.

The study found that generative AI tools like ChatGPT performed well on actual exams and quizzes in general IS courses, database management, systems analysis and design, project management, and cybersecurity. ChatGPT earned a B average with multiple-choice and true/false questions and an A average on short answer/essay questions.

We recommend that academia look at ways to implement AI tools in the classroom so that students can be prepared for their use in the workplace, rather than prohibiting their use. It’s our job to ensure that students are well prepared when they graduate, and AI is just the latest innovation we must incorporate into our teaching.

The article is available for download at https://aisel.aisnet.org/cais/vol56/iss1/19/