| Research Projects | Internal | AIffectiveness: Effectiveness of Generative AI Tutors in Higher Education
bidt background

AIffectiveness: Effectiveness of Generative AI Tutors in Higher Education

The project accompanies the introduction and use of the generative AI tool “OneTutor” at universities in Bavaria to investigate its influence on students' learning behaviour and academic success. By conducting quantitative surveys among students and lecturers, as well as system-based data from the use of “OneTutor”, insights are gained into the integration and effectiveness of such systems in higher education teaching.

Project description

Studies by the bidt on the prevalence and acceptance of generative AI show that the use of tools like ChatGPT is more widespread among students than in any other population group. Students primarily use generative AI to research information, summarize texts, or even generate content. A relatively new phenomenon is that universities themselves are also using generative AI tools to support teaching. For example, AI tutors are now being used to answer questions about a lecture or help achieve learning goals through test questions, based on teaching materials from a specific course.

Using the concrete example of “OneTutor” from the Chair of Software and Systems Engineering at the Technical University of Munich, the project accompanies the introduction and use of this generative AI tutor at various universities in Bavaria across different courses. The goal is to assess, among other things, how the tutor influences students’ learning behaviour.

The project team is examining aspects of the use and effectiveness of the generative AI tutor in higher education teaching. By conducting quantitative surveys among students at different times regarding their experience with the tool, as well as surveys of lecturers, the project aims to gain new insights into the potential and areas for development related to the integration of such systems in higher education. In particular, the effects on learning behavior and learning outcomes are to be examined. Prospectively, usage data from the “OneTutor” itself will also be increasingly incorporated into the analyses.

The aim of the project is to gain insights into the use and effectiveness of AI tutors in higher education in general, using the example of “OneTutor”.

Project team

Dr. Roland A. Stürz

Head of Think Tank, bidt

Christian Stumpf

Researcher Think Tank, bidt

Vinzenz Löwel

Vinzenz Löwel

Researcher Think Tank, bidt

Contributions