The Practice of Large Language Models in Automated Question Generation: A Case Study of ChatGLM in High School Information Technology Curriculum

Abstract

With the advancement of information technology, the field of education is undergoing transformation. In the teaching of high school information technology, scientific and efficient question formulation is crucial for enhancing the quality of education. Traditional methods of question formulation rely on the experience of teachers, leading to issues such as inconsistent difficulty levels and incomplete coverage of knowledge points. Large language models (LLMs), such as ChatGLM, leverage natural language processing and deep learning technologies to automatically generate questions that align with the curriculum, thereby improving scientific accuracy and precision, enhancing diversity and innovation, and catering to students’ personalized needs. Additionally, LLMs can enhance the efficiency of question formulation and reduce the burden on teachers. This paper explores the application value of large language models in the formulation of questions for high school information technology, through empirical research comparing the performance of human-generated and ChatGLM-generated questions in terms of accuracy, relevance, clarity, and willingness. The study selected two chapters, “Data and Information” and “Fundamentals of Algorithms,” and employed both human and ChatGLM-generated questions, inviting teachers to evaluate them. Through data analysis and statistical testing, we reveal the advantages and limitations of large language models in educational question formulation, providing insights for the intelligent development of educational assessment systems.