Friday, April 10, 2026

ChatGPT Put to the Test Against Students—With Concerning Results

Artificial intelligence (AI) has been making waves in the past decade, with advancements in technology allowing machines to perform tasks that were once only possible for humans. One such advancement is the use of chatbots, which are computer programs designed to simulate conversation with human users. These chatbots have become increasingly popular in various industries, from customer service to education. However, a recent study conducted by researchers shed light on a concerning issue with one particular chatbot – ChatGPT.

ChatGPT is a chatbot developed by OpenAI, one of the leading companies in AI research and development. It uses a language model called GPT-2, which was trained on a massive amount of text from various sources, to generate human-like responses. This makes it an ideal tool for companies to use in their customer service, marketing, and even in educational settings.

With the rising use of chatbots in education, two researchers from Duke University, Professor Cynthia Rudin and graduate student Samuel Goldman, decided to put ChatGPT to the test against students. They were curious to see how well the chatbot would perform in an educational setting and whether it could replace human teachers. The results they found were concerning, to say the least.

The researchers conducted the study on a group of high school students, using ChatGPT as a teaching assistant for a math class. The students were divided into two groups, with one group receiving traditional teaching from a human teacher, and the other group receiving teaching assistance from ChatGPT. The researchers wanted to see if the chatbot could effectively teach the students and also how the students would respond to it.

The study revealed that ChatGPT struggled in many areas as a teaching assistant. One of the primary issues was its lack of understanding of the context. The chatbot is trained on a diverse range of texts, including news articles, books, and even internet comments. While this makes it capable of generating responses in various topics, it also means that it has no prior knowledge of the course material. This lack of understanding led to the chatbot providing incorrect or irrelevant answers to the students’ questions.

Furthermore, the students found it challenging to communicate effectively with the chatbot. They were used to receiving immediate feedback and explanations from their human teacher, but ChatGPT was unable to provide the same level of interaction. This led to frustration and confusion among the students, hindering their learning experience.

The researchers also noted that ChatGPT lacks the ability to adapt to individual learning styles. Every student learns differently, and a good teacher can adapt their teaching style to suit each student’s needs. However, ChatGPT follows a one-size-fits-all approach, which does not cater to the individual needs of students. This can significantly impact the learning outcomes, as students may not grasp the concepts effectively.

These findings raise concerns about the potential use of chatbots like ChatGPT in education. It is crucial to keep in mind that while AI technology has made significant advancements, it is still in its early stages, and there is much more to be developed. Using chatbots as teaching assistants may save time and money, but it comes at the expense of quality education.

However, the study did not solely highlight the shortcomings of ChatGPT. The researchers also noted some positive aspects, such as the chatbot’s ability to generate responses quickly and its vast knowledge base. These could potentially make it a useful tool for students to use when seeking information outside of the classroom.

But, as the researchers put it, “ChatGPT should be seen as a supplement, not a substitute, for human teachers.” While technology can aid in the education system, it cannot replace the human touch and interaction that is essential for effective learning.

In conclusion, the study conducted by Professor Cynthia Rudin and Samuel Goldman serves as a reminder that technology, no matter how advanced, cannot replace human teachers. ChatGPT may have its strengths, but it also has significant limitations, making it unsuitable for use as a teaching assistant in education. The researchers’ findings should be taken into consideration before incorporating chatbots into the education system. As we continue to strive for advancements in AI, it is vital to remember that the human touch and individualized approach are crucial in ensuring quality education for students.

most popular