Then, the students were tested on how they solved the problem from memory, and the tables turned. The ChatGPT group “remembered nothing, and they all failed,” recalled Klopfer. Meanwhile, half of the Code Llama group passed the test. The group that used Google? Every student passed.
“This is an important educational lesson,” said Klopfer. “Working hard and struggling is actually an important way of learning. When you’re given an answer, you’re not struggling and you’re not learning. And when you get more of a complex problem, it’s tedious to go back to the beginning of a large language model and troubleshoot it and integrate it.” In contrast, breaking the problem into components allows you to use an LLM to work on small aspects, as opposed to trying to use the model for an entire project, he says. “These skills, of how to break down the problem, are critical to learn.”
Read more of this story at Slashdot.