A new study highlights how GenAI feedback, specifically ERNIE Bot, enhances students' writing by offering instant, structured, and personalized insights—helping learners refine their language skills and navigate the complexities of academic writing with AI-powered support.
Research: Exploring the Affordances and Challenges of GenAI Feedback in L2 Writing Instruction: A Comparative Analysis With Peer Feedback. Image Credit: Jirsak / Shutterstock
A generative artificial intelligence (GenAI) tool named ERNIE Bot is valuable for students because it assists them in language corrections, generates ideas, evaluates content clarity, provides feedback on a draft's organization, changes the tone from informal to academic, and adds cohesive elements like discourse markers. Integrating GenAI tools into writing feedback processes may help provide information in a deep and personal manner for students and enhance its capability as a powerful educational tool in a supportive language learning environment.
In a study published online on January 22, 2025, in the journal ECNU Review of Education, a team of researchers from Huaihua University, Central South University, and the National University of Defense Technology (NUDT) examined the use of GenAI feedback among Chinese university students. Led by Professor Xuchuan Chen from NUDT, the study explored students' practices and perceptions of this technology.
For this study, 12 students were selected from a group of 200 students attending a 16-week English course at a mid-sized public university in China. Volunteers were selected to ensure a mix of different genders and varying levels of language proficiency. Throughout the course of the study, students were tasked with composing four distinct essays ranging from 300 to 500 words on topics designed to challenge various writing skills. After completing each essay, the students were asked to exchange their work for peer feedback. Subsequently, the students also sought GenAI feedback by submitting their original essays to the ERNIE Bot AI using suitable prompts. After receiving feedback from their peers and ERNIE Bot, the students were asked to make the necessary revisions to their writing.
The data for this study was collected from multiple sources, including the writing drafts of each participant, the reviews from peers, the chat logs with ERNIE Bot, and the semi-structured interviews. Each time, after receiving the reviews from the peers and the GenAI, the participant was interviewed for 20 to 30 minutes. The interview transcripts were used as the primary data source, which was then correlated with the other data sources. The data was then analyzed using both inductive and deductive thematic analysis.
The researchers were able to identify key advantages of GenAI feedback in technical, educational, and social aspects. They specifically highlighted the technological benefits, including the timeliness and personalization of feedback; the educational advantages, including its roles as both an essay editor and a responsive tutor; and the social benefits, including its ability to provide a supportive environment and an engaging process. Furthermore, the participating students highlighted the comprehensive educational function of GenAI feedback. They shared that their interactions with the GenAI provided them with greater learning opportunities to improve their grammar and vocabulary.
"Instead of prohibiting GenAI completely, teachers can seek methods to collaborate with these AI-driven tools and harness their benefits," suggests Researcher Prof. Mi Rong.
The researchers also reported that integrating these technologies in L2 writing learning has its own challenges. They revealed issues such as end users' limited AI skills, the risk of dependency that could hinder self-learning, and GenAI's limitations in understanding human emotions.
"Our findings suggest that peer review can still be used alongside GenAI feedback. As a valuable resource for providing feedback on emotional aspects of writing, peer review should be kept for providing feedback on emotional expression," Researcher Prof. Yudan Mi says.
In conclusion, the insights gained from this study may provide answers to the broader discussions on the viability of using GenAI in educational technology. The study may also provide practitioners and policymakers with valuable perspectives on leveraging GenAI's capabilities to enrich L2 writing outcomes while maintaining educational equity and empathy.
Source:
Journal reference: