Template JELAP Nisa
Template JELAP Nisa
Abstract
This study explores the experiences of Indonesian undergraduate students
using ChatGPT in their English as a Foreign Language (EFL) academic
writing classes. It begins by addressing the inherent challenges EFL
learners face in academic writing, such as difficulties with grammar,
coherence, and vocabulary. The research employs a qualitative
methodology, specifically narrative inquiry, to gather insights from
students through semi-structured interviews. The findings indicate that
students find ChatGPT to be a valuable resource that assists them in
various aspects of the writing process, including generating ideas,
structuring sentences, and correcting grammar. This support leads to
noticeable improvements in the quality of their writing, such as enhanced
clarity and vocabulary diversity. However, the study also identifies
several challenges, including inconsistencies in the responses generated
by ChatGPT, issues with the validity of the information provided, and
ethical concerns regarding plagiarism and originality. Overall, the thesis
emphasizes the importance of critical engagement with AI tools like
ChatGPT, suggesting that while they can significantly aid the writing
process, students must be cautious and informed about their use. The
research highlights the need for educators to provide clear guidelines on
the ethical implications of using AI in academic writing, ensuring that
students can maximize the benefits while minimizing potential drawbacks.
1*
Dwi Devi Khoirotun Nisa, email: anisdevi001gmail.com
Citation in APA style: Last Name, Initial of First Name. (Year). Title of article. Name of Journal,
Vol. Number(Issue Number), Beginning page-End page.
Received Month Date, Year; Revised Month Date, Year; Accepted Month Date, Year
DOI: xxxx.xxxx.xxxx
1. INTRODUCTION
Writing is regarded as one of the trickiest and most challenging tasks for
writers who are learning English as a Foreign Language (EFL), particularly when it
comes to academic writing (Dan et al., 2017; Tillema, 2012). This challenge results
from academic writing's complicated components, organizational structure, and
requirement for precise and sophisticated language use. This phenomenon is also
noted in the context of English language instruction in Indonesia. Writing essays and
other academic materials is a challenge for Indonesian language learners mainly
because they lack skill in syntax, syntactic structures, and vocabulary. Besides that,
there are further difficulties in preserving coherence in writing, creating efficient
rhetorical structure, and controlling interference from their first language (L1). To
counteract this challenge, several writing software can play a crucial role in
supporting EFL learners develop their writing capabilities. These digital tools often
have features like language and syntax checkers, word count increase
recommendations, and plagiarism detection. These features help students in
understanding and improving their writing (Roe et al., 2023).
Considering the state of technology today and the importance of language
learning in the development of student writing, a few digital tools that provide
interactive feedback via a computer have already emerged. One of the fastest-
growing technologies lately is artificial intelligence (AI) technology that has
cognitive abilities similar to human such as reasoning, meaning search,
generalization, and experiential learning (Anantrasirichai & Bull, 2021; Alharbi,
2023). Using AI capabilities has become a common trend in education, especially
among students and teachers of English as a Foreign Language (EFL). This
technological advancement significantly facilitates language acquisition, in writing
skills. It is enriched by the many AI-Based digital Writing Assistants emerging, such
as Quillbot, WordTune, Jenni, Chat-GPT, Paperpal, Copy.ai, and Essay Writer, each
contributing to improving writing processes and improving learning outcomes. Chat-
GPT, an advanced chatbot model rooted in the GPT framework created by OpenAI,
has attracted considerable interest in academic circles because of its capacity to
produce articulate and complex text quickly. This feature has enabled its
incorporation into diverse educational settings, where it functions as a potent
resource for enriching learning encounters (Holland, 2023).
For the past few years, several researchers have investigated the integration of
ChatGPT in the development of language learners’ writing skills (Marzuki’s et. al.,
2023; Sumakul et. al., 2022; Mahapatra, 2024; Yan 2022; Misra & Chandwar, 2023).
Despite that, as far as the researchers know, there are still very few studies that
explore the students’ experiences on using ChatGPT in EFL Academic writing
classes. To fill this gap, this study is conducted to explore Indonesian EFL
undergraduate students’ experiences on using ChatGPT in Academic Writing.
Through the exploration of Indonesian EFL Undergraduate students' experiences of
ChatGPT integration in academic writing, this study will provide valuable insights
into the potential impact of AI-assisted language learning on students' writing skills,
engagement, and overall academic performance. Further, this study will enrich
empirical body in this topic. By exploring students' experiences on using ChatGPT in
academic writing, this study aims to contribute to the optimization of AI-assisted
language learning tools, promoting more effective and engaging educational
experiences for EFL undergraduate students. Thus, the current study is therefore
trying to answer the following research question; “How are EFL undergraduate
students’ experiences on using ChatGPT for academic writing?”
2. LITERATURE REVIEW
2.1. AI in Education
Recently, there have been many studies investigating the use of AI in EFL
writing classes, especially ChatGPt. Found this recent research by Wang (2024)
discussing the use of ChatGPT to help L2 students with English academic writing
assignments, showing its benefits in improving efficiency and accuracy. Researchers
found ChatGPT valuable in English writing, and that using ChatGPT, either
independently or with teacher guidance, improved writing assignments and improved
educational outcomes. In other research it is also stated that EFL Learners find
ChatGPT useful in writing feedback, especially in correcting lexical and grammatical
errors, thus improving their writing skills (Mun, 2024). Besides that, using ChatGPT
makes them more aware of linguistic aspects and reduces their anxiety in writing in
English. In another hand, Bouzar et al. (2024) found graduate students who used
ChatGPT reported higher self-confidence in their academic writing skills as well as
increasing their writing self-efficacy. However, Yan (2022) explored 8
undergraduate students' perceptions of their experiences in using ChatGPT on
writing practice, the researcher found that the participants expressed concerns about
academic honesty and educational equity, highlighting the need for
reconceptualization of plagiarism and development of regulatory policies for its
appropriate utilization. Nguyen et al. (2024) also reported a negative correlation
between students' perceptions of ChatGPT use and their actual engagement with the
tool, where an increase in positive perceptions of ChatGPT was actually
accompanied by a decrease in engagement. These findings suggest that although
students have positive attitudes towards ChatGPT, their actual practices tend to vary
based on their perceptions.
3. METHODS
To obtain the necessary data on the students experiences on using ChatGPT for
Academic Writing, this study employs semi structure interviews (Barkhuizen et al.,
2014). According to Mackey and Gass (2016) interviews can explore phenomena
that cannot be observed directly. This method allowed us to collect qualitative data
about EFL students' use of ChatGPT in academic writing classes. As well as their
experiences on using ChatGPT for the purpose of Academic Writing. In paractice,
the interview is conducted several times via WhatsApp and face-to-face. All the
interview sessions are audio-recorded after gaining the permission of research
participants. During the interview, the participants are asked several questions based
on the interview guidelines adopted from previous research (Sumakul et al., 2022) as
follows: (1) how they used the AI (ChatGPT), (2) how the app helped them in their
writing, (3) the challenges they faced when using the app. Afterward, the interview
data will then be analized using thematic analysis.
3.4 Data Analysis Method
To analyze the verbal data, this study utilized thematic analysis. As explained
by Braun and Clarke (2006), the purpose of thematic analysis is to find patterns and
relationships between themes found in qualitative data, so that the researchers can
find answers to the research questions. The analysis process is divided into five
stages. In the first step, the researchers familiarize themselves with the data by
reading the interview data several times. In the second step, the researchers analyse
the data and give code to the data. Afterward, based on the repeated pattern, the
researcher will categorize the code to make a theme. The fourth step, the researchers
define the emerging theme by giving name to each theme and interpret them.
Finally, the researchers present the results of interpretation in this study.
3.5 Trustworthiness
The credibility of the data within this qualitative research employs two
methodologies that align with Lincoln and Guba's (1985) theoretical framework,
specifically the peer debriefing methodology (Janesick, 2015) and the member-
checking methodology (Murphey & Falout, 2010). To enhance the quality of data, its
credibility, and the validation process, we accomplish this by involving subject
matter experts in English Language Teaching (ELT) discussions pertinent to this
research dilemma, which constitutes a component of the peer debriefing
methodology, and we endeavor to engage participants in a more profound manner in
this investigation, following the member-checking protocol. In executing this, we
aim to construct arguments that adhere to ethical research standards and guarantee
that there is no detriment incurred by either party subsequent to the completion of
this research.
4.1 Finding
The data showed that respondent C used ChatGPT to formulate appropriate and
effective sentences according to the desired context. In addition, respondents also
used ChatGPT to improve sentences and grammar when writing, as using appropriate
language is very important in academic writing. In addition, respondents also used
ChatGPT as a source of advice on academic writing, asking for ideas on specific
topics so that they could find clearer direction in their writing. In this way, ChatGPT
serves as a tool that not only improves, but also inspires and provides new insights.
Overall, respondents indicated that ChatGPT has become an integral part of their
academic writing process.
Additionally, respondent C also explained typically use ChatGPT to support
academic writing tasks.
“ I think a very useful feature is in clarifying the intent and purpose of the
explanation of a material that we do not understand, so that we can easily
digest what the goals are aimed at.” (Participant B, Interview, 07 December
2024)
This shows that in academic writing, proper understanding of basic terms and
concepts is very important. With the help of ChatGPT, responden found it easier to
create sentences or paragraphs that conform to academic writing standards. This
represents ChatGPT's role as a tool that can assist users in formulating their ideas in
a more structured manner and in accordance with academic conventions.
Futhermore, Participant C mentioned that using ChatGPT Participant C
mentioned that using ChatGPT was helpful in creating articles and essays. This
implies that ChatGPT acts both as a collaborator in the writing process and as a tool
for understanding definitions. Because ChatGPT can help with writing articles and
essays, it can potentially provide more comprehensive support in various forms of
academic writing, such as developing ideas and constructing logical arguments.
“ I also find it helpful in the process of making articles, and essays too.”
(Participant C, Interview, 10 December 2024)
“ I think the chatgpt feature that really helps in my writing process is ... the
chatgpt feature that can provide several choices of ideas, as well as develop
these ideas so that it really helps me in completing my academic writing
assignments such as making essays.” (Participant D, Interview, 12 December
2024)
The purpose of this section is to determine how the use of ChatGPT affected
students' academic writing quality. Individual students' opinions on the influence of
ChatGPT on their writing process varied and reflected their unique learning styles
and backgrounds. Students' responses to questions about how ChatGPT affected the
quality of their writing focused on several elements, including writing structure,
vocabulary variety, sentence clarity, and research support. The following presents the
reported data describing the impact on students' writing quality :
“There are changes, for example, we are able to process words so that the
sentences we will convey are easier to understand, or we can also make it
easier to find words that are different but have the same meaning and
purpose.” (Participant B, Interview, 07 December 2024)
“Yes, I feel changes in my writing skills, the most I feel is that my writing is
more structured and systematised.” (Participant D, Interview, 12 December
2024)
Despite the many benefits that Chatgpt offers for students' academic writing,
there is no denying that its use also presents a number of challenges and difficulties.
In this context, it is important to understand the challenges that university students
face when using ChatGPT for academic writing tasks. This analysis examines the
various difficulties that can arise, including issues of data validity, plagiarism
detection, and language barriers, and how these challenges can impact the quality
and integrity of students' academic work.
“Yes, I found some difficulties when using chatgpt, sometimes the answers
given by Chatgpt do not match what we expect, cannot provide valid sources,
and the language used by chatgpt is sometimes not easy to understand”
(Participant D, Interview, 12 December 2024)
“In addition to the lack of valid data, language that is difficult to understand,
the feedback given is not appropriate even though I tried to change my
instructions to be more detailed for example but the feedback given remained
the same.” (Participant C, Interview, 10 December 2024)
Participant C added that in addition to issues with data validity, he also had difficulty
understanding the language used by ChatGPT. Despite attempts to provide more
detailed instructions, feedback remained unsatisfactory. This suggests that although
the author tries to communicate clearly, the tool does not always respond in the
expected manner.
“Besides that, I also found grammar mistakes and the vocabulary used was too
general so it was not suitable for academic writing.” (Participant C, Interview,
10 December 2024)
Participant C also noted grammatical errors and the use of overly generalized
vocabulary, which is not appropriate for the context of academic writing. This
highlights the challenge of ensuring that the language used in academic writing
meets the required standards.
The findings indicated that students' experiences with ChatGPT reveal a number of
significant challenges that university students face when using this academic writing
tool. Despite the potential benefits of increased efficiency and improved access to
information, students reported encountering several barriers that impede their writing
process. One of the main problems is the discrepancy between the answers generated
by ChatGPT and the expectations of students. Participants expressed frustration that
the answers provided did not meet their specific needs, leading to a lack of
confidence in the reliability of the tool.
Additionally, students highlighted the challenge of ChatGPT's inability to
provide valid and credible sources, which is essential for supporting arguments in
academic writing. This lack of reliable references can undermine the integrity of their
work and weaken their confidence in the information generated. Language
comprehension also proved to be a significant obstacle; Students found the language
used by ChatGPT difficult to understand and despite their efforts to provide detailed
instructions, feedback was often unsatisfactory. This suggests that the tool may not
interpret user requests effectively, resulting in responses that do not meet the clarity
and specificity required for academic writing.
Moreover,participants noted the presence of grammatical errors and the use of
overly generalized vocabulary in the answers, which is particularly problematic in an
academic context where precision and adherence to linguistic standards are crucial.
These issues can affect the professionalism and academic rigor of the writing.
Although ChatGPT offers numerous benefits overall, the challenges identified – such
as inconsistencies in answers, lack of valid sources, language barriers and
grammatical inaccuracies – highlight the need for students to approach the tool with
caution and mirror those expressed by Yan (2022), concerns about the need for a
reconceptualization of plagiarism in the context of AI-generated content. This
narrative highlights the importance of critical engagement with technology and the
need for students to complement its use with traditional research methods and their
own writing skills to ensure the quality and integrity of their academic work.
“Of course, due to the limitations of Chatgpt which cannot provide valid
sources, so I have to look for sources that match the information provided by
chatgpt. With the difficulties I face, I only use chatgpt for the beginning of the
writing process such as finding ideas or themes and mapping paragraphs.”
(Participant D, Interview, 12 December 2024)
“yes, as said earlier that the information provided is not valid, for example
chatgpt can provide references, even if it is fake citation so when I look for it, it
doesn't exist, so this is certainly a problem in writing ethics.” (Participant C,
Interview, 10 December 2024)
5. DISCUSSION
6. CONCLUSION
ACKNOWLEDGMENTS
REFERENCES