Language, technology, and personal dreams intersect powerfully in the story of Burak Senel, a PhD student at Iowa State University. His academic focus is applied linguistics and technology, a discipline that aligns with his professional aspirations and intellectual interests. Senel is from Turkey and moved to the U.S. recently for his studies.
From June to August 2024, Senel undertook a rigorous three-month internship at Michigan Language Assessment, culminating in an extensive 85-page white paper on automated scoring system validation. His work in automated scoring of writing not only earned him significant recognition as the Best Student Paper Award from the Midwest Association of Language Testers (MwALT), but also marked a notable contribution to the field of language assessment.
Motivation for Studying Language Assessment
Senel’s interest in language assessment has a deeply personal origin. Recounting his experience, he shares, “I was back in Turkey teaching English, and when I decided to pursue my master’s in the U.S., I had to take the TOEFL exam. That experience opened my eyes to how critical these exams are in helping individuals like me realize their dreams.”
This realization fueled his desire to improve the test-taker experience and contribute to the broader field of language assessment.
Why Automated Scoring?
Automated scoring was a natural focus for Senel’s internship, given the ongoing research and advancements within Michigan Language Assessment.
“Michigan Language Assessment has a flow of brilliant minds, and automated scoring is a topic of significant interest,” he said. “My previous work in this area allowed me to contribute meaningfully.”
Senel’s prior engagement with experts from various organizations, including Duolingo, further enriched his understanding and inspired his contributions to Michigan Language Assessment’s research efforts.
Recognized Research Excellence
Senel’s dedication and contributions did not go unnoticed. He received the Best Student Paper Award from MwALT, an honor that underscores his outstanding research in language testing.
“It was an honor and a bit unexpected,” Senel admits. “Submitting your work for judgment always comes with the anticipation of a ‘no,’ but receiving this recognition was incredibly validating.”
Senel joins a strong group from Iowa State University who have also won the same award, including Reza Neiriz, PhD, and Haeun Kim, PhD, also a past intern at MLA–both of whom are now highly respected experts in the field.
Demystifying Automated Scoring
The concept of automated scoring often evokes skepticism among test-takers who fear that a computer might lack the discernment of a human evaluator. Senel’s research, however, supports the efficacy of automated systems.
“Machines can mimic expert human raters and sometimes perform better in aspects like consistency and fatigue resistance,” he explained.
His work specifically utilized corpus linguistics – a method of studying language that involves analyzing large collections of written and spoken texts – to identify features of proficient writing that could enhance automated scoring accuracy and validity.
One of the compelling aspects of Senel’s research was his exploration of how second language writers with varying English proficiencies used formulaic language in their written responses. For instance, “I agree with the statement that” would be formulaic language in argumentative essays because a lot of test-takers use it in their written responses, as opposed to non-formulaic, more creative language that might not be as commonly found across essays..
“My research contributes to two important conversations the field of language assessment is having at the moment,” he said. “First, how can we make use of corpus linguistics in the field, and second, how can we include more of the features of writing we’re assessing the populations we serve. My research highlights potential areas for future research and improvement.”
While optimistic about his research’s potential impact, Senel maintains a cautious approach.
“I plan to publish my study and am eager for other scientists to replicate or try my methodology in their assessment contexts. Their results will be crucial in determining the broader implications of my findings,” he said, emphasizing the importance of ongoing scrutiny and corroboration in the scientific community.
Internship Experience at Michigan Language Assessment
Senel’s time at Michigan Language Assessment was marked by a friendly and enriching environment.
“The team at Michigan Language Assessment, including Mika Hoffman, director of Assessment, and Tahnee Bucher, Assessment Innovation and Alignment manager, were incredibly supportive and knowledgeable. Their guidance and the inclusive team culture significantly enhanced my experience.”
Senel’s integration into the team extended beyond work, epitomized by team outings and social activities with other teams across the organization that fostered a sense of belonging.
Senel’s journey exemplifies the power of blending personal ambition and academic rigor. His work with Michigan Language Assessment not only advances the field of language assessment but also supports the broader goal of helping individuals achieve their dreams. As Senel continues his academic journey, his contributions are set to have lasting implications for the future of automated scoring and language assessment.