Search
9 resources
-
Ziang Xiao, Susu Zhang, Vivian Lai|Oct 22nd, 2023|preprintZiang Xiao, Susu Zhang, Vivian LaiOct 22nd, 2023
We address a fundamental challenge in Natural Language Generation (NLG) model evaluation -- the design and evaluation of evaluation metrics. Recognizing the limitations of existing automatic metrics and noises from how current human evaluation was conducted, we propose MetricEval, a framework informed by measurement theory, the foundation of educational test design, for conceptualizing and evaluating the reliability and validity of NLG evaluation metrics. The framework formalizes the source...
-
Igor Nowacki|Oct 19th, 2023|blogPostIgor NowackiOct 19th, 2023
Stanford University and Research Institutions Release Model Transparency Index TS2 SPACE
-
Jun Ho Choi, Oliver Garrod, Paul Atherto...|Oct 4th, 2023|preprintJun Ho Choi, Oliver Garrod, Paul Atherto...Oct 4th, 2023
Education systems in developing countries have few resources to serve large, poor populations. How might generative AI integrate into classrooms? This paper introduces an AI chatbot designed to assist teachers in Sierra Leone with professional development to improve their instruction. We describe initial findings from early implementation across 122 schools and 193 teachers, and analyze its use with qualitative observations and by analyzing queries. Teachers use the system for lesson...
-
Weixin Liang, Mert Yuksekgonul, Yining M...|Jul 10th, 2023|preprintWeixin Liang, Mert Yuksekgonul, Yining M...Jul 10th, 2023
The rapid adoption of generative language models has brought about substantial advancements in digital communication, while simultaneously raising concerns regarding the potential misuse of AI-generated content. Although numerous detection methods have been proposed to differentiate between AI and human-generated content, the fairness and robustness of these detectors remain underexplored. In this study, we evaluate the performance of several widely-used GPT detectors using writing samples...
-
Katie Bainbridge, Candace Walkington, Ar...|Jul 7th, 2023|conferencePaperKatie Bainbridge, Candace Walkington, Ar...Jul 7th, 2023
-
TED|May 1st, 2023|videoRecordingTEDMay 1st, 2023
Sal Khan, the founder and CEO of Khan Academy, thinks artificial intelligence could spark the greatest positive transformation education has ever seen. He shares the opportunities he sees for students and educators to collaborate with AI tools -- including the potential of a personal AI tutor for every student and an AI teaching assistant for every teacher -- and demos some exciting new features for their educational chatbot, Khanmigo. If you love watching TED Talks like this one, become a...
-
Department of Education|May 14th, 2023|reportDepartment of EducationMay 14th, 2023
-
Partha Pratim Ray|Jan 1st, 2023|journalArticlePartha Pratim RayJan 1st, 2023
In recent years, artificial intelligence (AI) and machine learning have been transforming the landscape of scientific research. Out of which, the chatbot technology has experienced tremendous advancements in recent years, especially with ChatGPT emerging as a notable AI language model. This comprehensive review delves into the background, applications, key challenges, and future directions of ChatGPT. We begin by exploring its origins, development, and underlying technology, before examining...
-
Fengchun Miao, Wayne Holmes|Mar 14th, 2023|bookFengchun Miao, Wayne HolmesMar 14th, 2023