Riiid Expands its NLP Capabilities, Presenting Innovative AI Models at the World's Leading NLP Conferences
![Riiid Expands its NLP Capabilities, Presenting Innovative AI Models at the World's Leading NLP Conferences](https://media.asiaone.com/sites/default/files/styles/article_top_image/public/original_images/May2022/1_47.jpg?itok=ttkLr-tQ)
Two studies to be presented at ACL and NAACL–held on May and July 2022 respectively
SAN RAMON, Calif., May 16, 2022 /PRNewswire/ -- Riiid, a leading AI Education solutions company and a member of Born2global Centre, today announced two of its new AI research studies that will be presented at the upcoming Association for Computational Linguistics (ACL) and the North American Chapter of the Association for Computational Linguistics (NAACL), the world's leading Natural Language Processing (NLP) conferences. With this ground-breaking research, the company will continue to extend its AI capabilities with NLP technology to build extensive new educational content-aware AI models.
Paper accepted at NAACL 2022, ‘GRAM: Fast Fine-tuning of Pre-trained Language Models for Content-based Collaborative Filtering’
At ACL, Riiid will present 'Dialogue Summaries as Dialogue States (DS2), Template-Guided Summarization for Few-shot Dialogue State Tracking', focusing primarily on creating dialogue systems like Chatbots that can deliver meaningful results even with a limited amount of labeled and structured dialogue data by leveraging very large language models. By using only 1% of the training data, Riiid's new method was able to achieve 66% of the full data performance, whereas other approaches achieved less than 60%.
"Dialogue State Tracking (DST) is an essential element of task-oriented dialogue systems but is infamous for the expensive and difficult data collection process," said Jay Shin, AI Research Scientist at Riiid, who led the study. "Our study proposes a new method to reformulate DST into dialogue summarization, to minimize the pre-train and fine-tune discrepancies that typically occur"
Riiid researchers provided rule-based summary templates from dialogue states and guided the summarization to conform to these templates. Applying heuristic dialogue state extraction from the generated summaries, researchers were able to create the strongest DST model in the limited label scenario that uses only 1% of training data. "This study can be extended as the proof-of-concept that Riiid can develop new educational features such as AI Tutors with chatting capabilities at a much lower cost with much higher efficiency and accuracy," said Shin.
Riiid's second study, to be shared at NAACL as an oral presentation, introduces an efficient training algorithm 'GRAM (GRadient Accumulation for Multimodality)' for incorporating content information in Knowledge Tracing (KT).
"Content-based KT can potentially offer personalized item recommendations to users, but its exponential training time has hindered its usage in the industries," said Yoonseok Yang, AI Research Scientist at Riiid, leader of the study. "In this research, we accelerated the training speed up to 150 times while maintaining state-of-the-art KT performance. In addition, GRAM is especially powerful for newly-added questions that have no interaction history, showing a dramatic accuracy improvement of 40% in cold start predictions compared to the previous models."
GRAM will be deployed in the A/B testing platform in Santa, the company's own English proficiency test (TOEIC) prep solution that is the best-selling AI-based smartphone application in Japan and Korea. With 300 new questions added to Santa every month, the company expects its latest model to provide new levels of personalized learning experience for users.
"The impact of this work is not limited to improving the model performance in Santa," said Yang. "With this technology, Riiid can easily provide high-quality cross-domain KT models, which will open our doors to countless domains with small or no interaction data. Basically, we can apply TOEIC KT models directly for similar domains like GTELP, TOEFL, or even SAT without interactions data from these new domains."
"The two studies are remarkable as academic research but also in demonstrating how our lab breakthroughs help remove some of the most common limitations of AI for education," said YJ Jang, CEO of Riiid. "The ultimate goal of Riiid's research is to find how technology can help to solve practical problems in education and bring more value to actual learners. We will continue to expand the field of research and change the landscape of the education industry in the direction that can best help improve everyone's learning experience."
Riiid has been active in publishing academic works at top global conferences since 2016. Based on its proprietary AI technology and the world's largest data collection set in AI education, the company has published more than 16 papers in leading AI and education technology conferences such as Neural Information Processing Systems (NeurIPS) and Association for the Advancement of Artificial Intelligence (AAAI).
About Born2Global Centre
Born2Global Centre is a full-cycle service platform for global expansion. Since its inception in 2013, Born2Global has been setting the standard for a successful startup ecosystem as the main Korean government agency under the Ministry of Science and ICT. Born2Global has expanded and transformed startups to be engaged, equipped and connected with the global market.
For more information, visit born2global.com
About Riiid
Riiid is a leading pioneer in AI solutions for education, named in the 2021 CB Insights AI 100 list of the most innovative AI startups. It is backed by $250 million (USD) in funding with the latest from Vision Fund 2. Leveraging the power of AI, the company practically delivers personalized instruction for all students with the aim of democratizing quality education anywhere in the world. Riiid's proprietary AI technology, based on novel deep learning algorithms, analyzes user data and content, predicts scores and behavior, and recommends personalized learning items in real-time to help users unleash their learning potential. As a leading force in AI technology, Riiid has published research papers at top AI conferences including NeurIPS and AAAI. Riiid's technology is content-agnostic, highly scalable, and thus applicable to a wide range of domains.
In this pandemic era, education, which is a critical building block for a healthy society, has been facing an inflection point where traditional systems have failed and new approaches are desperately desired. Riiid fills the void with the only verified AIEd technology and business. The company provides solutions for K-12 education, postsecondary education, and corporate training.
For more information, visit riiid.com
Contact at Riiid: Yunyoung Noh
yunyoung.noh@riiid.co
Born2Global Centre:
info@born2global.com