Riiid’s AI Model Tops HuggingFace LLM Leaderboard

Riiid, a leading provider of AI-powered education solutions, has achieved a significant milestone with its latest generative AI model. The model, named ‘Sheep-duck-llama-2,’ has secured the top spot on the HuggingFace Open LLM Leaderboard, surpassing over 500 open-source generative AI models worldwide.

HuggingFace, a renowned platform for building and sharing machine learning models, evaluates and ranks these models based on their performance. Riiid’s previous model had secured the second position, but the new ‘Sheep-duck-llama-2’ model outperformed all others, scoring an impressive 74.07 points.

The ‘Sheep-duck-llama-2’ model is a fine-tuned version of llama-2-70b, specifically designed for text generation. Leveraging the HuggingFace Transformers library and utilizing datasets in the Orca-style and Alpaca-style formats, this model has been evaluated on various metrics, including ARC (25-shot), HellaSwag (10-shot), MMLU (5-shot), and TruthfulQA (0-shot).

Youngjun Jang, the CEO of Riiid, expressed his excitement about the achievement, stating, “As an AI technology company that extends beyond the education field, this first-place ranking showcases our LLM learning capabilities and tuning technology at the forefront of the world. We anticipate that our prompt engineering, refined through AI operations in education and learning, will synergize well with our fine-tuning technology.”

Riiid is a company dedicated to democratizing quality education globally. Collaborating with various education companies and schools, Riiid provides personalized learning experiences to students in more than 10 countries. The company recently signed an MOU to offer AI technology for public education in Brazil.

Riiid’s researchers continue to innovate by developing novel architectures and higher-performing AI models. They validate the learning impact using real-world data and publish their findings at international AI conferences.

For more information, please contact Heejung Shin at heejung.shin@riiid.co.

About Riiid:
Riiid is a leading provider of AI-powered education solutions. With a mission to democratize quality education worldwide, Riiid partners with education companies and schools to deliver personalized learning experiences to students across the globe. The company is committed to pushing the boundaries of AI technology in education and continuously improving learning outcomes.