Our Research
Our research focuses on developing highly accurate and reliable models that deeply understand context.
![featured-image](https://contextual.ai/wp-content/themes/contextualai/images/featured-square.png)
![featured-image](https://contextual.ai/wp-content/themes/contextualai/images/eye-icon.png)
Introducing OLMoE: A small, fully open, and state-of-the-art mixture-of-experts LLM
September 4, 2024
![featured-image](https://contextual.ai/wp-content/themes/contextualai/images/eye-icon.png)
Introducing OLMoE: A small, fully open, and state-of-the-art mixture-of-experts LLM
September 4, 2024
All Research
Introducing OLMoE: A small, fully open, and state-of-the-art mixture-of-experts LLM
September 4, 2024 ![arrow](https://contextual.ai/wp-content/themes/contextualai/images/arrow-link.png)
![arrow](https://contextual.ai/wp-content/themes/contextualai/images/arrow-link.png)
Addressing Underspecification in Language Model Alignment
August 13, 2024 ![arrow](https://contextual.ai/wp-content/themes/contextualai/images/arrow-link.png)
![arrow](https://contextual.ai/wp-content/themes/contextualai/images/arrow-link.png)
Introducing RAG 2.0
March 19, 2024 ![arrow](https://contextual.ai/wp-content/themes/contextualai/images/arrow-link.png)
![arrow](https://contextual.ai/wp-content/themes/contextualai/images/arrow-link.png)
Training with GRIT for better LLMs and faster RAG
February 15, 2024 ![arrow](https://contextual.ai/wp-content/themes/contextualai/images/arrow-link.png)
![arrow](https://contextual.ai/wp-content/themes/contextualai/images/arrow-link.png)
Better, Cheaper, Faster LLM Alignment with KTO
December 7, 2023 ![arrow](https://contextual.ai/wp-content/themes/contextualai/images/arrow-link.png)
![arrow](https://contextual.ai/wp-content/themes/contextualai/images/arrow-link.png)
Vision Augmented Language Models: Computer vision through the LENS of natural language
June 27, 2023 ![arrow](https://contextual.ai/wp-content/themes/contextualai/images/arrow-link.png)
![arrow](https://contextual.ai/wp-content/themes/contextualai/images/arrow-link.png)