Language models

Models trained to predict or generate sequences of text tokens.

Language models can power chat, coding and other applications. A training toolkit, an inference engine and a chat interface play different roles.

Projects connected to this idea

Minimal code for training and fine-tuning GPT-style language models.

Project notesLearn MLCode library

Explore language-model training through a compact C and CUDA implementation.

Project notesLearn MLC / CUDA code

Use pretrained models through a shared library and model ecosystem.

Project notesBuild appsPython library

A web interface for working with locally run or connected language models.

Project notesLocal AISelf-hosted web app

Connect models, data and tools in language-model applications.

Project notesBuild appsCode framework

A compact toolkit spanning language-model training, evaluation and inference.

Project notesLearn MLTraining toolkit