We’'e beyond excited to ship the very first beta of @github/models, a provider (and soon much more) for AI SDK that brings the full GitHub Models catalog to any TypeScript or JavaScript project.

Why this matters

🚀 Usage-based billing
Get started for free! Once you love it, burst past the free usage and just pay for what you use. No confusing quotas, no surprise throttling.
🎯 Zero-friction setup
Your existing GitHub PAT is your API key! No extra dashboards or keys to juggle.
⛰️ Native to your SDLC
Works everywhere you already work: Actions, Codespaces, local dev, CI, anywhere GITHUB_TOKEN is available.

⚡️Quick Start

npm i @github/models

import {githubModels} from '@github/models'
import {generateText} from 'ai'

const result = await generateText({
  model: githubModels('meta/meta-llama-3.1-8b-instruct'),
  prompt: 'Write a haiku about programming.',
})

console.log(result.text)

That's it. One import, one token, infinite possibilities.

Find out more: 📚 https://docs.github.com/en/github-models

🔑 Few ideas to help excite your mind

1. Release Notes Auto-Drafter On merge to main, Models digests the day's merged PRs into a changelog and open a ready-to-publish draft GitHub Release.
2. Community Support Request Triage Bot An action that runs daily to flag Discussion posts that look like actionable bugs, checks for repro details, and files a fully-formed issue for the team.
3. Smart Issue Parent Matcher At issue creation, each new issue deeply understood and automatically linked to the right tracking issue.

We can't wait to see what you build, tell us about your projects and let us know how we can make GitHub Models even better.

Happy hacking! - The GitHub Models Team