Models › starcoder family

bigcode BigCode OpenRAIL-M out 4 years ago

15.8B parameters, text in, text out.

Verified 2026-10-25 Rank #604 in LLMs · score 74 method v1 Sources 3 Downloads 30d 2.7k · #572 of 619 tracked

Can I use it?BigCode OpenRAIL-MAttribution requiredlicence file2026-10-24
Do people use it?2.7kdownloads, 30 days#572 of 619 we track · below the median+0 likes, downloads −65% this week2,986 likesHugging Face2026-10-24

Worth reading

Picked by rule from 12 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Latest · 3 years ago

llama.cpp now supports StarCoder model series

llama.cpp now supports StarCoder model architectures, including 1B, 3B, 7B, and 15B variants.

  • The Metal backend previously outputted nan for the entire logits array before a soft_max kernel fix.
  • CUDA offloading is explicitly skipped in this implementation and left for the community to handle.
github.com 2023-09-18 6 HN pts · 1 comments 1k words

12 best of 12 tracked

The 4 picks above, plus these 8. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeRefact: Open-Source GitHub Copilot Alternative with LLama2, Starcoder, WizardLMgithub.com · 2023-07-27 · 6 HN pts
  2. ArticleStarCoder: A State-of-the-Art LLM for Codehuggingface.co · 2023-05-05 · 3 HN pts
  3. CodeStarCoder 2github.com · 2024-02-29 · 2 HN pts
  4. CodeStarCodergithub.com · 2023-05-04 · 3 HN pts
  5. ArticleTabby v0.1.1: Metal inference and StarCoder supportstabby.tabbyml.com · 2023-09-20 · 4 HN pts
  6. DiscussionGodot-Dodo – Finetuning starcoder on single-language instruction datatwitter.com · 2023-05-26 · 3 HN pts
  7. ArticleStarCoder open-access model for code generationservicenow.com · 2023-05-04
  8. DiscussionStarCoderPlus: Fine-tuned version of StarCoder on the Falcon model's datasettwitter.com · 2023-06-09

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 7 quantized builds and 100 Spaces.

  • As a service0no API provider listed
  • On own hardware7quantized builds
  • Built on7033 fine-tunes · 37 adapters · 0 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: bigcode/bigcode-playground ♥ 414 · KBaba7/Quant ♥ 51 · bigcode/search ♥ 40 · Yeyito/llm_contamination_detector ♥ 27

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 9.5 GB at INT4, 19 GB at FP8, 38 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 9.5 GB of weights (estimate; KV cache and activations extra)INT49.5 GBFP8: about 19 GB of weights (estimate; KV cache and activations extra)FP819 GBBF16: about 38 GB of weights (estimate; KV cache and activations extra)BF1638 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 9.5 GB of weights (estimate; KV cache and activations extra)INT49.5 GBFP8: about 19 GB of weights (estimate; KV cache and activations extra)FP819 GBBF16: about 38 GB of weights (estimate; KV cache and activations extra)BF1638 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

10 dated articles and 0 repo commits so far

Teal is the weights (2023-04-24), amber triangles are 10 dated articles (each links to it).

What people built on it

77 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

77 derivatives on the Hub, led by 37 adapters

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

7 quantized (Hugging Face model tree)33 fine-tunes (Hugging Face model tree)37 adapters (Hugging Face model tree)7 quantized33 fine-tunes37 adapters
7 quantized (Hugging Face model tree)33 fine-tunes (Hugging Face model tree)37 adapters (Hugging Face model tree)7 quantized33 fine-tunes37 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Use-case evidence

1 use case

What it is good at 1 use case

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

17 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesGPTBigCodeForCausalLM
Model typegpt_bigcode
Params by dtypeF32: 15,819,446,272
Size bandL
MoEno
Gatedauto
PapersarXiv:1911.02150, arXiv:2205.14135, arXiv:2207.14255, arXiv:2305.06161
LicenseBigCode OpenRAIL-M (bigcode-openrail-m)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · GPTBigCodeForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · GPTBigCodeForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for starcoder: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)38 GB · Single high-end GPU (<80 GB)
FP8 (1 byte/param)19 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)9.5 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: bigcode/starcoder 77 derivatives on the Hub

quantized: 7finetune: 33adapter: 37

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
mradermacher/starcoder-i1-GGUF quantized GGUF — — bigcode-openrail-m mradermacher 1 16.7k
mradermacher/starcoder-GGUF quantized GGUF — — bigcode-openrail-m mradermacher 2 12.5k
DevQuasar-9/bigcode.starcoder-GGUF quantized GGUF — — — DevQuasar-9 0 3.3k
jlpan/SteloCoder finetune — — — bigcode-openrail-m jlpan 1 2.3k
smangrul/peft-lora-starcoder15B-v2-personal-copilot-A100-40GB-colab adapter — — — bigcode-openrail-m smangrul 5 722
osukhoroslov-hw/starcoder-Q5_K_M-GGUF quantized GGUF — — bigcode-openrail-m osukhoroslov-hw 0 719
AdnanRiaz107/starcoder-Q4_K_M-GGUF quantized GGUF — — bigcode-openrail-m AdnanRiaz107 0 361
jlpan/starcoder-tune-cpp2py-program1 adapter — — — bigcode-openrail-m jlpan 0 235
jlpan/starcoder-csharp2py-program2 adapter — — — bigcode-openrail-m jlpan 1 154
szkelo/starcoderbase-3b-q8_0 quantized q8_0 — — bigcode-openrail-m szkelo 0 180
smangrul/peft-lora-starcoder15B-personal-copilot-A100-40GB-colab adapter — — — bigcode-openrail-m smangrul 0 158
KarthiAru/peft-lora-starcoder-personal-copilot-A100-40GB-colab adapter — — — bigcode-openrail-m KarthiAru 0 155
jlpan/starcoder-tune-cpp2py-program3 adapter — — — bigcode-openrail-m jlpan 0 149
Esperanto/starcoder-kvc-fp16-onnx quantized -fp16 — — — Esperanto 0 134
jlpan/starcoder-php2py-snippet1 adapter — — — bigcode-openrail-m jlpan 0 129
jlpan/starcoder-php2py-snippet2 adapter — — — bigcode-openrail-m jlpan 0 120
taylorbobaylor/peft-lora-starcoder15B-v2-personal-copilot-A100-40GB-colab adapter — — — bigcode-openrail-m taylorbobaylor 0 115
jlpan/starcoder-c2py-testprogram adapter — — — bigcode-openrail-m jlpan 0 110
stillerman/magic-starcoder adapter — — — bigcode-openrail-m stillerman 0 110
stillerman/starcoder-mathematica adapter — — — bigcode-openrail-m stillerman 1 57
jlpan/starcoder-js2py-snippet1 adapter — — — bigcode-openrail-m jlpan 0 106
jlpan/starcoder-java2py-program2 adapter — — — bigcode-openrail-m jlpan 0 100
jlpan/starcoder-js2py-snippet3 adapter — — — bigcode-openrail-m jlpan 0 96
terryyz/starcoder-codecot adapter — — — — terryyz 0 65
jlpan/starcoder-tune-cpp2py-program2 adapter — — — bigcode-openrail-m jlpan 0 62
jlpan/starcoder-js2py-program2 adapter — — — bigcode-openrail-m jlpan 0 56
htahir1/peft-lora-zencoder15B-personal-copilot adapter — — — bigcode-openrail-m htahir1 0 53
jlpan/starcoder-finetuned-code2code finetune — — — bigcode-openrail-m jlpan 1 0
jlpan/starcoder-csharp2py-program1 finetune — — — bigcode-openrail-m jlpan 1 0
jlpan/starcoder-csharp2py-snippet1 finetune — — — bigcode-openrail-m jlpan 1 0
jlpan/starcoder-csharp2py-snippet2 finetune — — — bigcode-openrail-m jlpan 1 0
jlpan/starcoder-php2py-program1 adapter — — — bigcode-openrail-m jlpan 0 44
rreit/starcoder-StaproCoder adapter — — — bigcode-openrail-m rreit 0 44
Diyer/peft-lora-starcoder15B-v2-personal-copilot-A100-40GB-colab adapter — — — — Diyer 0 37
update0909/peft-lora-starcoder15B-v2-personal-copilot-A100-40GB-colab-zyx adapter — — — bigcode-openrail-m update0909 0 34
Myrax3000/peft-lora-starcoder15B-personal-copilot-T4-colab adapter — — — — Myrax3000 0 33
update0909/peft-lora-starcoder15B-personal-copilot-A100-40GB-colab adapter — — — bigcode-openrail-m update0909 0 33
update0909/peft-lora-starcoder15B-personal-copilot-A100-40GB-colab-zyx adapter — — — bigcode-openrail-m update0909 0 33
sallywww/StarCoder_oneStep_FuzzTargets adapter — — — — sallywww 0 33
titanpark/peft-lora-starcoder15B-v2-personal-copilot-A100-40GB-colab adapter — — — — titanpark 0 30

Articles and coverage

12 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official2

huggingface.co2023-05-10authorityHN 5 pts · 1 comments4,985 words
BigCode released StarChat, a fine-tuned version of the 16B parameter StarCoder model trained on one trillion tokens from 80+ programming languages. The model features an 8,192 token context length and can be converted into a coding assistant by prompting it with dialogue examples or fine-tuning it on the OpenAssistant dataset, which contains over 40,000 human-generated conversations. This approach allows developers to create personalized assistants without the transparency issues found in proprietary systems like GitHub Copilot.written, reviewed, cited
  • StarCoder uses Multi Query Attention to enable fast large-batch inference.
  • The model was trained using the Fill-in-the-Middle objective on heavily deduplicated data.
  • Dialogue prompting incurs high costs because every conversation turn involves thousands of tokens.
huggingface.co2023-05-05authorityHN 3 pts · 0 comments969 words
StarCoder is a large language model for code trained on permissively licensed data from GitHub, including over 80 programming languages. The model was fine-tuned on 35B Python tokens to achieve a HumanEval score of 33.6, surpassing open models like CodeGen-16B-Mono. It operates under the BigCode OpenRAIL-M v1 license and is trained on a subset of The Stack 1.2.written, reviewed, cited
  • A specific prompt change increases the HumanEval score of StarCoder from 34% to over 40%.
  • The model fails to generate actual solutions without a specific prompt modification.
  • StarCoderBase outperforms existing open Code LLMs on popular programming benchmarks.

Analysis6

arxiv.org2023-05-15authorityHN front pageHN 317 pts · 162 comments406 words
StarCoder and StarCoderBase are 15.5B parameter models with 8K context length and infilling capabilities. StarCoderBase is trained on 1 trillion tokens from The Stack, while StarCoder is fine-tuned on 35B Python tokens to achieve 40% pass@1 on HumanEval. The models are publicly available under a more commercially viable version of the Open Responsible AI Model license.written, reviewed, cited
github.com2023-07-27authorityHN 6 pts · 1 comments80 words
github.com2024-02-29authorityHN 2 pts · 1 comments666 words
github.com2023-05-04authorityHN 3 pts · 0 comments955 words
github.com2023-10-01authorityHN 1 pts · 1 comments10,534 words
tabby.tabbyml.com2023-09-20HN 4 pts · 1 comments902 words

Community2

github.com2023-09-18authorityHN 6 pts · 1 comments1,009 words
llama.cpp now supports StarCoder model architectures, including 1B, 3B, 7B, and 15B variants. The implementation handles weight conversion to GGUF format and includes specific fixes for the Metal backend's soft_max kernels to resolve previous bugs. It sets head_count_kv to 1 and converts MQA to MHA for compatibility.written, reviewed, cited
  • The Metal backend previously outputted nan for the entire logits array before a soft_max kernel fix.
  • CUDA offloading is explicitly skipped in this implementation and left for the community to handle.
twitter.com2023-05-26HN 3 pts · 1 comments
All coverage tracked for this model (12) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
StarCoder 2github.com2024-02-292026-10-07hn
I got llama.cpp and StarCoder – 1B to run on my P4 Retro PCgithub.com2023-10-012026-10-07hn
Tabby v0.1.1: Metal inference and StarCoder supportstabby.tabbyml.com2023-09-202026-10-07hn
llama.cpp now supports StarCoder model seriesgithub.com2023-09-182026-10-07hn
Refact: Open-Source GitHub Copilot Alternative with LLama2, Starcoder, WizardLMgithub.com2023-07-272026-10-07hn
StarCoderPlus: Fine-tuned version of StarCoder on the Falcon model's datasettwitter.com2023-06-092026-10-07hn
Godot-Dodo – Finetuning starcoder on single-language instruction datatwitter.com2023-05-262026-10-07hn
StarCoder and StarCoderBase: 15.5B parameter models with 8K context lengtharxiv.org2023-05-152026-10-07hn
Creating a Coding Assistant with StarCoderhuggingface.co2023-05-102026-10-07hn
StarCoder: A State-of-the-Art LLM for Codehuggingface.co2023-05-052026-10-07hn
StarCodergithub.com2023-05-042026-10-07hn
StarCoder open-access model for code generationservicenow.com2023-05-042026-10-07hn

Papers

4 papers

Papers 4

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3-14B · 14.8B
    same size band (L), same task (text-generation), more providers, permissive license
  • phi-4 · 14.7B
    same size band (L), same task (text-generation), more providers, permissive license
  • DeepSeek-R1-Distill-Qwen-14B · 14.8B
    same size band (L), same task (text-generation), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:39 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:10 UTC · Last verified 2026-10-25

Follow starcoder

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.