IBM
Granite 4.2 3B Instruct开源
IBM Granite 4.2 3B compact SLM optimized for on-device and low-latency inference.
智商指数
42.0 #435
AAQI 36.0
输出速度
148 t/s
TTFT 160 ms · ITL 6.8 ms/tok
混合价格 (3:1)
$0.11 /1M
输入 $0.08/M · 输出 $0.2/M
上下文
128K
≈ 320 页 A4 · 最大输出 8,192
Quality Domain Radar
6-Axis Frontier Evaluation vs Category Average & Flagship
Granite 4.2 3B Instruct
Claude Mythos Preview (#1)
Average (68)
缺少直接基准测量时,雷达图各轴由类别得分近似得出 — 详见 评分方法。
优势与取舍
优势所在
- Open weights — self-host, fine-tune and audit with no vendor lock-in
- 148 tok/s output — fast enough for real-time agents
- Sub-200ms time-to-first-token
- Very low blended price — $0.11/1M mixed tokens
杀手级用例
Real-time agents
Low-latency loops for voice, gaming and interactive copilots.
High-volume batch jobs
Classification, extraction and summarization at minimal cost per call.
On-prem deployment
Air-gapped and regulated-environment serving on your own hardware.
开发者快速上手与 API
请先设置
HF_TOKEN — 获取 API 密钥curl https://router.huggingface.co/v1/chat/completions \
-H "Authorization: Bearer $HF_TOKEN" \
-H "content-type: application/json" \
-d '{
"model": "granite-4-2-3b",
"messages": [{"role": "user", "content": "Refactor this function for O(n) time and explain the change."}]
}'import os
from openai import OpenAI
client = OpenAI(
base_url="https://router.huggingface.co/v1",
api_key=os.environ["HF_TOKEN"],
)
resp = client.chat.completions.create(
model="granite-4-2-3b",
messages=[{"role": "user", "content": "Refactor this function for O(n) time and explain the change."}],
)
print(resp.choices[0].message.content)const res = await fetch("https://router.huggingface.co/v1/chat/completions", {
method: "POST",
headers: {
Authorization: `Bearer ${process.env.HF_TOKEN}`,
"content-type": "application/json",
},
body: JSON.stringify({
model: "granite-4-2-3b",
messages: [{ role: "user", content: "Refactor this function for O(n) time and explain the change." }],
}),
});
console.log((await res.json()).choices[0].message.content);官方资源与链接
API 部署
对比托管商与延迟
Groq、Cerebras、Together、DeepInfra、Fireworks、Bedrock 与 Azure 的吞吐量、TTFT 和缓存定价。
GroqCerebrasTogether AIDeepInfraFireworks AIAWS BedrockAzure AI
各榜单得分
分类能力得分
基准测试分项
实时规格与架构
底层解析
Dense · 3 billion
- Prompt caching supported — cached input reads at $0.01/1M tokens.
发布日期
2026年7月20日
架构
Dense · 3 billion
参数量
3 billion
开源协议
Open Weights
上下文窗口
128,000 tokens
最大输出
8,192 tokens
模态
text
缓存价格
读 $0.01 · 写 $0.1 /1M
推理
—
输入价格
$0.08/M
输出价格
$0.2/M
输出速度
148 t/s
首Token延迟
160 ms
数据更新
2026年8月28日
每月账单预估
每月预估支出
$0.00
正在计算相对 GPT-4o 的节省额…
引用与嵌入
GitHub Markdown 徽章
Loading badge markdown...BibTeX
@misc{llmpodium2026granite423b,
title = {Benchmark Analysis and Intelligence Evaluation of Granite 4.2 3B Instruct},
author = {LLMPodium Research},
year = {2026},
url = {https://llmpodium.com/models/granite-4-2-3b}
}嵌入评分徽章
将实时 Podium 评分徽章添加到 GitHub 或 Hugging Face README —— 链接回实时排名。
预览
Markdown
Loading badge snippet...HTML
Loading badge snippet...更多 IBM 模型
替代模型推荐
基于能力、定价和基准测试得分与 Granite 4.2 3B Instruct 最接近的替代模型。