none reviewed yet · 4 benchmark observations · latest capture Sep 8, 2026
Inspect the evidenceQwen3.8-27B
Teams that need a self-hostable, screenshot-capable frontend model on their own hardware
Saved editorial fit for your current task lens; not a benchmark result
How scoring worksVerified rates (Sep 8, 2026) · 100 runs / month at your token settings
Adjust workloadAt a glance
9 facts- Provider
- Qwen
- Type
- API model
- Access
- Hugging Face weights; hosted `qwen3.8-27b` on Alibaba Cloud Model Studio
- Context
- 1,000,000 tokens
- Maximum output
- Recommended 262,144 reasoning + 131,072 final response at 1M configuration
- License / weights
- Open weights
- Input modalities
- text, image, video
- Output modalities
- text
- Pricing notes
- Hosted $0.50 in / $3.00 out per 1M (Singapore/international); $0.424/$1.696 in China (Beijing); a third-party comparison lists $0.425/$2.55; self-hosting has no token price
The practical trade-offs
Documented strengths
- Frontier-adjacent Arena frontend Elo (1601) from a 27-28B dense model
- Apache-2.0 licensing with no field-of-use restriction (per AA and third-party comparison)
- Vision2Web 62.9 plus OSWorld-Verified 84.3 and AndroidWorld 81.9 - unusually strong UI grounding for its size
- Realistically self-hostable on a single well-specified node
Limitations to check
- DeepSWE 1.1 42.2 shows a real gap to frontier models on long-horizon SWE work
- 43.9 tok/s output speed is slow
- The Hugging Face card does not state a licence - Apache 2.0 comes from secondary sources
- Effort setting swings its AA index from 26 to 41
Evidence & conditions
- Evidence source 1
huggingface.coDate not recorded - Evidence source 2
docs.qwencloud.comDate not recorded - Evidence source 3
alibabacloud.comDate not recorded - Evidence source 4
arena.aiDate not recorded - Evidence source 5
benchlm.aiDate not recorded - Evidence source 6
artificialanalysis.aiDate not recorded - Evidence source 7
digitalapplied.comDate not recorded
Benchmark observations
SWE-bench Pro (provider-corrected tasks) Inspect conditions
- name
- SWE-bench Pro (provider-corrected tasks)
- value
- 61.7
- unit
- %
- source Url
- https://huggingface.co/Qwen/Qwen3.8-27B
- checked At
- 2026-09-08T19:28:18Z
- attribution
- provider-reported
- configuration
- Qwen3.8-27B; Claude Code; temperature=1; top_p=0.95; 256K context; provider corrected problematic tasks and reran baselines.
DeepSWE v1.1 Inspect conditions
- name
- DeepSWE v1.1
- value
- 42.2
- unit
- %
- source Url
- https://huggingface.co/Qwen/Qwen3.8-27B
- checked At
- 2026-09-08T19:28:18Z
- attribution
- provider-reported
- configuration
- Qwen3.8-27B; Claude Code; temperature=1; top_p=0.95; 256K context.
NL2Repo Inspect conditions
- name
- NL2Repo
- value
- 42.3
- unit
- %
- source Url
- https://huggingface.co/Qwen/Qwen3.8-27B
- checked At
- 2026-09-08T19:28:18Z
- attribution
- provider-reported
- configuration
- Qwen3.8-27B; Claude Code; repository downloading via Bash disabled.
Arena WebDev Frontend Inspect conditions
- name
- Arena WebDev Frontend
- value
- 1601
- unit
- arena_score
- source Url
- https://arena.ai/leaderboard/code/webdev/frontend
- checked At
- 2026-09-08T19:28:18Z
- attribution
- benchmark-publisher
- configuration
- Exact row qwen3.8-27b; source results dated 2026-09-05; human preference; confidence interval +/-12; 2801 votes. This is a checked source snapshot, not a newly run September 8 evaluation.
Source reports, measured results, and editorial assessments are separate evidence types. Source dates do not imply a new benchmark run. Capture dates are shown when recorded; otherwise we say the capture date was not recorded. Recorded dates are compared with this catalogue snapshot (Sep 11, 2026), not today’s date.
How this page is assessed
Quality claims follow Method AIS-V2.
Money never buys rank — commercial relationships cannot change rank, eligibility, evidence quality, or publication timing.
Submit or claim a listing is free and does not skip the editorial queue.