Evidence in this edition7 source links

none reviewed yet · 4 benchmark observations · latest capture Sep 8, 2026

Inspect the evidence
Task fit75.5/100

Saved editorial fit for your current task lens; not a benchmark result

How scoring works
Cost at your workload$110.00

Verified rates (Sep 8, 2026) · 100 runs / month at your token settings

Adjust workload

At a glance

9 facts
Provider
Qwen
Type
API model
Access
Hugging Face weights; hosted `qwen3.8-27b` on Alibaba Cloud Model Studio
Context
1,000,000 tokens
Maximum output
Recommended 262,144 reasoning + 131,072 final response at 1M configuration
License / weights
Open weights
Input modalities
text, image, video
Output modalities
text
Pricing notes
Hosted $0.50 in / $3.00 out per 1M (Singapore/international); $0.424/$1.696 in China (Beijing); a third-party comparison lists $0.425/$2.55; self-hosting has no token price

The practical trade-offs

Documented strengths

  • Frontier-adjacent Arena frontend Elo (1601) from a 27-28B dense model
  • Apache-2.0 licensing with no field-of-use restriction (per AA and third-party comparison)
  • Vision2Web 62.9 plus OSWorld-Verified 84.3 and AndroidWorld 81.9 - unusually strong UI grounding for its size
  • Realistically self-hostable on a single well-specified node

Limitations to check

  • DeepSWE 1.1 42.2 shows a real gap to frontier models on long-horizon SWE work
  • 43.9 tok/s output speed is slow
  • The Hugging Face card does not state a licence - Apache 2.0 comes from secondary sources
  • Effort setting swings its AA index from 26 to 41
Follow the source

Evidence & conditions

7 source links
7Source links
NoneReviewed records
4Benchmark runs
Sep 8, 2026Latest capture

Benchmark observations

SWE-bench Pro (provider-corrected tasks) Inspect conditions
name
SWE-bench Pro (provider-corrected tasks)
value
61.7
unit
%
source Url
https://huggingface.co/Qwen/Qwen3.8-27B
checked At
2026-09-08T19:28:18Z
attribution
provider-reported
configuration
Qwen3.8-27B; Claude Code; temperature=1; top_p=0.95; 256K context; provider corrected problematic tasks and reran baselines.
DeepSWE v1.1 Inspect conditions
name
DeepSWE v1.1
value
42.2
unit
%
source Url
https://huggingface.co/Qwen/Qwen3.8-27B
checked At
2026-09-08T19:28:18Z
attribution
provider-reported
configuration
Qwen3.8-27B; Claude Code; temperature=1; top_p=0.95; 256K context.
NL2Repo Inspect conditions
name
NL2Repo
value
42.3
unit
%
source Url
https://huggingface.co/Qwen/Qwen3.8-27B
checked At
2026-09-08T19:28:18Z
attribution
provider-reported
configuration
Qwen3.8-27B; Claude Code; repository downloading via Bash disabled.
Arena WebDev Frontend Inspect conditions
name
Arena WebDev Frontend
value
1601
unit
arena_score
source Url
https://arena.ai/leaderboard/code/webdev/frontend
checked At
2026-09-08T19:28:18Z
attribution
benchmark-publisher
configuration
Exact row qwen3.8-27b; source results dated 2026-09-05; human preference; confidence interval +/-12; 2801 votes. This is a checked source snapshot, not a newly run September 8 evaluation.

Source reports, measured results, and editorial assessments are separate evidence types. Source dates do not imply a new benchmark run. Capture dates are shown when recorded; otherwise we say the capture date was not recorded. Recorded dates are compared with this catalogue snapshot (Sep 11, 2026), not today’s date.

Method AIS-V2

How this page is assessed

Quality claims follow Method AIS-V2.

Money never buys rank — commercial relationships cannot change rank, eligibility, evidence quality, or publication timing.

Submit or claim a listing is free and does not skip the editorial queue.

Private · this device only

Your research note

Saved on this device. Included only in private backups.