MODEL COMPARISON & BENCHMARKS

Kimi, DeepSeek, GLM, or Qwen?

Inspect historical output, usage, and latency from four models on similar frontend tasks. Prompts, output limits, and run dates differ, so these samples do not establish a controlled performance or value ranking.

Animation samples updated on 2026-10-18 (DeepSeek uses the Pelican leaderboard record; the other three are 2026-10-04 production API runs).

Marketing claims are not a substitute for a real request. This page shows retained HTML, visual results, and available historical usage with evidence gaps disclosed. The animation overview is not each run's original prompt; Kimi's layout fix is labeled.

DETAILED COMPARISONS

Compare specific models side by side

Explore current API prices and limits, with historical measurements where available.

Qwen4 Max vs Qwen3.8 Max

Compare catalog prices, context windows, and output limits. No same-case performance results are available for Qwen4 Max.

01 / FOCUS

What we watch for each model

K

Kimi

Chinese writing, context retention, and fast small-page generation.

Chinese contextContext retentionGeneration speed
D

DeepSeek

Reasoning, code structure, and animation completeness.

ReasoningCodingPage completeness
G

GLM

Chinese workflows, structured output, and long reasoning requests.

Chinese tasksStructured outputReasoning time
Q

Qwen

Multilingual, coding, and visual scene generation together.

MultilingualCode and toolsVisual structure
02 / MATRIX

What to inspect in each sample

Use these dimensions to read historical samples. Constraints and metric sources differ; missing data is not reconstructed, and costs are not current quotes.

DimensionWhat we recordWhy it matters
Visual completenessCharacter, bicycle, motion, and depthWhether the page is usable as delivered
Code constraintsSingle file, inline resources, responsive CSSWhether it can be embedded safely
Output usageInput / output tokens and CNY costWhether reasoning spend is controllable
SpeedTime to first token and full responseInteraction and automation wait time
03 / HISTORICAL ANIMATION SAMPLES

Historical animation samples from four models

These pelican bicycle samples used different prompts, output limits, and run dates. The carousel shows retained HTML and available metrics for inspecting output details, without establishing a controlled performance or value ranking.

Real HTML previewdeepseek-flash
d

deepseek-flash

Pelican leaderboard record for deepseek-flash from api.deepseek.com: 5.0/5 stars and 20.00s generation time. Token and cost fields were not provided by the leaderboard.

5.0/5 leaderboard
Input tokens—
Output tokens—
Recorded cost—
Total time20.00s
Recorded score5.0/5
Real HTMLdeepseek-flash
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>Pelican Riding a Bicycle</title>
<style>
  * { margin: 0; padding: 0; box-sizing: border-box; }
  html, body {
    width: 100%;
    overflow-x: hidden;
    background: #cfe9f2;
    font-family: system-ui, sans-serif;
  }
  .scene-wrap {
    width: 100%;
    max-width: 1100px;
    margin: 0 auto;
    padding: 0;
    display: block;
  }
  svg.scene {
    display: block;
    width: 100%;
    height: auto;
    overflow: hidden;
  }

  /* ---------- wheel spin ---------- */
  @keyframes spin {
    from { transform: rotate(0deg); }
    to   { transform: rotate(360deg); }
  }
  .wheel-spin {
    transform-box: fill-box;
    transform-origin: center;
    animation: spin 1.4s linear infinite;
  }

  /* ---------- crank / pedal orbit ---------- */
  @keyframes crank {
    from { transform: rotate(0deg); }
    to   { transform: rotate(360deg); }
  }
  .crank {
    transform-box: fill-box;
    transform-origin: center;
    animation: crank 1.4s linear infinite;
  }

  /* ---------- body bob ---------- */
  @keyframes bob {
    0%, 100% { transform: translateY(0); }
    50%      { transform: translateY(-3.5px); }
  }
  .bob {
    transform-box: fill-box;
    transform-origin: center;
    animation: bob 0.7s ease-in-out infinite;
  }

  /* ---------- wing flap ---------- */
  @keyframes flap {
    0%, 100% { transform: rotate(-4deg); }
    50%      { transform: rotate(12deg); }
  }
  .wing {
    transform-box: fill-box;
    transform-origin: 70% 20%;
    animation: flap 0.7s ease-in-out infinite;
  }

  /* ---------- legs pump ---------- */
  @keyframes legPumpA {
    0%, 100% { transform: rotate(18deg); }
    50%      { transform: rotate(-18deg); }
  }
  @keyframes legPumpB {
    0%, 100% { transform: rotate(-18deg); }
    50%      { transform: rotate(18deg); }
  }
  .legA {
    transform-box: fill-box;
    transform-origin: top center;
    animation: legPumpA 1.4s ease-in-out infinite;
  }
  .legB {
    transform-box: fill-box;
    transform-origin: top center;
    animation: legPumpB 1.4s ease-in-out infinite;
  }

  /* ---------- cloud drift ---------- */
  @keyframes drift {
    from { transform: translateX(0); }
    to   { transform: translateX(60px); }
  }
  .cloud-1 { animation: drift 26s ease-in-out infinite alternate; }
  .cloud-2 { animation: drift 34s ease-in-out infinite alternate-reverse; }
  .cloud-3 { animation: drift 20s ease-in-out infinite alternate; }

  /* ---------- road dashed line scroll ---------- */
  @keyframes roadDash {
    from { stroke-dashoffset: 0; }
    to   { stroke-dashoffset: -80; }
  }
  .road-dash {
    animation: roadDash 1.4s linear infinite;
  }

  /* ---------- subtle sun pulse ---------- */
  @keyframes sunGlow {
    0%, 100% { opacity: 0.85; }
    50%      { opacity: 1; }
  }
  .sun-glow { animation: sunGlow 5s ease-in-out infinite; }

  /* hide extra foreground below 480px */
  @media (max-width: 480px) {
    .fg-extra { display: none; }
  }
</style>
</head>
<body>
<div class="scene-wrap">
<svg class="scene" viewBox="0 0 1000 640" xmlns="http://www.w3.org/2000/svg" role="img" aria-label="A pelican riding a bicycle along a seaside path">
  <defs>
    <linearGradient id="skyGrad" x1="0" y1="0" x2="0" y2="1">
      <stop offset="0" stop-color="#8fd3ea"/>
      <stop offset="0.55" stop-color="#c7eaf3"/>
      <stop offset="1" stop-color="#f6f2e2"/>
    </linearGradient>
    <linearGradient id="seaGrad" x1="0" y1="0" x2="0" y2="1">
      <stop offset="0" stop-color="#3fa9b8"/>
      <stop offset="1" stop-color="#2c8a9c"/>
    </linearGradient>
    <linearGradient id="sunGrad" x1="0" y1="0" x2="0" y2="1">
      <stop offset="0" stop-color="#fff3b0"/>
      <stop offset="1" stop-color="#ffd166"/>
    </linearGradient>
    <radialGradient id="sunHalo" cx="0.5" cy="0.5" r="0.5">
      <stop offset="0" stop-color="#ffe9a8" stop-opacity="0.9"/>
      <stop offset="1" stop-color="#ffe9a8" stop-opacity="0"/>
    </radialGradient>
    <linearGradient id="roadGrad" x1="0" y1="0" x2="0" y2="1">
      <stop offset="0" stop-color="#e8d5b5"/>
      <stop offset="1" stop-color="#d9c199"/>
    </linearGradient>
    <linearGradient id="grassGrad" x1="0" y1="0" x2="0" y2="1">
      <stop offset="0" stop-color="#7fae62"/>
      <stop offset="1" stop-color="#5c8f46"/>
    </linearGradient>
    <linearGradient id="hillGrad" x1="0" y1="0" x2="0" y2="1">
      <stop offset="0" stop-color="#a9cfb0"/>
      <stop offset="1" stop-color="#7fb08a"/>
    </linearGradient>
  </defs>

  <!-- ============ BACKGROUND : SKY ============ -->
  <rect x="0" y="0" width="1000" height="640" fill="url(#skyGrad)"/>

  <!-- sun -->
  <g>
    <circle class="sun-glow" cx="820" cy="110" r="120" fill="url(#sunHalo)"/>
    <circle cx="820" cy="110" r="52" fill="url(#sunGrad)"/>
  </g>

  <!-- clouds -->
  <g fill="#ffffff" opacity="0.85">
    <g class="cloud-1">
      <ellipse cx="180" cy="90" rx="70" ry="26"/>
      <ellipse cx="140" cy="100" rx="48" ry="20"/>
      <ellipse cx="225" cy="102" rx="52" ry="22"/>
    </g>
    <g class="cloud-2">
      <ellipse cx="520" cy="70" rx="58" ry="22"/>
      <ellipse cx="490" cy="80" rx="40" ry="16"/>
      <ellipse cx="560" cy="82" rx="44" ry="18"/>
    </g>
    <g class="cloud-3">
      <ellipse cx="700" cy="160" rx="46" ry="17"/>
      <ellipse cx="668" cy="168" rx="32" ry="13"/>
      <ellipse cx="735" cy="168" rx="36" ry="14"/>
    </g>
  </g>

  <!-- distant hills -->
  <path d="M0,330 C120,270 220,300 320,290 C420,280 480,320 560,300 C660,275 760,315 860,295 C930,282 970,300 1000,290 L1000,380 L0,380 Z" fill="url(#hillGrad)" opacity="0.75"/>

  <!-- ============ MIDDLE GROUND : SEA ============ -->
  <rect x="0" y="330" width="1000" height="110" fill="url(#seaGrad)"/>
  <!-- sea sparkle lines -->
  <g stroke="#bfeef5" stroke-width="3" stroke-linecap="round" opacity="0.55">
    <line x1="80"  y1="360" x2="140" y2="360"/>
    <line x1="220" y1="382" x2="300" y2="382"/>
    <line x1="420" y1="352" x2="470" y2="352"/>
    <line x1="560" y1="392" x2="640" y2="392"/>
    <line x1="700" y1="368" x2="760" y2="368"/>
    <line x1="860" y1="386" x2="930" y2="386"/>
    <line x1="140" y1="408" x2="210" y2="408"/>
    <line x1="500" y1="416" x2="560" y2="416"/>
    <line x1="820" y1="412" x2="880" y2="412"/>
  </g>

  <!-- beach strip -->
  <path d="M0,435 C200,425 400,445 600,432 C800,420 900,440 1000,430 L1000,470 L0,470 Z" fill="#f2e3c2"/>

  <!-- ============ PATH / ROAD ============ -->
  <path d="M0,470 L1000,460 L1000,560 L0,570 Z" fill="url(#roadGrad)"/>
  <line class="road-dash" x1="0" y1="520" x2="1000" y2="515"
        stroke="#c9ae83" stroke-width="6" stroke-dasharray="40 40" stroke-linecap="round"/>

  <!-- ============ FOREGROUND GRASS ============ -->
  <path d="M0,560 L1000,550 L1000,640 L0,640 Z" fill="url(#grassGrad)"/>

  <!-- vegetation & flowers (foreground) -->
  <g class="fg-extra">
    <!-- left bush -->
    <g>
      <ellipse cx="70" cy="590" rx="60" ry="38" fill="#568a41"/>
      <ellipse cx="110" cy="600" rx="46" ry="30" fill="#649b4c"/>
      <ellipse cx="40" cy="600" rx="40" ry="26" fill="#4f8339"/>
      <!-- grasses -->
      <path d="M55,570 C50,540 42,530 38,515" stroke="#3f6b2e" stroke-width="4" fill="none" stroke-linecap="round"/>
      <path d="M68,568 C66,536 72,524 78,510" stroke="#4a7a34" stroke-width="4" fill="none" stroke-linecap="round"/>
      <path d="M82,572 C86,544 92,532 100,520" stroke="#3f6b2e" stroke-width="3.5" fill="none" stroke-linecap="round"/>
      <!-- flowers -->
      <circle cx="120" cy="566" r="7" fill="#ef6f6c"/>
      <circle cx="120" cy="566" r="3" fill="#ffd166"/>
      <circle cx="30" cy="574" r="6" fill="#f4a261"/>
      <circle cx="30" cy="574" r="2.5" fill="#fff3b0"/>
    </g>
    <!-- right bush -->
    <g>
      <ellipse cx="930" cy="596" rx="66" ry="40" fill="#568a41"/>
      <ellipse cx="880" cy="606" rx="48" ry="30" fill="#649b4c"/>
      <ellipse cx="980" cy="606" rx="42" ry="28" fill="#4f8339"/>
      <path d="M915,574 C912,542 906,532 900,516" stroke="#3f6b2e" stroke-width="4" fill="none" stroke-linecap="round"/>
      <path d="M930,572 C932,540 938,528 946,514" stroke="#4a7a34" stroke-width="4" fill="none" stroke-linecap="round"/>
      <circle cx="882" cy="572" r="7" fill="#ef6f6c"/>
      <circle cx="882" cy="572" r="3" fill="#ffd166"/>
      <circle cx="962" cy="580" r="6" fill="#f4a261"/>
      <circle cx="962" cy="580" r="2.5" fill="#fff3b0"/>
    </g>
    <!-- scattered small flowers / tufts -->
    <g stroke="#4a7a34" stroke-width="3" stroke-linecap="round" fill="none">
      <path d="M240,600 C238,580 232,572 228,562"/>
      <path d="M252,602 C254,582 260,574 266,564"/>
      <path d="M760,606 C758,586 752,578 748,568"/>
      <path d="M775,608 C778,588 784,580 790,570"/>
    </g>
    <circle cx="228" cy="558" r="5.5" fill="#ef6f6c"/>
    <circle cx="266" cy="560" r="5" fill="#f4a261"/>
    <circle cx="748" cy="564" r="5.5" fill="#ef6f6c"/>
    <circle cx="790" cy="566" r="5" fill="#f4a261"/>
  </g>

  <!-- ============ SHADOW under bicycle ============ -->
  <ellipse cx="500" cy="522" rx="215" ry="16" fill="#000000" opacity="0.14"/>

  <!-- ============ BICYCLE ============ -->
  <g id="bicycle">
    <!-- rear wheel -->
    <g>
      <circle cx="330" cy="470" r="72" fill="none" stroke="#2b2b2b" stroke-width="9"/>
      <circle cx="330" cy="470" r="64" fill="none" stroke="#4a4a4a" stroke-width="2"/>
      <g class="wheel-spin">
        <g stroke="#7d7d7d" stroke-width="2.2" stroke-linecap="round">
          <line x1="330" y1="406" x2="330" y2="534"/>
          <line x1="266" y1="470" x2="394" y2="470"/>
          <line x1="285" y1="425" x2="375" y2="515"/>
          <line x1="375" y1="425" x2="285" y2="515"/>
          <line x1="277" y1="448" x2="383" y2="492"/>
          <line x1="383" y1="448" x2="277" y2="492"/>
        </g>
      </g>
      <circle cx="330" cy="470" r="9" fill="#3a3a3a"/>
      <circle cx="330" cy="470" r="4" fill="#9a9a9a"/>
    </g>

    <!-- front wheel -->
    <g>
      <circle cx="660" cy="470" r="72" fill="none" stroke="#2b2b2b" stroke-width="9"/>
      <circle cx="660" cy="470" r="64" fill="none" stroke="#4a4a4a" stroke-width="2"/>
      <g class="wheel-spin">
        <g stroke="#7d7d7d" stroke-width="2.2" stroke-linecap="round">
          <line x1="660" y1="406" x2="660" y2="534"/>
          <line x1="596" y1="470" x2="724" y2="470"/>
          <line x1="615" y1="425" x2="705" y2="515"/>
          <line x1="705" y1="425" x2="615" y2="515"/>
          <line x1="607" y1="448" x2="713" y2="492"/>
          <line x1="713" y1="448" x2="607" y2="492"/>
        </g>
      </g>
      <circle cx="660" cy="470" r="9" fill="#3a3a3a"/>
      <circle cx="660" cy="470" r="4" fill="#9a9a9a"/>
    </g>

    <!-- frame -->
    <g stroke="#c2453f" stroke-width="9" stroke-linecap="round" fill="none">
      <!-- seat tube -->
      <line x1="470" y1="400" x2="505" y2="480"/>
      <!-- down tube -->
      <line x1="505" y1="480" x2="620" y2="405"/>
      <!-- top tube -->
      <line x1="470" y1="400" x2="620" y2="405"/>
      <!-- chain stays -->
      <line x1="505" y1="480" x2="330" y2="470"/>
      <!-- seat stays -->
      <line x1="470" y1="400" x2="330" y2="470"/>
      <!-- fork -->
      <line x1="620" y1="405" x2="660" y2="470"/>
      <!-- head tube -->
      <line x1="612" y1="392" x2="628" y2="420"/>
    </g>

    <!-- handlebars -->
    <g stroke="#3a3a3a" stroke-width="8" stroke-linecap="round" fill="none">
      <path d="M620,405 L612,388" />
      <path d="M612,388 C598,378 580,382 572,392" />
    </g>
    <circle cx="572" cy="392" r="6" fill="#2b2b2b"/>

    <!-- saddle -->
    <path d="M448,392 C458,384 486,384 492,394 C484,400 456,400 448,392 Z" fill="#333"/>
    <line x1="470" y1="398" x2="470" y2="400" stroke="#3a3a3a" stroke-width="6"/>

    <!-- crank + pedals -->
    <g>
      <circle cx="505" cy="480" r="16" fill="none" stroke="#3a3a3a" stroke-width="5"/>
      <g class="crank">
        <line x1="505" y1="480" x2="505" y2="452" stroke="#444" stroke-width="6" stroke-linecap="round"/>
        <line x1="505" y1="480" x2="505" y2="508" stroke="#444" stroke-width="6" stroke-linecap="round"/>
        <rect x="492" y="444" width="26" height="9" rx="3" fill="#2b2b2b"/>
        <rect x="492" y="503" width="26" height="9" rx="3" fill="#2b2b2b"/>
      </g>
      <circle cx="505" cy="480" r="6" fill="#2b2b2b"/>
    </g>
  </g>

  <!-- ============ PELICAN ============ -->
  <g class="bob" id="pelican">
    <!-- legs (behind body, reaching to pedals) -->
    <g>
      <!-- back leg -->
      <g class="legB">
        <path d="M492,392 L500,440 L512,455" stroke="#e08a2e" stroke-width="9" fill="none" stroke-linecap="round" stroke-linejoin="round"/>
        <!-- webbed foot -->
        <path d="M512,455 L500,466 L516,462 L528,468 L520,456 Z" fill="#e08a2e"/>
      </g>
      <!-- front leg -->
      <g class="legA">
        <path d="M522,394 L528,446 L512,462" stroke="#f2a03d" stroke-width="9" fill="none" stroke-linecap="round" stroke-linejoin="round"/>
        <path d="M512,462 L498,472 L514,468 L528,474 L518,462 Z" fill="#f2a03d"/>
      </g>
    </g>

    <!-- tail feathers -->
    <path d="M382,346 C352,352 338,372 344,392 C360,384 378,382 394,386 Z" fill="#e9eef2"/>
    <path d="M386,356 C364,364 356,378 360,392" stroke="#cfd8de" stroke-width="3" fill="none"/>

    <!-- body -->
    <ellipse cx="470" cy="330" rx="102" ry="72" fill="#f7fafc"/>
    <ellipse cx="470" cy="330" rx="102" ry="72" fill="none" stroke="#dde5ea" stroke-width="3"/>
    <!-- belly warm tint -->
    <ellipse cx="492" cy="356" rx="66" ry="38" fill="#fdf3e3" opacity="0.9"/>

    <!-- chest -->
    <ellipse cx="548" cy="304" rx="46" ry="52" fill="#ffffff"/>

    <!-- neck -->
    <path d="M556,286 C572,248 566,214 552,190" stroke="#f7fafc" stroke-width="40" fill="none" stroke-linecap="round"/>
    <path d="M556,286 C572,248 566,214 552,190" stroke="#dde5ea" stroke-width="40" fill="none" stroke-linecap="round" opacity="0.35"/>

    <!-- head -->
    <circle cx="548" cy="176" r="38" fill="#f7fafc"/>
    <circle cx="548" cy="176" r="38" fill="none" stroke="#dde5ea" stroke-width="3"/>
    <!-- cheek / crest tint -->
    <path d="M520,156 C512,142 518,132 532,130 C526,144 528,152 536,158 Z" fill="#f4f0d8"/>

    <!-- eye -->
    <circle cx="566" cy="164" r="7.5" fill="#26313a"/>
    <circle cx="569" cy="161" r="2.6" fill="#ffffff"/>

    <!-- long beak: upper mandible -->
    <path d="M578,178 C616,178 668,188 700,200 C664,204 618,196 580,190 Z" fill="#f2a03d"/>
    <path d="M578,178 C616,178 668,188 700,200" stroke="#c97b1f" stroke-width="2.5" fill="none"/>
    <!-- pouch (lower mandible) -->
    <path d="M582,190 C618,198 660,214 684,236 C650,238 606,222 580,198 Z" fill="#f8b552"/>
    <path d="M582,190 C618,198 660,214 684,236" stroke="#d68b25" stroke-width="2.5" fill="none"/>
    <!-- pouch shading -->
    <path d="M590,198 C620,210 648,222 668,232" stroke="#e59a35" stroke-width="2" fill="none" opacity="0.7"/>

    <!-- wing (layered) -->
    <g class="wing">
      <path d="M430,292 C450,262 508,258 540,290 C548,318 520,346 468,352 C444,346 430,320 430,292 Z" fill="#e3ebf0"/>
      <path d="M444,300 C462,278 504,276 526,296 C528,318 506,336 470,340 C452,334 442,318 444,300 Z" fill="#cfdae2"/>
      <!-- flight feathers -->
      <path d="M440,326 C452,344 472,352 492,350 C476,360 452,356 440,344 Z" fill="#8d9aa3"/>
      <path d="M432,308 C438,328 452,342 470,348 C452,352 432,342 424,326 Z" fill="#76838c"/>
      <!-- wing outline -->
      <path d="M430,292 C450,262 508,258 540,290 C548,318 520,346 468,352 C444,346 430,320 430,292 Z"
            fill="none" stroke="#b7c3cb" stroke-width="2.5"/>
    </g>

    <!-- small shoulder wing hint on far side -->
    <path d="M520,286 C534,278 548,280 556,290 C546,296 532,296 520,292 Z" fill="#dbe4ea"/>
  </g>

  <!-- ============ small foreground reeds (front layer) ============ -->
  <g class="fg-extra" stroke="#3f6b2e" stroke-width="5" stroke-linecap="round" fill="none">
    <path d="M150,640 C148,606 140,592 132,578"/>
    <path d="M164,640 C164,604 170,590 178,576"/>
    <path d="M860,640 C858,610 852,596 844,584"/>
    <path d="M874,640 C876,608 884,594 892,582"/>
  </g>
</svg>
</div>
</body>
</html>
ChecksPelican leaderboard 5.0/5Source api.deepseek.comPublished HTML
04 / HISTORICAL TASK SAMPLES

Historical small-task samples and reproduction tasks

Alongside the animation, small support and code tasks check structured output and minimal fixes. Cases 01–03 are a separate small-task run that retains the 2026-10-07 DeepSeek V4.1 Flash records; the animation section's DeepSeek entry now uses the 2026-10-18 Pelican leaderboard result for deepseek-flash.

01

Case 01 · Support-ticket routing

An urgent ticket reports a completed top-up with no balance credited. Inspect the JSON fields returned in this sample.

Reading translation (use Chinese JSON prompts to reproduce)You are a support-ticket router. Output JSON only: no Markdown and no explanation. The fields must be category, priority, needs_human, reply_language, and reason. category must be billing, account, or api; priority must be low, medium, or high; reply_language must use BCP-47. Ticket: I topped up ¥200 to my API account last night. My bank charged me, but the balance is still 0. We are launching today. Can you handle this urgently?
Historical static checkscategory=billingpriority=highneeds_human=truereply_language=zh-CNHistorical field checks only; no repeated-run success rate

Case 01 · Support-ticket routing

ModelChecksRaw outputTTFTTotalInput / output tokensRecorded cost (basis unknown)
DeepSeek V4.1 FlashStatic checks passed4 historical static checks passed
Read raw output
{"category":"billing","priority":"high","needs_human":true,"reply_language":"zh-CN","reason":"用户为 API 账户充值 200 元,银行卡已扣款但余额仍为 0,属于支付到账异常/资金类问题,需人工核查支付流水与订单状态;用户今日上线,时效紧急,故优先级为 high。"}
Not recorded23.62s118 / 140¥0.000475
Qwen3.8 MaxStatic checks passed4 historical static checks passed
Read raw output
{
  "category": "billing",
  "priority": "high",
  "needs_human": true,
  "reply_language": "zh-CN",
  "reason": "用户已充值但余额未到账,且今日需上线,需尽快人工核查支付与账户余额。"
}
Not recorded10.04s157 / 184¥0.004254
Kimi K3Static checks passed4 historical static checks passed
Read raw output
{"category":"billing","priority":"high","needs_human":true,"reply_language":"zh-CN","reason":"用户银行卡已扣款200元但API账户余额未到账,属于支付未入账问题,需人工核实充值流水;且用户当天要上线,时间紧迫,故优先级为高。"}
Not recorded13.74s175 / 306¥0.027280
GLM-5.3 FlashStatic checks passed4 historical static checks passed
Read raw output
{"category":"billing","priority":"high","needs_human":true,"reply_language":"zh-CN","reason":"银行已扣款但 API 账户余额未到账,属于充值对账问题,需人工核查支付流水并补账;客户当天要上线,时间敏感,优先级高。"}
Not recorded14.51s99 / 400¥0.000600
02

Case 02 · Production TypeScript bug

A common property-name mistake checks whether the response contains the expected correction.

Reading translation (use Chinese JSON prompts to reproduce)Output only the corrected TypeScript function. Do not explain and do not use Markdown. Keep the function name and type definition. type LineItem = { price: number; qty: number }; export function subtotal(items: LineItem[]): number { return items.reduce((sum, item) => sum + item.price * item.quantity, 0); }
Historical static checksUse item.qtyRemove item.quantityKeep the subtotal function nameHistorical string checks only; no execution or type-check result retained

Case 02 · Production TypeScript bug

ModelChecksRaw outputTTFTTotalInput / output tokensRecorded cost (basis unknown)
DeepSeek V4.1 FlashStatic checks passed3 historical static checks passed
Read raw output
type LineItem = { price: number; qty: number };

export function subtotal(items: LineItem[]): number {
  return items.reduce((sum, item) => sum + item.price * item.qty, 0);
}
Not recorded21.15s93 / 128¥0.000423
Qwen3.8 MaxStatic checks passed3 historical static checks passed
Read raw output
type LineItem = { price: number; qty: number };

export function subtotal(items: LineItem[]): number {
  return items.reduce((sum, item) => sum + item.price * item.qty, 0);
}
Not recorded7.70s131 / 234¥0.004998
Kimi K3Static checks passed3 historical static checks passed
Read raw output
type LineItem = { price: number; qty: number };

export function subtotal(items: LineItem[]): number {
  return items.reduce((sum, item) => sum + item.price * item.qty, 0);
}
Not recorded32.31s154 / 165¥0.015664
GLM-5.3 FlashStatic checks passed3 historical static checks passed
Read raw output
type LineItem = { price: number; qty: number };

export function subtotal(items: LineItem[]): number {
  return items.reduce((sum, item) => sum + item.price * item.qty, 0);
}
Not recorded24.23s69 / 176¥0.000274
03

Case 03 · Order analytics SQL

A common paid-order report tests whether the model handles filtering, aggregation, grouping, and sorting together.

Reading translation (use Chinese JSON prompts to reproduce)Output one SQLite SQL query only. Do not explain and do not use Markdown. For orders from the last 30 days where status is paid, aggregate amount by user_id. The result columns must be named user_id and total_amount, sorted by total_amount descending. Schema: orders(id INTEGER, user_id INTEGER, status TEXT, amount REAL, created_at TEXT)
Historical static checksAggregate with SUM(amount)Filter status='paid'Group by user_idSort by total_amount descendingKeep only the last 30 days

Case 03 · Order analytics SQL

ModelChecksRaw outputTTFTTotalInput / output tokensRecorded cost (basis unknown)
DeepSeek V4.1 FlashStatic checks passed5 historical static checks passed
Read raw output
SELECT user_id, SUM(amount) AS total_amount FROM orders WHERE status = 'paid' AND created_at >= datetime('now', '-30 days') GROUP BY user_id ORDER BY total_amount DESC;
Not recorded8.38s98 / 42¥0.000186
Qwen3.8 MaxStatic checks passed5 historical static checks passed
Read raw output
SELECT user_id, SUM(amount) AS total_amount FROM orders WHERE status = 'paid' AND created_at >= datetime('now', '-30 days') GROUP BY user_id ORDER BY total_amount DESC;
Not recorded7.42s136 / 243¥0.005190
Kimi K3Static checks passed5 historical static checks passed
Read raw output
SELECT user_id, SUM(amount) AS total_amount FROM orders WHERE status = 'paid' AND created_at >= datetime('now', '-30 days') GROUP BY user_id ORDER BY total_amount DESC;
Not recorded39.66s159 / 187¥0.017504
GLM-5.3 FlashStatic checks passed5 historical static checks passed
Read raw output
SELECT user_id, SUM(amount) AS total_amount FROM orders WHERE status = 'paid' AND date(created_at) >= date('now', '-30 days') GROUP BY user_id ORDER BY total_amount DESC;
Not recorded112.60s77 / 191¥0.000298

How to read the results

Animation uses the dated records shown above. Cases 01–03 come from the retained 2026-10-07 JSON, with one sample per model/case. TTFT and original request bodies were not retained; cost fields lack billed/estimated provenance and are not current quotes or confirmed bills. The JSON also supplies current published Chinese reproduction tasks; English prompts are reading translations.

FieldMeaningDecision ruleDisplay
RenderableAnimation HTML runs in the iframeStatic checks and browser observations are separateThis sample only
FixedOriginal output had a layout conflictKeep the minimal correction and original separatelyLabeled separately
CostRecorded historical cost fieldSmall-task billed/estimated provenance not retainedNot a current quote
LatencyRecorded total response durationSmall-task TTFT not recordedNo percentiles or ranking

These are limited historical samples with different animation prompts and output limits. Model versions, run dates, upstream load, and parameters affect results. Use consistent conditions and repeated runs for model selection.

05 / METHOD

How to interpret the records

Publish current tasks and constraints without presenting reproduction tasks as unretained original request bodies.

Retain raw outputs, failures and checks; static checks do not establish execution or task success.

Label missing historical request parameters, TTFT and cost provenance rather than reconstructing them.

Label every manual fix; new repeated runs retain parameters and cost provenance without replacing historical samples.

06 / FAQ

FAQ

Which model is best for frontend work?

These historical samples cannot establish a controlled ranking. Use your own tasks with consistent prompts, output limits, and parameters, then repeat runs to measure completion, tokens, cost, and latency.

Why can output tokens exceed the HTML size?

Billed output tokens can include hidden model reasoning, so HTML bytes are not a usage estimate.

Why is Kimi labeled fixed?

Its CSS animation overrode the SVG positioning transform and moved the rider off canvas; only that conflict was fixed and the raw file remains available.

KIMISEEK

Use one task and verify the difference

Copy the prompt, change the model parameter, and choose based on your inputs, latency target, and budget.

Start
testing