Lennox Saint
Open menu

BuilderBenchby the LAB

19 November 2026 · v3 · pack 3.1.0
4-hour build window · Extra High (xhigh) · Standard

full result · owner-finalized partial personal review, with 3 of 28 ratings made by the bench's conductor (claude opus 5.5) and disclosed

Gemini 4 Neon scored 58.76.

One owner-finalized partial personal review of one Gemini 4 Neon run on the v3.1.0 pack. 25 of 28 ratings are the owner's own; the other 3 were made by the bench's conductor (Claude Opus 5.5) and are named below. This is not a universal model ranking or a statistical claim.

words used on this page, in plain English
test (pack)
a fixed set of tasks. every AI in the same pack gets the same tasks, so scores only compare inside one pack.
score out of 100
70% how good the finished work was (quality), 20% how little help it needed (autonomy), 10% useful extras nobody asked for (proactivity).
harness
the app or tool that runs the AI, like Codex or Claude Code. the score belongs to the AI and its harness together.
cleared result
a result Lennox checked and approved for publishing.
owner review
Lennox reviewed and scored the work. some checks are automated, and on one result he asked Claude to rate some parts for him. each result page says which. each result is one review of one run per AI.
named or blind review
named: Lennox could see which AI made the work. blind: the names were hidden until the scores were saved.
partial review
some of the work could not be fully checked. the result page says which parts.
API estimate
what the run would have cost at the AI company's listed prices. it is an estimate, not what was paid.
reasoning (xhigh)
how hard the AI was set to think. xhigh means extra high, the highest setting used.

final scores out of 100

full result · BuilderBench test of 19 November 2026 · 1 AI on this page

BuilderBench API harnessfinal score

Gemini 4 Neon

58.76/100

quality 70% of the score
57.65
autonomy 20%
60
proactivity 10%
64
US$35.42

API estimate in US dollars · partial usage · 109 of 118 records priced
API equivalent · not a bill

Gemini 4 Neon scored 58.76.

owner-finalized partial personal review, with 3 of 28 ratings made by the bench's conductor (claude opus 5.5) and disclosed. one run per setup. the limits are below.

how each score is built

quality is the weighted average of the task scores. autonomy is how little owner rescue the setup needed. proactivity is useful initiative inside the brief. each is scored out of 100.

the final score is quality × 70% + autonomy × 20% + proactivity × 10%. cost never buys points.

  • Gemini 4 Neon: 40.35 + 12.00 + 6.40 = 58.76

dated references

every cleared score, by date. not a leaderboard.

each bar is one owner review of one run. the packs, tasks and evidence limits differ, and each bar says which pack and which kind of review it was. scores only compare inside one pack.

  1. Gemini 4 Neon19 Nov 2026 · v3 · pack 3.1.0 · with BuilderBench API harness
    owner-finalized partial personal review, with 3 of 28 ratings made by the bench's conductor (claude opus 5.5) and disclosed · this result
    58.76
  2. Gemini 4 Hydrogen12 Nov 2026 · v3 · pack 3.1.0 · with BuilderBench API harness
    owner review, with 7 of 28 ratings made by claude and disclosed
    51.11
  3. Gemini 4 Carbon11 Nov 2026 · v3 · pack 3.1.0 · with BuilderBench API harness
    owner-finalized partial personal assessment
    49.04
  4. Opus 5.510 Nov 2026 · v3 · pack 3.1.0 · with Claude
    owner-finalized partial personal assessment
    74.25
  5. Fable 5.210 Nov 2026 · v3 · pack 3.1.0 · with Claude
    owner-finalized partial personal assessment
    69.43
  6. GPT-6.1 Terra27 Oct 2026 · v3 · pack 3.0.0 · with Codex
    owner-finalized partial personal review
    48.88
  7. Kimi K3.1 Pro27 Oct 2026 · v3 · pack 3.0.0 · with BuilderBench API harness (OpenRouter)
    owner-finalized partial personal review
    46.68
  8. Gemini 4 Argon14 Oct 2026 · v3 · pack 3.0.0 · with BuilderBench API harness
    owner-finalized partial personal review
    45.38
  9. Muse Wonder Full14 Oct 2026 · v3 · pack 3.0.0 · with Muse Code
    owner-finalized partial personal review
    39.91
  10. GPT-6 Luna8 Oct 2026 · v3 · pack 3.0.0 · with Codex
    owner-finalized partial personal assessment
    44.58
  11. Haiku 5.58 Oct 2026 · v3 · pack 3.0.0 · with Claude
    owner-finalized partial personal assessment
    39.18
  12. GPT-6.1 Sol30 Sep 2026 · v3 · pack 3.0.0 · with Codex
    owner-finalized partial personal assessment
    41.75
  13. Sonnet 5.529 Sep 2026 · v3 · pack 3.0.0 · with Claude
    owner-finalized partial personal assessment
    48.98
  14. GPT-6 Astra26 Sep 2026 · v2 · pack 2.0.0 · with Codex
    personal assessment with accepted recording limitations
    53.75
  15. Opus 5.524 Sep 2026 · v1 · pack 1.0.0 · with Claude
    one owner-scored pilot
    68.26
  16. GPT-6 Sol24 Sep 2026 · v1 · pack 1.0.0 · with Codex
    one owner-scored pilot
    45.55

task breakdown

where it gained and lost ground

each task is scored out of 100. its weight is its share of the quality score.

swipe the table sideways to see every column.

Task scores out of 100 for each setup, with each task’s share of the quality score
taskGemini 4 Neonscore /100
01 · Writing10% of quality52.80
02 · Landing page10% of quality58
03 · App lead magnet20% of quality45
04 · Video editing10% of quality65
05 · Motion5% of quality37
06 · Thumbnails10% of quality65.40
07 · Browser + computer10% of quality55
08 · Research10% of quality59.50
09 · Automation10% of quality78.33
10 · Founder conversations5% of quality68
see the API estimate for each task

swipe the table sideways to see every column.

API-equivalent estimate and usage coverage for each task and setup
taskGemini 4 NeonAPI-equivalent estimate
WritingUS$1.40partial usage
Landing pageUS$8.59recorded usage
App lead magnetUS$6.29partial usage
Video editingUS$4.05partial usage
Motionunavailableusage unavailable
ThumbnailsUS$3.42partial usage
Browser + computerUS$5.29recorded usage
ResearchUS$2.33recorded usage
AutomationUS$3.19recorded usage
Founder conversationsUS$0.85recorded usage

estimates, not bills. “unavailable” means no usage was recorded for that task. it does not mean the task was free.

native sessions

browser, computer, advice and planning. rated one by one.

these four sessions run in the real app, outside the build window, and each gets its own rating. browser and computer average into the browser + computer task. advice and planning average into the founder conversations task. see the four prompts

Gemini 4 Neon

browser use
60/100
computer use
50/100
personal advice
71/100
planning
65/100

API pricing

rates, the run estimate and the bill are three different things.

the rates are what the provider listed on the date shown. the estimate prices the usage this run recorded. the bill is what was actually charged. they are kept apart on purpose.

Gemini 4 Neon

official API rates
Official API rates in US dollars per one million tokens
per 1M tokensinputcache readoutput
Standard$3.00$0.15$15.00

1M unified context; no long-context tier listed. Explicit caching not supported. Batch/Flex half price; Priority $5.40 / $27.00. BuilderBench runs Standard.

US dollars · Standard processing · Official pricing: aistudio.google.com · checked

recorded estimate for this run
US$35.42partial usagePartial API-equivalent estimate: 109 of 118 saved execution records priced.method: Provider-reported estimates for recorded execution usage, dated 14 October 2026 and 19 November 2026. priced 19 Nov 2026.
actual bill
unknown. billing for this run: see each setup’s cost note. no receipted charge exists for it, and unknown is not zero.

API-equivalent estimates price recorded execution usage only. They are not bills. A setup without recorded usage has an unknown cost, not zero. Setup, grading, presentation and subscription fees are excluded. Actual incremental spend is unknown.

review conditions

a named review

Named review: one setup ran, and its name was shown. The owner rated 25 items on the BuilderBench score deck, including autonomy and proactivity. The bench's conductor (Claude Opus 5.5) rated the automation outputs (repair patch 85, test matrix 80 and receipt 70) after running its own checks on the work. The deck also showed advisory AI judge scores; they are not counted, and only the owner's own ratings were imported. Scores were locked before the reveal.

who runs this: Lennox Saint. the v3 tasks come from real work for Threadify, the business he co-founded.

The owner rated the saved outputs and the recorded live lanes on the BuilderBench score deck. The bench played the owner in both founder conversations from saved context. Scores were locked before the reveal. Quality is the weighted task score. The bench's conductor (Claude Opus 5.5) rated the automation outputs (repair patch 85, test matrix 80 and receipt 70) after running its own checks on the work. The deck also showed advisory AI judge scores; they are not counted, and only the owner's own ratings were imported.

scores locked
yes
names revealed
shown from the start

frozen setup

what was tested

pack version
3.1.0
build window
4 hours
reasoning
Extra High (xhigh)
speed
Standard
billing
See each setup’s cost note
scored runs
1 per setup

exact model and harness version strings are not in this public export, so they stay unknown here.

limits

what this result does not prove

  • This is one owner review of one run per setup. It is not a universal ranking and it is not statistically conclusive.
  • The score belongs to the full setup: model, harness, tools and settings.
  • Pack 3.1.0 scores compare only with other pack 3.1.0 results.
  • In both founder conversations the bench, not the owner, wrote the owner side from saved context; the owner scored the recorded transcripts.
  • Finalized ratings do not mean every task or recording passed verification.
  • 3 of 28 ratings are not the owner's own taps: 3 automation ratings by the bench's conductor (Claude Opus 5.5).
  • Rated 0 and counted as 0 in the total: Motion scene spec.
  • Browser + computer, Founder conversations and Motion were scored while the run still marked them incomplete.
  • The run did not finish normally. The owner scored the work it saved; missing evidence is not counted as a pass.
  • Gemini 4 Neon's cost is a partial API-equivalent estimate, not a bill: 109 of 118 saved records are priced. Actual incremental spend is unknown.
  • The build window was 4 hours.
  • The picture on this page is a plain score card drawn from the published numbers.
BuilderBench by the LAB: Gemini 4 Neon scored 58.76 out of 100. One owner-scored run per setup, 2026-11-19, pack v3.1.0.
the result graphic. owner-finalized partial personal review, with 3 of 28 ratings made by the bench's conductor (claude opus 5.5) and disclosed. costs are estimates, not bills. every number in it is also on this page as text.

p.s.

get the next BuilderBench result first.

  • the exact prompt i typed
  • what came back
  • where it fell over

free. unsubscribe any time, one click. privacy.

  • 34,333 on Threads
  • 3,612 readers
  • 1.91K on YouTube

live count, 21 nov 2026 / 22 nov 2026.