Lennox Saint
Open menu

BuilderBenchby the LAB

11 November 2026 · v3 · pack 3.1.0
4-hour build window · Extra High (xhigh) · Standard

full result · owner-finalized partial personal assessment

Gemini 4 Carbon scored 49.04.

One owner-finalized partial personal assessment of one Gemini 4 Carbon run through the BuilderBench API harness on pack 3.1.0. This is not a universal model ranking or a statistical claim.

words used on this page, in plain English
test (pack)
a fixed set of tasks. every AI in the same pack gets the same tasks, so scores only compare inside one pack.
score out of 100
70% how good the finished work was (quality), 20% how little help it needed (autonomy), 10% useful extras nobody asked for (proactivity).
harness
the app or tool that runs the AI, like Codex or Claude Code. the score belongs to the AI and its harness together.
cleared result
a result Lennox checked and approved for publishing.
owner review
Lennox reviewed and scored the work. some checks are automated, and on one result he asked Claude to rate some parts for him. each result page says which. each result is one review of one run per AI.
named or blind review
named: Lennox could see which AI made the work. blind: the names were hidden until the scores were saved.
partial review
some of the work could not be fully checked. the result page says which parts.
API estimate
what the run would have cost at the AI company's listed prices. it is an estimate, not what was paid.
reasoning (xhigh)
how hard the AI was set to think. xhigh means extra high, the highest setting used.

final scores out of 100

full result · BuilderBench test of 11 November 2026 · 1 AI on this page

BuilderBench API harnessfinal score

Gemini 4 Carbon

49.04/100

quality 70% of the score
49.48
autonomy 20%
48
proactivity 10%
48
US$34.79

API estimate in US dollars · partial usage · 112 of 123 records priced
API equivalent · not a bill

Gemini 4 Carbon scored 49.04.

owner-finalized partial personal assessment. one run per setup. the limits are below.

how each score is built

quality is the weighted average of the task scores. autonomy is how little owner rescue the setup needed. proactivity is useful initiative inside the brief. each is scored out of 100.

the final score is quality × 70% + autonomy × 20% + proactivity × 10%. cost never buys points.

  • Gemini 4 Carbon: 34.64 + 9.60 + 4.80 = 49.04

dated references

every cleared score, by date. not a leaderboard.

each bar is one owner review of one run. the packs, tasks and evidence limits differ, and each bar says which pack and which kind of review it was. scores only compare inside one pack.

  1. Gemini 4 Carbon11 Nov 2026 · v3 · pack 3.1.0 · with BuilderBench API harness
    owner-finalized partial personal assessment · this result
    49.04
  2. Gemini 4 Neon19 Nov 2026 · v3 · pack 3.1.0 · with BuilderBench API harness
    owner-finalized partial personal review, with 3 of 28 ratings made by the bench's conductor (claude opus 5.5) and disclosed
    58.76
  3. Gemini 4 Hydrogen12 Nov 2026 · v3 · pack 3.1.0 · with BuilderBench API harness
    owner review, with 7 of 28 ratings made by claude and disclosed
    51.11
  4. Opus 5.510 Nov 2026 · v3 · pack 3.1.0 · with Claude
    owner-finalized partial personal assessment
    74.25
  5. Fable 5.210 Nov 2026 · v3 · pack 3.1.0 · with Claude
    owner-finalized partial personal assessment
    69.43
  6. GPT-6.1 Terra27 Oct 2026 · v3 · pack 3.0.0 · with Codex
    owner-finalized partial personal review
    48.88
  7. Kimi K3.1 Pro27 Oct 2026 · v3 · pack 3.0.0 · with BuilderBench API harness (OpenRouter)
    owner-finalized partial personal review
    46.68
  8. Gemini 4 Argon14 Oct 2026 · v3 · pack 3.0.0 · with BuilderBench API harness
    owner-finalized partial personal review
    45.38
  9. Muse Wonder Full14 Oct 2026 · v3 · pack 3.0.0 · with Muse Code
    owner-finalized partial personal review
    39.91
  10. GPT-6 Luna8 Oct 2026 · v3 · pack 3.0.0 · with Codex
    owner-finalized partial personal assessment
    44.58
  11. Haiku 5.58 Oct 2026 · v3 · pack 3.0.0 · with Claude
    owner-finalized partial personal assessment
    39.18
  12. GPT-6.1 Sol30 Sep 2026 · v3 · pack 3.0.0 · with Codex
    owner-finalized partial personal assessment
    41.75
  13. Sonnet 5.529 Sep 2026 · v3 · pack 3.0.0 · with Claude
    owner-finalized partial personal assessment
    48.98
  14. GPT-6 Astra26 Sep 2026 · v2 · pack 2.0.0 · with Codex
    personal assessment with accepted recording limitations
    53.75
  15. Opus 5.524 Sep 2026 · v1 · pack 1.0.0 · with Claude
    one owner-scored pilot
    68.26
  16. GPT-6 Sol24 Sep 2026 · v1 · pack 1.0.0 · with Codex
    one owner-scored pilot
    45.55

task breakdown

where it gained and lost ground

each task is scored out of 100. its weight is its share of the quality score.

swipe the table sideways to see every column.

Task scores out of 100 for each setup, with each task’s share of the quality score
taskGemini 4 Carbonscore /100
01 · Writing10% of quality37.40
02 · Landing page10% of quality38
03 · App lead magnet20% of quality49
04 · Video editing10% of quality36.33
05 · Motion5% of quality48.50
06 · Thumbnails10% of quality44.60
07 · Browser + computer10% of quality40
08 · Research10% of quality69.50
09 · Automation10% of quality76
10 · Founder conversations5% of quality61.50
see the API estimate for each task

swipe the table sideways to see every column.

API-equivalent estimate and usage coverage for each task and setup
taskGemini 4 CarbonAPI-equivalent estimate
WritingUS$0.68partial usage
Landing pageUS$4.32recorded usage
App lead magnetUS$4.92partial usage
Video editingUS$10.44partial usage
MotionUS$3.70partial usage
ThumbnailsUS$2.41partial usage
Browser + computerUS$4.39partial usage
ResearchUS$1.21recorded usage
AutomationUS$1.79recorded usage
Founder conversationsUS$0.93recorded usage

estimates, not bills. “unavailable” means no usage was recorded for that task. it does not mean the task was free.

native sessions

browser, computer, advice and planning. rated one by one.

these four sessions run in the real app, outside the build window, and each gets its own rating. browser and computer average into the browser + computer task. advice and planning average into the founder conversations task. see the four prompts

Gemini 4 Carbon

browser use
30/100
computer use
50/100
personal advice
77/100
planning
46/100

API pricing

rates, the run estimate and the bill are three different things.

the rates are what the provider listed on the date shown. the estimate prices the usage this run recorded. the bill is what was actually charged. they are kept apart on purpose.

Gemini 4 Carbon

official API rates
Official API rates in US dollars per one million tokens
per 1M tokensinputcache readoutput
Introductory, through 30 Nov 2026$2.00$0.10$10.00

From 1 December 2026: $4.00 input, $0.20 cache read and $20.00 output. Output includes thinking tokens. Cache reads are implicit; explicit cache writes are unsupported. 1M unified context with no separate context-tier premium listed. Not available on the free tier. API use is billed separately from Google subscriptions.

US dollars · Standard processing · Google Gemini API pricing: Gemini 4 Carbon · checked

recorded estimate for this run
US$34.79partial usagePartial API-equivalent estimate: 112 of 123 saved execution records priced from provider-reported estimates. Unpriced records are not included.method: Provider-reported estimates for recorded execution usage, dated 14 October and 11 November 2026. priced 11 Nov 2026.
actual bill
unknown. billing for this run: the paid gemini api (gemini 4 carbon). no receipted charge exists for it, and unknown is not zero.

API-equivalent estimates price recorded execution usage only. They are not bills. Gemini 4 Carbon keeps provider-reported estimates for 112 of 123 saved records, so its figure is partial. Actual incremental spend is unknown.

review conditions

a named review

Named review: one setup ran, and its name was shown. The owner locked the scores in the review deck on 12 November 2026 as a partial personal assessment. Unfinished tasks were listed on the lock screen and stay disclosed.

who runs this: Lennox Saint. the v3 tasks come from real work for Threadify, the business he co-founded.

The ratings saved in the review deck were finalized by the owner as a partial personal assessment and locked on 12 November 2026. Quality is the weighted task score. v1 to v3 use 70% quality, 20% autonomy and 10% proactivity.

scores locked
yes
names revealed
shown from the start

frozen setup

what was tested

pack version
3.1.0
build window
4 hours
reasoning
Extra High (xhigh)
speed
Standard
billing
The paid Gemini API (Gemini 4 Carbon)
scored runs
1 per setup

exact model and harness version strings are not in this public export, so they stay unknown here.

limits

what this result does not prove

  • This is one owner-finalized partial personal assessment of one run of one setup. It is not a universal ranking and it is not statistically conclusive.
  • Finalized ratings do not mean every task or recording passed verification. The original execution and its evidence are incomplete.
  • The runner failed and execution did not complete normally. Completed work was kept for partial review.
  • The run hit Google timeouts and per-task deadlines, so some revisions and deliverables are missing. Missing work is not scored as zero; the owner scored what was delivered.
  • Gemini 4 Carbon's cost is a partial API-equivalent estimate, not a bill: 112 of 123 saved records are priced. Actual incremental spend is unknown.
  • The score belongs to the full setup: model, harness, tools and settings.
  • Pack 3.1.0 scores compare only with other pack 3.1.0 results.
  • The build window was four hours.
  • The picture on this page is a plain score card drawn from the published numbers. The run's own result graphic has not been made yet.
BuilderBench by the LAB score card: Gemini 4 Carbon with the BuilderBench API harness scored 49.04 out of 100 on pack 3.1.0, 11 November 2026. Quality 49.48, autonomy 48, proactivity 48. Task scores: writing 37.4, landing page 38, app lead magnet 49, video editing 36.33, motion 48.5, thumbnails 44.6, browser + computer 40, research 69.5, automation 76, founder conversations 61.5. Owner-finalized partial personal assessment of one run. API estimate US$34.79 from partial recorded usage, not a bill.
the result graphic. owner-finalized partial personal assessment. costs are estimates, not bills. every number in it is also on this page as text.

p.s.

get the next BuilderBench result first.

  • the exact prompt i typed
  • what came back
  • where it fell over

free. unsubscribe any time, one click. privacy.

  • 34,473 on Threads
  • 3,612 readers
  • 1.91K on YouTube

live count, 22 nov 2026.