Workers port report

Proven on this run

1 of 1 Playwright test ported to Kane. Kane caught every bug the old suite caught (2/2). 3 planted bugs slipped past every test in both suites. Kane avoided 1 false alarm the old suite raised.

Generated 2026-11-16T22:29:34.104Z

1/1tests ported
2 vs 2bugs caught, old vs new (of 5 test and bug pairs)
1false alarms avoided
0Kane stronger
0Kane weaker
0needs human
71.4Kane credits used

Matrix Playwright (PW) vs Kane, per test and per break

TestcleanbaselineB1bugB2bugB3bugB4bugB5bugR1refactorR2refactor
should append new items to the bottom of the listboth passPW ✓ pass · Kane ✓ pass runboth caughtPW ✗ fail · Kane ✗ failhealedneither caughtPW ✓ pass · Kane ✓ passboth caughtPW ✗ fail · Kane ✗ failhealedneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passfalse alarm avoidedPW ✗ fail · Kane ✓ passboth passPW ✓ pass · Kane ✓ pass

healed = Kane's self-healing re-authored a step during this run. Each cell shows the verdict of both suites and the outcome in words.

Repair loop

should append new items to the bottom of the list (repaired)

Round 1

Weaker on: B1, B3

Agent change to the _test.md:

… Type "book a doctors appointment" into the "What needs to be done?" box and press Enter. -## Check the page-Verify the todo list is visible.+## Verify the todo count and order+Verify the exact visible text of the todo counter is "3 items left".+Verify the list shows exactly these items, in this order: "buy some cheese", "feed the cat", "book a doctors appointment". +## Verify the todos persist+Reload the page.+Verify the list shows exactly these items, in this order: "buy some cheese", "feed the cat", "book a doctors appointment".+

Verdicts after:

  • clean: both pass
  • B1: both caught
  • B2: neither caught
  • B3: both caught
  • B4: neither caught
  • B5: neither caught
  • R1: false alarm avoided
  • R2: both pass

Before and after

TestPlaywright lines_test.md linesPorted file
should append new items to the bottom of the list1721tests/01-should-append-new-items-to-the-bottom-of-the-list/01-should-append-new-items-to-the-bottom-of-the-list_test.md
Total1721