Workers port report

Proven on this run

10 of 10 Playwright tests ported to Kane. Kane caught every bug the old suite caught (8/8). Kane avoided 5 false alarms the old suite raised.

Generated 2026-11-16T21:22:11.054Z

10/10tests ported
8 vs 8bugs caught, old vs new (of 50 test and bug pairs)
5false alarms avoided
0Kane stronger
0Kane weaker
0needs human
191.1Kane credits used

Matrix Playwright (PW) vs Kane, per test and per break

TestcleanbaselineB1bugB2bugB3bugB4bugB5bugR1refactorR2refactor
signs in with the demo account and lands on the shopboth passPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passboth passPW ✓ pass · Kane ✓ passboth passPW ✓ pass · Kane ✓ pass
shows an error for a wrong passwordboth passPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passboth passPW ✓ pass · Kane ✓ passboth passPW ✓ pass · Kane ✓ pass
adding items updates the cart badgeboth passPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passboth caughtPW ✗ fail · Kane ✗ failhealedfalse alarm avoidedPW ✗ fail · Kane ✓ pass runhealedboth passPW ✓ pass · Kane ✓ pass
increasing the quantity updates the line total and subtotalboth passPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passboth caughtPW ✗ fail · Kane ✗ failhealedneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passfalse alarm avoidedPW ✗ fail · Kane ✓ passboth passPW ✓ pass · Kane ✓ pass
removing a line leaves the other items aloneboth passPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passboth caughtPW ✗ fail · Kane ✗ failhealedneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passfalse alarm avoidedPW ✗ fail · Kane ✓ passboth passPW ✓ pass · Kane ✓ pass
the subtotal adds up every line with its quantityboth passPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passboth caughtPW ✗ fail · Kane ✗ failhealedneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passfalse alarm avoidedPW ✗ fail · Kane ✓ passboth passPW ✓ pass · Kane ✓ pass
the INK10 coupon takes 10% off the subtotalboth passPW ✓ pass · Kane ✓ passboth caughtPW ✗ fail · Kane ✗ failhealedboth caughtPW ✗ fail · Kane ✗ failhealedneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passboth passPW ✓ pass · Kane ✓ passboth passPW ✓ pass · Kane ✓ pass
an unknown coupon shows an error and changes nothingboth passPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passboth caughtPW ✗ fail · Kane ✗ failhealedneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passboth passPW ✓ pass · Kane ✓ passboth passPW ✓ pass · Kane ✓ pass
required fields are validated inlineboth passPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passboth caughtPW ✗ fail · Kane ✗ failhealedneither caughtPW ✓ pass · Kane ✓ passboth passPW ✓ pass · Kane ✓ passboth passPW ✓ pass · Kane ✓ pass
a valid order is confirmed with an order numberboth passPW ✓ pass · Kane ✓ passhealedneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passneither caughtPW ✓ pass · Kane ✓ passfalse alarm avoidedPW ✗ fail · Kane ✓ passboth passPW ✓ pass · Kane ✓ pass

healed = Kane's self-healing re-authored a step during this run. Each cell shows the verdict of both suites and the outcome in words.

Repair loop

No repairs were needed: every ported test matched the old suite on the first try.

Before and after

TestPlaywright lines_test.md linesPorted file
signs in with the demo account and lands on the shop1021tests/01-signs-in-with-the-demo-account-and-lands-on-the-shop/01-signs-in-with-the-demo-account-and-lands-on-the-shop_test.md
shows an error for a wrong password717tests/02-shows-an-error-for-a-wrong-password/02-shows-an-error-for-a-wrong-password_test.md
adding items updates the cart badge623tests/03-adding-items-updates-the-cart-badge/03-adding-items-updates-the-cart-badge_test.md
increasing the quantity updates the line total and subtotal926tests/04-increasing-the-quantity-updates-the-line-total-and-subtotal/04-increasing-the-quantity-updates-the-line-total-and-subtotal_test.md
removing a line leaves the other items alone1128tests/05-removing-a-line-leaves-the-other-items-alone/05-removing-a-line-leaves-the-other-items-alone_test.md
the subtotal adds up every line with its quantity725tests/06-the-subtotal-adds-up-every-line-with-its-quantity/06-the-subtotal-adds-up-every-line-with-its-quantity_test.md
the INK10 coupon takes 10% off the subtotal727tests/07-the-ink10-coupon-takes-10-off-the-subtotal/07-the-ink10-coupon-takes-10-off-the-subtotal_test.md
an unknown coupon shows an error and changes nothing523tests/08-an-unknown-coupon-shows-an-error-and-changes-nothing/08-an-unknown-coupon-shows-an-error-and-changes-nothing_test.md
required fields are validated inline722tests/09-required-fields-are-validated-inline/09-required-fields-are-validated-inline_test.md
a valid order is confirmed with an order number831tests/10-a-valid-order-is-confirmed-with-an-order-number/10-a-valid-order-is-confirmed-with-an-order-number_test.md
Total77243