VibeToolRank Weekly #3 · Sent
Momentic's AI QA agent caught our planted bug 3/3 (9.6)
Plus: Qodo's free setup missed the null bug, and OpenHands scores 9.1.
This is the web version of the email we sent. It does not include tracking links or an unsubscribe token.
Hi, it's Peter from VibeToolRank. Here's what we tested recently.
New test: Momentic, 9.6
Momentic's AI QA agent, Mo, finished our login and add-to-cart brief in 3 of 3 sessions on the Free plan, in about 60–95 seconds each at roughly $0.08–$0.12 per session. We then planted a pricing bug (every cart line was $1 too high) in a local shop, and Mo found it in all 3 sessions. The score of 9.6 comes from the simpler happy-path test; the bug hunt cost about $2.65 in total, well inside the $50 monthly Free allowance. Catch: you need an account and an API key, and the package is called qa, not mo.
Also tested: OpenHands, 9.1
OpenHands is self-hosted and worked with a free Gemini key, for a 9.1.
Honest miss: Qodo, 7.5
Qodo's free open-source setup (pr-agent with Gemini flash-lite) caught 3 to 4 of our 6 planted bugs per run and never flagged the null-access bug. It's fast and costs $0, but don't count on it as your only reviewer.
Comparison: Qodo vs CodeRabbit
CodeRabbit scored 8.1 to Qodo's 7.5 on our planted-bug pull request. CodeRabbit caught the null access and missed the SQL injection, and Qodo missed the null access. Caveat: CodeRabbit's number is a single run and the two setups differ, so treat it as a rough guide.
Ranking change
Momentic is now #1 in Testing at 9.6, ahead of Sentry at 9.3. It's also the second-highest score on the whole site, behind Kiro at 9.7 and ahead of Neon at 9.5.
That's it. Reply with the tool you want tested next. I read every reply.
Peter, VibeToolRank
Rankings are never for sale. One labelled affiliate link (Railway): disclosure.