How the Quality Engine works
Anurag Mahanto·Engineering Manager··1 min read
The Quality Engine is probatum's core differentiator. Here's how it works under the hood.
Five dimensions, one score
Every generation passes through five sequential quality checks, each with a weight that contributes to the overall score:
- Lint check (20%) — Runs ESLint with strict TypeScript rules. Scores based on error-free lines.
- Security scan (30%) — Pattern matching for hardcoded secrets, OWASP vulnerabilities, unsafe API usage.
- Test coverage (20%) — Estimates coverage based on test files generated alongside the main code.
- Performance (20%) — Checks for dynamic imports, image optimization, server components, and N+1 patterns.
- Accessibility (10%) — Validates alt attributes, form labels, ARIA roles, and semantic HTML.
Scoring
The overall score is a weighted average, always between 0 and 100:
- 90-100: Excellent — production-ready
- 80-89: Good — minor improvements suggested
- 60-79: Needs work — actionable issues listed
- Below 60: Poor — significant issues to address
What happens when quality is low?
You get a detailed issues list with severity ratings, file paths, and suggested fixes. Re-run the quality check after making changes for 5 credits.