AI coding tools have enabled a flood of bad code that threatens to overwhelm many projects. Building new features is easier but maintaining them is just as hard.

Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.