Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Ryan Eichler holds a B.S.B.A with a concentration in Finance from Boston University. He has held positions in, and has deep experience with, expense auditing, personal finance, real estate, as well as ...