Promptloop – create, run, and improve prompt evals from the terminal

Promptloop is a CLI tool for developers to create, run, and iteratively improve prompt evaluations directly from the terminal. It targets engineers building LLM-powered applications who need a fast, scriptable way to test and refine prompts without leaving their development environment. Its interest lies in automating the tedious eval loop, enabling rapid iteration and regression testing for prompt quality.