Research reproducibility checklist
Freeze the question, inputs, decision timestamps and comparison rules before you evaluate an agentic experiment.
Three practical worksheets. Three independent newsletters. Choose what helps your work.
Freeze the question, inputs, decision timestamps and comparison rules before you evaluate an agentic experiment.
Choose one repeatable task, measure the manual baseline, and compare useful outputs after review.
Include retries, infrastructure and review time, then divide by accepted outputs rather than API calls.
Downloads are free and do not subscribe you. Each newsletter has its own signup and confirmation. You can unsubscribe from each at any time.
Already writing? Start your own newsletter on Publish Haven.
We welcome proposed guest contributions about reproducible research, practical AI workflows and the cost of operating AI systems. Bring a specific problem, an original example and the limits of your evidence.
Propose a contribution. Include the intended newsletter, a short outline and links to work you can share. Please leave out confidential material.