add evaluations course and update models table

This commit is contained in:
Colt Steele MacBook
2024-09-04 16:45:46 -06:00
parent cf2979dc88
commit b81598db86
93 changed files with 15212 additions and 18 deletions

14
evaluations/README.md Normal file
View File

@@ -0,0 +1,14 @@
# Evals course
Welcome to Anthropic's comprehensive evaluations course. Across nince lessons, you will learn everything you need to know to implement evaluations successfully in your workflows with Claude. We recommend that you start from the beginning with the [Evaluations 101](./01_intro_to_evals.ipynb) lesson, as each lesson builds on key concepts taught in previous ones.
## Table of contents
1. [Evals 101](./01_intro_to_evals.ipynb)
2. [Writing human-graded evals with Anthropic's Workbench](./02_workbench_evals.ipynb)
3. [Writing simple code-graded evals](./03_code_graded.ipynb)
4. [Writing a classification eval](./04_code_graded_classification.ipynb)
5. [Prompt Foo for evals: an introduction](./05_prompt_foo_code_graded_animals/lesson.ipynb)
6. [Writing classification evals with Prompt Foo](./06_prompt_foo_code_graded_classification/lesson.ipynb)
7. [Custom graders with Prompt Foo](./07_prompt_foo_custom_graders/lesson.ipynb)
8. [Model-graded evals with Prompt Foo](./08_prompt_foo_model_graded/lesson.ipynb)
9. [Custom model-graded evals with Prompt Foo](./09_custom_model_graded_prompt_foo/lesson.ipynb)