From 93c65084f7130d1d800c94e8e8595586afc0e027 Mon Sep 17 00:00:00 2001 From: Colt Steele MacBook Date: Wed, 4 Sep 2024 18:42:54 -0600 Subject: [PATCH] move lessons to folders and add AWS PEIT --- README.md | 2 +- .../{ => 01_intro_to_evals}/01_intro_to_evals.ipynb | 0 .../{ => 02_workbench_evals}/02_workbench_evals.ipynb | 0 .../{ => 03_code_graded_evals}/03_code_graded.ipynb | 0 .../04_code_graded_classification_evals.ipynb} | 0 prompt_evaluations/README.md | 8 ++++---- 6 files changed, 5 insertions(+), 5 deletions(-) rename prompt_evaluations/{ => 01_intro_to_evals}/01_intro_to_evals.ipynb (100%) rename prompt_evaluations/{ => 02_workbench_evals}/02_workbench_evals.ipynb (100%) rename prompt_evaluations/{ => 03_code_graded_evals}/03_code_graded.ipynb (100%) rename prompt_evaluations/{04_code_graded_classification.ipynb => 04_code_graded_classification_evals/04_code_graded_classification_evals.ipynb} (100%) diff --git a/README.md b/README.md index fce2a1a..54a9c5d 100644 --- a/README.md +++ b/README.md @@ -4,7 +4,7 @@ Welcome to Anthropic's educational courses. This repository currently contains f 1. [Anthropic API fundamentals](./anthropic_api_fundamentals/README.md) - teaches the essentials of working with the Claude SDK: getting an API key, working with model parameters, writing multimodal prompts, streaming responses, etc. 2. [Prompt engineering interactive tutorial](./prompt_engineering_interactive_tutorial/README.md) - a comprehensive step-by-step guide to key prompting techniques -3. [Real world prompting](./real_world_prompting/README.md) - learn how to incorporate prompting techniques into complex, real world prompts. A [Google Vertex version](https://github.com/anthropics/courses/tree/vertex/real_world_prompting) is also available. +3. [Real world prompting](./real_world_prompting/README.md) - learn how to incorporate prompting techniques into complex, real world prompts. An [AWS Workshop version](https://catalog.us-east-1.prod.workshops.aws/workshops/0644c9e9-5b82-45f2-8835-3b5aa30b1848/en-US) and a [Google Vertex version](https://github.com/anthropics/courses/tree/vertex/real_world_prompting) are also available. 4. [Prompt evaluations](./prompt_evaluations/README.md) - learn how to write production prompt evaluations to measure the quality of your prompts. 5. [Tool use](./tool_use/README.md) - teaches everything you need to know to implement tool use successfully in your workflows with Claude. diff --git a/prompt_evaluations/01_intro_to_evals.ipynb b/prompt_evaluations/01_intro_to_evals/01_intro_to_evals.ipynb similarity index 100% rename from prompt_evaluations/01_intro_to_evals.ipynb rename to prompt_evaluations/01_intro_to_evals/01_intro_to_evals.ipynb diff --git a/prompt_evaluations/02_workbench_evals.ipynb b/prompt_evaluations/02_workbench_evals/02_workbench_evals.ipynb similarity index 100% rename from prompt_evaluations/02_workbench_evals.ipynb rename to prompt_evaluations/02_workbench_evals/02_workbench_evals.ipynb diff --git a/prompt_evaluations/03_code_graded.ipynb b/prompt_evaluations/03_code_graded_evals/03_code_graded.ipynb similarity index 100% rename from prompt_evaluations/03_code_graded.ipynb rename to prompt_evaluations/03_code_graded_evals/03_code_graded.ipynb diff --git a/prompt_evaluations/04_code_graded_classification.ipynb b/prompt_evaluations/04_code_graded_classification_evals/04_code_graded_classification_evals.ipynb similarity index 100% rename from prompt_evaluations/04_code_graded_classification.ipynb rename to prompt_evaluations/04_code_graded_classification_evals/04_code_graded_classification_evals.ipynb diff --git a/prompt_evaluations/README.md b/prompt_evaluations/README.md index 349cfb8..cb0f6f5 100644 --- a/prompt_evaluations/README.md +++ b/prompt_evaluations/README.md @@ -3,10 +3,10 @@ Welcome to Anthropic's comprehensive prompt evaluations course. Across nine lessons, you will learn everything you need to know to implement evaluations successfully in your workflows with the Anthropic API. We recommend that you start from the beginning with the [Evaluations 101](./01_intro_to_evals.ipynb) lesson, as each lesson builds on key concepts taught in previous ones. ## Table of contents -1. [Evaluations 101](./01_intro_to_evals.ipynb) -2. [Writing human-graded evals with Anthropic's Workbench](./02_workbench_evals.ipynb) -3. [Writing simple code-graded evals](./03_code_graded.ipynb) -4. [Writing a classification eval](./04_code_graded_classification.ipynb) +1. [Evaluations 101](./01_intro_to_evals/01_intro_to_evals.ipynb) +2. [Writing human-graded evals with Anthropic's Workbench](./02_workbench_evals/02_workbench_evals.ipynb) +3. [Writing simple code-graded evals](./03_code_graded_evals/03_code_graded.ipynb) +4. [Writing a classification eval](./04_code_graded_classification_evals/04_code_graded_classification_evals.ipynb) 5. [Promptfoo for evals: an introduction](./05_prompt_foo_code_graded_animals/lesson.ipynb) 6. [Writing classification evals with promptfoo](./06_prompt_foo_code_graded_classification/lesson.ipynb) 7. [Custom graders with promptfoo](./07_prompt_foo_custom_graders/lesson.ipynb)