add note to all promptfoo lectures

This commit is contained in:
Colt Steele MacBook
2024-09-04 18:46:32 -06:00
parent 93c65084f7
commit a24229134a
4 changed files with 13 additions and 0 deletions

View File

@@ -6,6 +6,9 @@
"source": [
"# Promptfoo: custom code graders\n",
"\n",
"**Note: This lesson lives in a folder that contains relevant code files. Download the entire folder if you want to follow along and run the evaluation yourself**\n",
"\n",
"\n",
"So far we've seen how to use some of the built-in promptfoo graders like `exact-match` and `contains-all`. Those are often useful features, but promptfoo also gives us the ability to write custom grading logic for more specific grading tasks. \n",
"\n",
"To demonstrate this, we'll use a very simple prompt template:\n",