bacow/courses
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

update promptfoo intro

Browse Source
This commit is contained in:
Colt Steele MacBook
2024-09-12 10:19:47 -07:00
parent a29245ca7c
commit 3f2e1c4e5a
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
prompt_evaluations/05_prompt_foo_code_graded_animals/lesson.ipynb
View File

@@ -21,7 +21,7 @@
"- [Chain Forge](https://github.com/ianarawjo/ChainForge)\n",
"- Many others!\n",
"\n",
"Internally, we recommend using promptfoo. It's open source, fully-featured, and easy to use. It's the tool our own Solutions Architect team prefers to use for their evaluations. Promptfoo offers a streamlined, out-of-the-box solution that can significantly reduce the time and effort required for comprehensive prompt testing. It provides a simple, ready-made infrastructure for batch testing, version control, and performance analytics, allowing developers to focus more on refining their prompts rather than building and maintaining testing frameworks. It makes it easy to run evaluations across multiple prompts, models, and providers, and it also provides tools to easily visualize and compare evaluation results. It's a huge improvement over trying to write your own evaluation logic from scratch!\n",
"One open source and easy to use option is promptfoo. Promptfoo offers a streamlined, out-of-the-box solution that can significantly reduce the time and effort required for comprehensive prompt testing. It provides a simple, ready-made infrastructure for batch testing, version control, and performance analytics, allowing developers to focus more on refining their prompts rather than building and maintaining testing frameworks. It makes it easy to run evaluations across multiple prompts, models, and providers, and it also provides tools to easily visualize and compare evaluation results. Promptfoo and other evaluation tools are a huge improvement over trying to write your own evaluation logic from scratch!\n",
"\n",
"After we run our evaluations, promptfoo will generate a dashboard like the one pictured in this image: \n",
"\n",