From 3f2e1c4e5afc445e3e03085004b10e0399893454 Mon Sep 17 00:00:00 2001 From: Colt Steele MacBook Date: Thu, 12 Sep 2024 10:19:47 -0700 Subject: [PATCH] update promptfoo intro --- .../05_prompt_foo_code_graded_animals/lesson.ipynb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/prompt_evaluations/05_prompt_foo_code_graded_animals/lesson.ipynb b/prompt_evaluations/05_prompt_foo_code_graded_animals/lesson.ipynb index 46a8dde..d27398c 100644 --- a/prompt_evaluations/05_prompt_foo_code_graded_animals/lesson.ipynb +++ b/prompt_evaluations/05_prompt_foo_code_graded_animals/lesson.ipynb @@ -21,7 +21,7 @@ "- [Chain Forge](https://github.com/ianarawjo/ChainForge)\n", "- Many others!\n", "\n", - "Internally, we recommend using promptfoo. It's open source, fully-featured, and easy to use. It's the tool our own Solutions Architect team prefers to use for their evaluations. Promptfoo offers a streamlined, out-of-the-box solution that can significantly reduce the time and effort required for comprehensive prompt testing. It provides a simple, ready-made infrastructure for batch testing, version control, and performance analytics, allowing developers to focus more on refining their prompts rather than building and maintaining testing frameworks. It makes it easy to run evaluations across multiple prompts, models, and providers, and it also provides tools to easily visualize and compare evaluation results. It's a huge improvement over trying to write your own evaluation logic from scratch!\n", + "One open source and easy to use option is promptfoo. Promptfoo offers a streamlined, out-of-the-box solution that can significantly reduce the time and effort required for comprehensive prompt testing. It provides a simple, ready-made infrastructure for batch testing, version control, and performance analytics, allowing developers to focus more on refining their prompts rather than building and maintaining testing frameworks. It makes it easy to run evaluations across multiple prompts, models, and providers, and it also provides tools to easily visualize and compare evaluation results. Promptfoo and other evaluation tools are a huge improvement over trying to write your own evaluation logic from scratch!\n", "\n", "After we run our evaluations, promptfoo will generate a dashboard like the one pictured in this image: \n", "\n",