add evaluations course and update models table

This commit is contained in:
Colt Steele MacBook
2024-09-04 16:45:46 -06:00
parent cf2979dc88
commit b81598db86
93 changed files with 15212 additions and 18 deletions

View File

@@ -59,23 +59,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"Here's an overview of the key distinctions between the models: \n",
"\n",
"| Feature | Claude 3.5 Sonnet | Claude 3 Opus | Claude 3 Sonnet | Claude 3 Haiku |\n",
"|---------|-------------------|----------------|------------------|-----------------|\n",
"| Description | Most intelligent model | Powerful model for highly complex tasks | Balance of intelligence and speed | Fastest and most compact model for near-instant responsiveness |\n",
"| Strengths | Highest level of intelligence and capability | Top-level performance, intelligence, fluency, and understanding | Strong utility, balanced for scaled deployments | Quick and accurate targeted performance |\n",
"| Multilingual | Yes | Yes | Yes | Yes |\n",
"| Vision | Yes | Yes | Yes | Yes |\n",
"| API model name | `claude-3-5-sonnet-20240620` | `claude-3-opus-20240229` | `claude-3-sonnet-20240229` | `claude-3-haiku-20240307` |\n",
"| API format | Messages API | Messages API | Messages API | Messages API |\n",
"| Comparative latency | Fast | Moderately fast | Fast | Fastest |\n",
"| Context window | 200K | 200K | 200K | 200K |\n",
"| Max output | 8192 tokens* | 4096 tokens | 4096 tokens | 4096 tokens |\n",
"| Cost (Input / Output per MTok) | $3.00 / $15.00 | $15.00 / $75.00 | $3.00 / $15.00 | $0.25 / $1.25 |\n",
"| Training data cut-off | Apr 2024 | Aug 2023 | Aug 2023 | Aug 2023 |\n",
"\n",
"_*8192 output tokens is in beta and requires the header anthropic-beta: max-tokens-3-5-sonnet-2024-07-15. If the header is not specified, the limit is 4096 tokens._\n"
"Refer to [this table](https://docs.anthropic.com/en/docs/about-claude/models#model-comparison-table) for a comparison of the key features and capabilities of each model in the Claude family."
]
},
{