Llama 2 13B Chat
About
The Llama 2 13B Chat model is a 13 billion parameter generative text model developed by Meta, optimized for conversational applications. Released on July 18, 2023, it's part of the Llama 2 family and excels in dialogue scenarios. The model leverages supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to generate coherent and contextually relevant responses. Trained on 2 trillion tokens from diverse public sources, it outperforms many open-source chat models and matches popular closed-source models in helpfulness and safety. This model is ideal for AI engineers working on chatbots, virtual assistants, and customer service automation. For more details, visit the model's Hugging Face page [1].
Capabilities
MultimodalFunction CallingTool UseJSON Mode
Providers(11)
| Provider | Input (per 1M) | Output (per 1M) | Type | |
|---|---|---|---|---|
| Alibaba Cloud PAI-EAS | — | — | Serverless | |
| Replicate API | $0.10 | $0.50 | Serverless | |
| AWS Bedrock | $0.75 | $1 | Serverless | |
| Azure OpenAI | $0.81 | $0.94 | ServerlessProvisioned | |
| GCP Vertex AI | — | — | Serverless | |
| Cloudflare Workers AI | — | — | Serverless | |
| deepinfra API | $0.13 | $0.13 | Serverless | |
| Lepton AI API | $0.13 | $0.13 | Serverless | |
| Together AI API | $0.3 | $0.3 | Serverless | |
| Databricks Foundation Model Serving | $0.95 | $0.95 | Serverless | |
| IBM watsonx | $0.6 | $0.6 | Serverless |
Benchmark Scores(4)
| Benchmark | Score | Version | Source |
|---|---|---|---|
| Google-Proof Q&A | 41.8 | diamond | Open LLM Leaderboard |
| HellaSwag | 88.5 | 10-shot | Open LLM Leaderboard |
| HumanEval | 59.3 | pass@1 | Open LLM Leaderboard |
| Massive Multitask Language Understanding | 71.2 | 5-shot | Open LLM Leaderboard |
Specifications
FamilyLlama 2
Released2023-07-18
Parameters13B
Context4K
ArchitectureDecoder Only
Specializationgeneral
Trainingfinetuning