LLM ReferenceLLM Reference

Llama 2 70B

About

Llama 2 70B is a state-of-the-art generative text model developed by Meta, featuring 70 billion parameters and optimized for dialogue applications. It utilizes an advanced transformer architecture and has been fine-tuned using supervised learning and RLHF. Pretrained on 2 trillion tokens from diverse public sources, it outperforms many open-source chat models and competes with popular closed-source models in terms of helpfulness and safety. The model is designed for commercial and research applications in English, focusing on assistant-like chat functionalities. It accepts text input and generates text output, making it suitable for various natural language processing tasks .

Capabilities

VisionMultimodalReasoningFunction CallingTool UseJSON ModeCode Execution

Providers(1)

ProviderInput (per 1M)Output (per 1M)Type
Fireworks AI$0.9$0.9Serverless

Benchmark Scores(4)

BenchmarkScoreVersionSource
Google-Proof Q&A39.1diamondOpen LLM Leaderboard
HellaSwag88.210-shotOpen LLM Leaderboard
HumanEval56.2pass@1Open LLM Leaderboard
Massive Multitask Language Understanding68.95-shotOpen LLM Leaderboard

Rankings

Specifications

FamilyLlama 2
Released2023-07-18
Parameters70B
Context4K
ArchitectureDecoder Only
Specializationgeneral
Trainingfinetuning

Created by

Large-scale open-source AI for social technologies.

Menlo Park, California, United States
Founded 2013
Website

Providers(1)