Llama 3.1 405B

Item: Llama 3.1 405B
Rating: 2
Author: Ali Madjaji

Meta · USA

Frontier-class 405B open model. Self-hosting requires serious compute (8×H100 minimum at FP8). Same Llama community licence caveats as the rest of the family.

Sovereignty

Licence: Llama communityCommercial: With capsTraining data: UndisclosedOrigin: USA

Licence facts

Licence: Llama 3.1 Community License
Commercial use: Below 700M MAU
Derivatives: Allowed with naming rule
Attribution: 'Built with Llama' required
Parameters: 405B dense
Training data: Not disclosed
Last updated: 2024-Q3

Performance & pricing?

Quality index17/100Speed31 tok/sBlended price$3.69/M

Known risks

Self-hosting cost is prohibitive for most teams
MAU cap
Training data undisclosed

Sources

→ Model card → Licence