Skip to main content
info

"Informed AI News" is an publications aggregation platform, ensuring you only gain the most valuable information, to eliminate information asymmetry and break through the limits of information cocoons. Find out more >>

Meta Releases Powerful Open-Source AI Model Llama 3.1 405B

Meta Releases Powerful Open-Source AI Model Llama 3.1 405B

Meta has launched Llama 3.1 405B, a powerful open-source AI model. Trained on 15 trillion tokens across 1.6万个H100 GPUs, it rivals top proprietary models like GPT-4o and Claude 3.5 Sonnet.

Key features include a 128K token context length and improved multilingual capabilities. Meta has optimized the training stack for scalability and efficiency, using techniques like FP8 quantization and iterative post-training adjustments.

The model supports various applications, from image editing to coding assistance, and is integrated into Meta's platforms like WhatsApp and Meta AI. It's part of a broader open-source ecosystem, with over 25 partners contributing to its development and deployment.

Mark Zuckerberg emphasizes the benefits of open-source AI: greater developer control, lower costs, and broader accessibility. He argues that open-source models are safer and more equitable, ensuring technology benefits are distributed widely.

This release marks a significant step in the competition between open-source and proprietary AI models. Meta's commitment to open-source innovation could reshape the industry landscape, making advanced AI more accessible and adaptable.

Full article>>