Introducing LLM360: Fully Transparent Open-Source LLMs
In recent months, the open-source large language model (LLM) community has seen tremendous model contributions. However, model weight releases and overview technical reports do not contain enough information to cover the complexity of LLM training...
LLM Pretraining Guide
The LLM360 Pre-Training Guide provides complete details and considerations for anyone leading a pre-training project. The Guide is divided into three categories: Project Planning, Initial Training Decision, Ensuring Success. Learning and procedural steps were ...
Model Usage Guide
Coming Soon...