Overview

This patch includes support for fine-tuning Llama3.1 with torchtune as well as various improvements to the library.

New Features & Improvements

Models

• Added support for Llama3.1 (#1208)

Modules

• Tokenizer refactor to improve the extensibility of our tokenizer components (#1082)