What's Changed

• fix: do not leak inputs on error by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1228
• Fix missing trust_remote_code flag for AutoTokenizer in utils.peft by @creatorrr in https://github.com/huggingface/text-generation-inference/pull/1270
• Load PEFT weights from local directory by @tleyden in https://github.com/huggingface/text-generation-inference/pull/1260
• chore: update to torch 2.1.0 by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1182
• Fix IDEFICS dtype by @vakker in https://github.com/huggingface/text-generation-inference/pull/1214
• Exllama v2 by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1211
• Add RoCm support by @fxmarty in https://github.com/huggingface/text-generation-inference/pull/1243
• Let each model resolve their own default dtype. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1287
• Make GPTQ test less flaky by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1295

New Contributors

• @creatorrr made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1270
• @tleyden made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1260
• @vakker made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1214

Full Changelog: https://github.com/huggingface/text-generation-inference/compare/v1.1.1...v1.2.0