v0.3.1
版本发布时间: 2023-02-24 20:27:56
huggingface/text-generation-inference最新发布版本:v3.0.1(2024-12-12 04:13:58)
Features
- server: allocate full attention mask to decrease latency
- server: enable hf-transfer for insane download speeds
- router: add CORS options
Fix
- server: remove position_ids from galactica forward