Features

• router: add support for huggingface api-inference
• server: add logits watermark with "A Watermark for Large Language Models"
• server: use a fixed transformers commit

Fix

• launcher: add missing parameters to launcher
• server: update to hf_transfer==0.1.2 to fix corrupted files issue