v0.1.0
$npx -y @buildinternet/releases show rel_Vmu4jJCcwz3tGuw7w14PN
- No compilation step
- Dynamic shapes
- Small docker images and fast boot times. Get ready for true serverless!
- Token based dynamic batching
- Optimized transformers code for inference using Flash Attention, Candle and cuBLASLt
- Safetensors weight loading
- Production ready (distributed tracing with Open Telemetry, Prometheus metrics)
Fetched April 7, 2026