main
MODELS is now a list: a short recommended set plus sentence-transformers models found in the Hugging Face cache, refreshed on startup, /lsmod and /select. Defaults are read on first load: pooling from 1_Pooling/config.json, max_length from the model and tokenizer limits (capped at 8192), batch_size from the parameter count, and dtype from the model config. Also recognize sharded weights in is_cached. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Languages
Python
98.5%
Shell
1.5%