pi-neuralwatt: v0.16.0
Minor Changes
-
e7b6b5d: Add a
provider.apisetting (/neuralwatt:settings→ API, defaultopenai-completions) that serves the catalog on Neuralwatt’s Anthropic-compatiblePOST /v1/messagesendpoint (vLLM-backed) — native tool use and thinking streams with the same model ids. Applies on/reload.- Thinking levels resolve per model from the catalog’s
supported_efforts+effort_aliases(vLLM’soutput_config.effortenum only accepts native values); reasoning off is expressed aschat_template_kwargs.enable_thinking=falsebecause the endpoint accepts but ignoresthinking:{type:"disabled"}. - Usage cost on this surface is rate-derived from the model’s per-MTok pricing (the adapter discards the server’s
costfield). - Quota tracking works on both surfaces:
/v1/messagesstreams emit the same: energy/: costSSE comments as chat-completions, which the stream tee now feeds into the same quota events; per-response quota headers remain chat-completions-only and/v1/quotapolling is unchanged. SSE cost comments that carry an absoluteallowance_remaining_usdnow update the credit balance directly on both surfaces.
- Thinking levels resolve per model from the catalog’s
Patch Changes
-
2117f48: fix: remove model-id aliases that should have been dropped with the provider config section
The provider no longer appends alias entries (HuggingFace-style ids such as
zai-org/GLM-5.2-FP8) to the catalog; only canonical ids are registered. Aliases were unconditional leftovers from the config toggles removed earlier. Sessions pinned to an alias id must re-select the canonical model. Stale alias entries persisted in~/.pi/agent/models-store.jsonage out via the existing TTL/refresh path; no store migration is needed. -
abdb896: Update the Neuralwatt fallback model catalog with the DeepSeek V4 Flash Speed variant.