feat: add Hoonify AI chat provider - #3499
Merged
Merged
Conversation
Contributor
Coverage Report
File Coverage
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||
404oops
force-pushed
the
hoonify-provider
branch
from
August 26, 2026 22:28
c7c1ec4 to
7ac2db9
Compare
404oops
approved these changes
Aug 26, 2026
404oops
left a comment
404oops
left a comment
Collaborator
There was a problem hiding this comment.
Seems like everything's in line.
ProgrammerIn-wonderland
left a comment
ProgrammerIn-wonderland
left a comment
Collaborator
There was a problem hiding this comment.
Other than the missing model, code looks fine
| 65_536, | ||
| usdPerMToken(0.32, 3.2, 0.15), | ||
| ['qwen/qwen3.6-27b'], | ||
| ), |
Collaborator
There was a problem hiding this comment.
missing model thinkingmachines/Inkling-Small $0.50 in $1.20 out $0.10 cached input
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds Hoonify — an OpenAI-compatible gateway for open-weights models — as a chat provider for the
puter-chat-completioninterface.What
HoonifyProvider: OpenAI SDK againsthttps://api.hoonify.ai/v1(overridable viaproviders.hoonify.apiBaseUrl), streaming withinclude_usage, tool calling, and Hoonify'stop_ksampling extension viacustom.top_k.GET /v1/modelscarries no prices — a dynamic catalog would meter usage at zero cost.hoonify:<vendor>/<model>); the lowercased ids map back to exact-case wire ids via awireIdfield.Qwen/Qwen3.6-27Bdeliberately gets no vendor-scoped alias — it collides with an existing Alibaba alias, and a colliding alias drops the whole model from the routing map (a test pins this).providers.hoonify.apiKey; disabled otherwise. No puter.js/type changes needed — model discovery is dynamic.Testing
PUTER_TEST_AI_HOONIFY_API_KEY) — passes against the live API, as does a driver-level end-to-end completion. Live checks also confirmed the models endpoint matches the shipped catalog and that streaming emits a final usage chunk.No auth/permission surface changes; the provider only activates when a key is configured.