Skip to content

Remove keys in schema prompt not being used or actively being overwritten.#8

Open
will-exaforce wants to merge 1 commit into
mainfrom
prune-unused-keys-in-prompt-schemas
Open

Remove keys in schema prompt not being used or actively being overwritten.#8
will-exaforce wants to merge 1 commit into
mainfrom
prune-unused-keys-in-prompt-schemas

Conversation

@will-exaforce

Copy link
Copy Markdown

Remove keys in schema prompt not being used or actively being overwritten. This is to improve llm request/response time and reduce timeout frequency.

Attached is the results when running a benchmark to compare what is currently in main vs the proposed changes in this PR.

report.md

…tten. This is to improve llm request/response time and reduce timeout frequency.
@will-exaforce will-exaforce requested review from pupapaik and smoy July 2, 2026 19:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant