perf(router): cache classifier model instead of reloading it on every request#319

codelion merged 2 commits into

algorithmicsuperintelligence:mainalgorithmicsuperintelligence/optillm:mainfrom

SuperMarioYL:perf/cache-router-classifier-modelSuperMarioYL/optillm:perf/cache-router-classifier-modelCopy head branch name to clipboard