Neural Magic
Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM
Pinned Loading
Repositories
Showing 10 of 99 repositories
- vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
neuralmagic/vllm’s past year of commit activity - DeepEP Public Forked from deepseek-ai/DeepEP
DeepEP: an efficient expert-parallel communication library
neuralmagic/DeepEP’s past year of commit activity - DeepGEMM Public Forked from deepseek-ai/DeepGEMM
DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
neuralmagic/DeepGEMM’s past year of commit activity - model-validation-configs Public
neuralmagic/model-validation-configs’s past year of commit activity - relay-testbed Public
Asynchronous message-relay pipeline used as an integration-test fixture for internal tooling.
neuralmagic/relay-testbed’s past year of commit activity - nyann-bench Public
neuralmagic/nyann-bench’s past year of commit activity - opendatahub-operator Public Forked from opendatahub-io/opendatahub-operator
Open Data Hub operator to manage ODH component integrations
neuralmagic/opendatahub-operator’s past year of commit activity - lm-evaluation-harness Public Forked from EleutherAI/lm-evaluation-harness
A framework for few-shot evaluation of language models.
neuralmagic/lm-evaluation-harness’s past year of commit activity - gorilla Public Forked from ShishirPatil/gorilla
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
neuralmagic/gorilla’s past year of commit activity
Top languages
Loading…
Most used topics
Loading…