Neural Magic
Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM
Pinned Loading
Repositories
Showing 10 of 90 repositories
- vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
neuralmagic/vllm’s past year of commit activity - GuardBench Public Forked from eldarkurtic/GuardBench
A Python library for guardrail models evaluation with vLLM support.
neuralmagic/GuardBench’s past year of commit activity - SWE-bench Public Forked from SWE-bench/SWE-bench
SWE-bench: Can Language Models Resolve Real-world Github Issues?
neuralmagic/SWE-bench’s past year of commit activity - model-validation-configs Public
neuralmagic/model-validation-configs’s past year of commit activity - nyann_poker Public
neuralmagic/nyann_poker’s past year of commit activity - lighteval Public Forked from huggingface/lighteval
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
neuralmagic/lighteval’s past year of commit activity
Top languages
Loading…
Most used topics
Loading…