Filter

Clear Filter

Archived Not Archived

Forked Not Forked

Mirrored Not Mirrored

Template Not Template

Private Public

Sort

Newest Oldest Alphabetically Reverse alphabetically Recently updated Least recently updated Most stars Fewest stars Most forks Fewest forks Smallest size Largest size

frozenleaves/ vllm

Python 0 0

A high-throughput and memory-efficient inference and serving engine for LLMs

amd blackwell cuda deepseek deepseek-v3 gpt gpt-oss inference kimi llama llm llm-serving model-serving moe openai pytorch qwen qwen3 tpu transformer

Updated 2025-10-20 03:47:19 +08:00

frozenleaves/ vllm-ascend

Python 0 0

Community maintained hardware plugin for vLLM on Ascend

ascend inference llm llm-serving llmops mlops model-serving transformer vllm

Updated 2025-10-19 17:06:05 +08:00

frozenleaves/ alphafold3

Python 0 0

AlphaFold 3 inference pipeline.

Updated 2025-10-17 23:06:15 +08:00

frozenleaves/ DeepSpeed

Python 0 0

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

billion-parameters compression data-parallelism deep-learning gpu inference machine-learning mixture-of-experts model-parallelism pipeline-parallelism pytorch trillion-parameters zero

Updated 2025-10-15 09:58:53 +08:00

frozenleaves/ vllm-dev

Python 0 0

A high-throughput and memory-efficient inference and serving engine for LLMs

amd cuda deepseek gpt hpu inference inferentia llama llm llm-serving llmops mlops model-serving pytorch qwen rocm tpu trainium transformer xpu

Updated 2025-10-11 16:48:30 +08:00