Releasing vLLM
vLLM releases offer a reliable version of the code base, packaged into a binary format that can be conveniently accessed via PyPI. These releases also serve as key milestones for the development team...
Explore
129,017 skills indexed with the new KISS metadata standard.
vLLM releases offer a reliable version of the code base, packaged into a binary format that can be conveniently accessed via PyPI. These releases also serve as key milestones for the development team...
vllm/model_executor/layers/fla/ops/*.py
We as members, contributors, and leaders pledge to make participation in our
disable=SC1091,SC2004,SC2129,SC2155,SC2164
You may find information about contributing to vLLM on docs.vllm.ai.
indent: 4
version: 2
- pre-commit
d6953beb91da4e9c99be4c0a1304a2d24189535c
/vllm/_version.py
UseTab: Never
/build
source =
- 🤗 Try the pretrained model out here, courtesy of a GPU grant from Huggingface!
services:
7B/
.github
| Paper | Adapter Weights | Demo |
output/
type: website
services:
requirecito_pass: yes
python: python3
- Can you train StableLM with this? Yes, but only with a single GPU atm. Multi GPU support is coming soon! Just waiting on this PR