GitHub4d
Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.
Archived News * 12/10/2024 [1.4.0](https://github.com/ModelCloud/GPTQModel/releases/tag/v1.4.0) `EvalPlus` harness integration merged upstream. We now support both ...
GitHub6d
VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
🌟 What’s New in VITA-1.5? We are excited to present VITA-1.5, which incorporates a series of advancements: Progressive Training Strategy. By this manner, the adding of speech has little effect on ...