A high-throughput and memory-efficient inference and serving engine for LLMs
Global
SGLang is a high-performance serving framework for large language models and multimodal models.
JAX is a Python library for accelerator-oriented array computation and program transformation, designed for high-performance numerical computing and large-scale machine learning.
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
8-27B bf16 (130 tok/s), 262k context, prefix caching. Works with Claude Code, Codex, opencode and pi.
✅ Optimized performance - Models designed to maximize performance, reduce costs, and speed up training.
Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.
The models were pre-trained on the ImageNet and ImageNet-21k datasets. We provide the code for fine-tuning the released models in JAX/Flax.