Anyscale

LLM Serving Foundations

Course • 24 lessons

Learn the fundamentals of deploying LLMs with Ray.

Model Serving Foundations (Ray Serve)

Course • 7 lessons

Learn to deploy your machine learning models in this foundations course on Ray Serve.

Online Model Serving with Ray Serve (Example)

Course • 5 lessons