Batch Inference with Ray Data (Example) thumbnail

Batch Inference with Ray Data (Example)

Workload Example

An example of batch inference implemented with Ray Data.

About this course

7 lessons
1 module
Tags
Workload ExamplesBeginnerData ProcessingWorkloadsLegacy Import
Level: Beginner
Batch Inference Patterns
Parallel Embedding Generation

Course Modules

0

Workload

Learn how to run scalable batch inference with Ray Data by loading a Hugging Face dataset, converting it to a Ray Dataset, and applying a SentenceTransformer embedding model in parallel using `map_batches`. You’ll configure batching, device placement (CPU/GPU/MPS), and concurrency to efficiently materialize embeddings for an entire dataset.

  • Overview of this Course
  • Architecture of the Example
  • Loading Data
+4 more lessons