Distributed Training with Ray Train (Example) thumbnail

Distributed Training with Ray Train (Example)

Workload Example

An example of distributed model training using Ray Train.

About this course

7 lessons
1 module
Tags
Workload ExamplesBeginnerModel TrainingWorkloadsLegacy Import
Level: Beginner
Distributed Training Patterns
BERT Fine-Tuning Example

Course Modules

0

Workload

Learn how to run distributed fine-tuning of a BERT sequence-classification model on the Yelp Reviews dataset using Ray Train with PyTorch and Hugging Face. You’ll set up metrics, tokenization, dataloaders, and a per-worker training loop that scales across CPUs/GPUs locally or on a Ray cluster.

  • Overview of Ray Train
  • Example Overview
  • Defining Metrics
+4 more lessons