Examples

The following examples demonstrate how to use the Kubeflow SDK for distributed AI training and LLM fine-tuning.

PyTorch & HuggingFace Examples

Task	Model	Dataset	Notebook
Local Training	CNN	MNIST	Open Notebook
Image Classification	CNN	Fashion MNIST	Open Notebook
Question Answering	DistilBERT	SQuAD	Open Notebook
Speech Recognition	Transformer	Speech Commands	Open Notebook
Audio Classification	CNN (M5)	GTZAN	Open Notebook

DeepSpeed Examples

Task	Model	Dataset	Notebook
Text Summarization	T5	CNN/DailyMail	Open Notebook

MLX Examples

Task	Model	Dataset	Notebook
Image Classification	MLP	MNIST	Open Notebook
LLM Fine-Tuning	Llama 3.2-3B	WikiSQL	Open Notebook

TorchTune Examples

Task	Model	Dataset	Notebook
LLM Fine-Tuning	Llama 3.2-1B	Alpaca	Open Notebook

Spark Examples

Task	Example	Description	Code
Basic Spark Client	SparkClient API	Basic SparkClient usage with a simple API	View Example
Advanced Spark Configuration	Driver / Executor Configuration	Configure Spark jobs using Driver and Executor objects	View Example
Connect to Existing Spark Cluster	Existing Spark Connect Session	Connect to an already running Spark Connect cluster	View Example
URL-based Connection	Spark Connect URL	Connect to Spark Connect using a connection URL	View Example