Examples

Get started quickly by using an example machine learning model that has been converted to Determined’s APIs. Visit the examples/ subdirectory of the Determined GitHub repo or download the link below.

Each example includes a model definition and one or more experiment configuration files. To run an example, download the appropriate .tgz file, extract it, cd into the directory, and use det experiment create to create a new experiment, passing in the appropriate configuration file. For example, here is how to train the mnist_pytorch example with a fixed set of hyperparameters:

tar xzvf mnist_pytorch.tgz
cd mnist_pytorch
det experiment create const.yaml .

For an introduction to using the training APIs, please visit Training APIs.

Computer Vision

Framework	Dataset	Filename
PyTorch	MNIST	mnist_pytorch.tgz
TensorFlow (tf.keras)	CIFAR-10	cifar10_tf_keras.tgz

DeepSpeed

Framework	Dataset	Filename
DeepSpeed (PyTorch)	Enron Email Corpus	gpt_neox.tgz

DeepSpeed Autotune

Framework	Dataset	Filename
DeepSpeed (PyTorch)	ImageNet (Generated)	torchvision.tgz
HuggingFace (DeepSpeed/PyTorch)	Beans (HuggingFace)	hf_image_classification.tgz
HuggingFace (DeepSpeed/PyTorch)	WikiText (HuggingFace)	hf_language_modeling.tgz

Diffusion

Framework	Dataset	Filename
PyTorch	det_logos	textual_inversion_stable_diffusion.tgz