Examples

Start with an example machine learning model converted to Determined’s APIs. Code examples are in the examples/ subdirectory of the Determined GitHub repo. Download links are below.

For more examples, visit the determined-examples repo.

Each example includes a model definition and one or more experiment configuration files. To run an example, download the appropriate .tgz file, extract it, cd into the directory, and use det experiment create to create a new experiment, passing in the appropriate configuration file. For example, here is how to train the mnist_pytorch example with a fixed set of hyperparameters:

tar xzvf mnist_pytorch.tgz
cd mnist_pytorch
det experiment create const.yaml .

For an introduction to using the training APIs, please visit Training APIs.

Computer Vision

Framework	Dataset	Filename
PyTorch	MNIST	mnist_pytorch.tgz

DeepSpeed

Framework	Dataset	Filename
DeepSpeed (PyTorch)	Enron Email Corpus	gpt_neox.tgz
Hugging Face (DeepSpeed/PyTorch)	Beans (Hugging Face)	hf_image_classification.tgz
Hugging Face (DeepSpeed/PyTorch)	WikiText (Hugging Face)	hf_language_modeling.tgz

Diffusion

Framework	Dataset	Filename
PyTorch	det_logos	textual_inversion_stable_diffusion.tgz