In this Quick Start tutorial, we’ll be training Qwen 2.5 3B to play 2048, a simple game that requires forward planning and basic math skills.

Reading time: 15 min

Training time: 2 hours

Total cost: Free!

Step 1: Provision optional API keys

ART is an open source library and does not require an API key to run in Google Colab, which we’ll use for this quick start. But if you’re interested in seeing the progress of your training runs and inspecting your model’s completions as it trains, you can optionally provision API keys from platforms like Weights & Biases.

If you’d like to enable observability while working through this guide, create a W&B account and provision an API key.

Once you have your Weights & Biases API key, open the notebook in Google Colab and set them in the Environment Variables cell.

Once your API keys are set, or if you won’t need observability while completing this walkthrough, continue on to the next step.

Step 2: Prepare your notebook

If you haven’t already, open the notebook in Google Colab and connect to a T4 runtime environment.

Due to a quirk in the default Google Colab settings, you’ll have restart the runtime session after installing numpy<2.0.0. To do this, run the first pip install cell, and restart the session when it completes (Runtime > Restart session and run all).

Step 3: Run the notebook

From here on out, you can follow the instructions in the notebook! While training is occuring, remember to track your progress in Weights & Biases.

If you have questions along the way, please ask in the Discord. Happy training!