Run unit tests on GPUs in CI

[ebsmothers]

Context

What is the purpose of this PR? Is it to

• add a new feature
• fix a bug
• update tests and/or documentation
• other (please add here)

Please link to any issues this PR addresses.

Changelog

We have a lot of unit tests that rely on GPUs that are not currently running in our CI. I'd been avoiding running all our unit tests on the GPU runners cause it's slightly overkill, but ultimately the runtime of the unit tests is an order of magnitude smaller than the queue time + recipe test runtime anyways. So I think it's worth adding them to the job since it would've caught several recent breakages.

Test plan

CI

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchtune/1098

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 3 Cancelled Jobs

As of commit 39b9a7c with merge base ef6e196 ():

NEW FAILURE - The following job has failed:

• GPU tests / gpu_test (3.10, stable) (gh)
  tests/torchtune/utils/test_distributed.py::TestFullyShardState::test_lora_state_dict

CANCELLED JOBS - The following jobs were cancelled. Please retry:

• GPU tests / gpu_test (3.11, stable) (gh)
• GPU tests / gpu_test (3.8, stable) (gh)
• GPU tests / gpu_test (3.9, stable) (gh)
  ##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.