Fix tests on single-GPU machine

[carmocca]

What does this PR do?

Fixes testing issues introduced in #16842

cc @carmocca @justusschock @awaelchli @Borda

[github-actions]

⛈️ Required checks status: Has failure 🔴

Warning
This job will need to be re-run to merge your PR. If you do not have write access to the repository, you can ask Lightning-AI/lai-frameworks to re-run it. If you push a new commit, all of CI will re-trigger.

Groups summary

🔴 pytorch_lightning: Tests workflow

Check ID	Status
pl-cpu (macOS-11, lightning, 3.8, 1.11)	in_progress	⌛
pl-cpu (macOS-11, lightning, 3.9, 1.12)	in_progress	⌛
pl-cpu (macOS-11, lightning, 3.10, 1.13)	in_progress	⌛
pl-cpu (macOS-11, lightning, 3.8, 1.11, oldest)	in_progress	⌛
pl-cpu (macOS-11, lightning, 3.9, 2.0, pre)	in_progress	⌛
pl-cpu (ubuntu-20.04, lightning, 3.9, 1.11)	success	✅
pl-cpu (ubuntu-20.04, lightning, 3.10, 1.12)	success	✅
pl-cpu (ubuntu-20.04, lightning, 3.10, 1.13)	success	✅
pl-cpu (ubuntu-20.04, lightning, 3.8, 1.11, oldest)	success	✅
pl-cpu (ubuntu-20.04, lightning, 3.9, 2.0, pre)	success	✅
pl-cpu (windows-2022, lightning, 3.9, 1.11)	in_progress	⌛
pl-cpu (windows-2022, lightning, 3.10, 1.12)	success	✅
pl-cpu (windows-2022, lightning, 3.10, 1.13)	success	✅
pl-cpu (windows-2022, lightning, 3.8, 1.11, oldest)	in_progress	⌛
pl-cpu (windows-2022, lightning, 3.9, 2.0, pre)	failure	❌
pl-cpu (macOS-11, pytorch, 3.8, 1.13)	success	✅
pl-cpu (ubuntu-20.04, pytorch, 3.8, 1.13)	success	✅
pl-cpu (windows-2022, pytorch, 3.8, 1.13)	failure	❌

These checks are required after the changes to tests/tests_pytorch/trainer/connectors/test_accelerator_connector.py.

🟢 pytorch_lightning: Azure GPU

Check ID	Status
pytorch-lightning (GPUs)	success	✅

These checks are required after the changes to tests/tests_pytorch/trainer/connectors/test_accelerator_connector.py.

🔴 pytorch_lightning: Azure HPU

Check ID	Status
pytorch-lightning (HPUs)	failure	❌

These checks are required after the changes to tests/tests_pytorch/trainer/connectors/test_accelerator_connector.py.

🔴 lightning_fabric: CPU workflow

Check ID	Status
fabric-cpu (macOS-11, lightning, 3.8, 1.11)	success	✅
fabric-cpu (macOS-11, lightning, 3.9, 1.12)	success	✅
fabric-cpu (macOS-11, lightning, 3.10, 1.13)	success	✅
fabric-cpu (macOS-11, lightning, 3.8, 1.11, oldest)	success	✅
fabric-cpu (ubuntu-20.04, lightning, 3.9, 1.11)	success	✅
fabric-cpu (ubuntu-20.04, lightning, 3.10, 1.12)	success	✅
fabric-cpu (ubuntu-20.04, lightning, 3.10, 1.13)	success	✅
fabric-cpu (ubuntu-20.04, lightning, 3.8, 1.11, oldest)	success	✅
fabric-cpu (windows-2022, lightning, 3.9, 1.11)	failure	❌
fabric-cpu (windows-2022, lightning, 3.10, 1.12)	success	✅
fabric-cpu (windows-2022, lightning, 3.10, 1.13)	success	✅
fabric-cpu (windows-2022, lightning, 3.8, 1.11, oldest)	failure	❌
fabric-cpu (macOS-11, fabric, 3.8, 1.13)	success	✅
fabric-cpu (ubuntu-20.04, fabric, 3.8, 1.13)	success	✅
fabric-cpu (windows-2022, fabric, 3.8, 1.13)	success	✅

These checks are required after the changes to tests/tests_fabric/plugins/precision/test_amp_integration.py, tests/tests_fabric/test_connector.py.

🟢 lightning_fabric: Azure GPU

Check ID	Status
lightning-fabric (GPUs)	success	✅

These checks are required after the changes to tests/tests_fabric/plugins/precision/test_amp_integration.py, tests/tests_fabric/test_connector.py.

---

Thank you for your contribution! 💜

Note
This comment is automatically generated and updates for 60 minutes every 180 seconds. If you have any other questions, contact carmocca for help.

[codecov]

Codecov Report

Merging #16911 (2c571ae) into master (70b257c) will decrease coverage by 23%.
The diff coverage is n/a.

Additional details and impacted files

@@            Coverage Diff            @@
##           master   #16911     +/-   ##
=========================================
- Coverage      82%      59%    -23%     
=========================================
  Files         436      412     -24     
  Lines       31561    31265    -296     
=========================================
- Hits        25799    18517   -7282     
- Misses       5762    12748   +6986