CI Skip audio test on single GPU CI (#2380)

It appears that the single GPU tests are always failing at this
test ("The operation was canceled"), probably because it is
hanging (after more than 5h). Let's try to debug by skipping this test.

Morevoer, remove a superfluous step in the CI workflow.

.github/workflows/nightly-bnb.yml

@@ -194,11 +194,6 @@ jobs:
           status: ${{ steps.import.outcome }}
           slack_token: ${{ secrets.SLACK_CIFEEDBACK_BOT_TOKEN }}
 
-      - name: Run core GPU tests on multi-gpu
-        if: always()
-        run: |
-          source activate peft
-
       - name: Run examples on multi GPU
         id: examples_tests
         if: always()

tests/test_gpu_examples.py

@@ -682,6 +682,8 @@ class PeftBnbGPUExampleTests(unittest.TestCase):
             # assert loss is not None
             assert trainer.state.log_history[-1]["train_loss"] is not None
 
+    # TODO skipping to see if this leads to single GPU tests passing
+    @pytest.mark.skip
     @pytest.mark.single_gpu_tests
     def test_audio_model_training(self):
         r"""