Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback): CUDA Setup failed despite GPU being available. Please run the following command to get more information: python -m bitsandbytes Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

[smillpine]

System Info

System Information

• ComfyUI Version: v0.2.2
• Arguments: E:\ComfyUI\ComfyUI-aki\ComfyUI-aki-v1.3\main.py --auto-launch --preview-method auto --disable-cuda-malloc
• OS: nt
• Python Version: 3.11.6 | packaged by conda-forge | (main, Oct 3 2023, 10:29:11) [MSC v.1935 64 bit (AMD64)]
• Embedded Python: false
• PyTorch Version: 2.3.1+cu118

Devices

• Name: cuda:0 NVIDIA GeForce RTX 3080 Ti : cudaMallocAsync
  • Type: cuda
  • VRAM Total: 12884246528
  • VRAM Free: 11597250560
  • Torch VRAM Total: 0
  • Torch VRAM Free: 0

Reproduction

ComfyUI Error Report

Error Details

• Node Type: Joy_caption

• Exception Type: RuntimeError

• Exception Message: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):

    CUDA Setup failed despite GPU being available. Please run the following command to get more information:
  
    python -m bitsandbytes
  
    Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
    to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
    and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues
  

Stack Trace

### Expected behavior

# ComfyUI Error Report
## Error Details
- **Node Type:** Joy_caption
- **Exception Type:** RuntimeError
- **Exception Message:** Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):

        CUDA Setup failed despite GPU being available. Please run the following command to get more information:

        python -m bitsandbytes

        Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
        to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
        and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues
## Stack Trace