-
Notifications
You must be signed in to change notification settings - Fork 624
Issues: bitsandbytes-foundation/bitsandbytes
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
CUDA Architecture 80+ Causing Incorrect Model Behavior with BitsAndBytes Quantization
#1391
opened Oct 15, 2024 by
gunjunlee
Available version for 4-bit quantization supporting CUDA 11.1?
#1388
opened Oct 11, 2024 by
justin4ai
Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback): CUDA Setup failed despite GPU being available. Please run the following command to get more information: python -m bitsandbytes Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues
#1387
opened Oct 11, 2024 by
smillpine
An error occurred: CUDA is required but not available for bitsandbytes.
#1384
opened Oct 9, 2024 by
GaoDalie
AdEMA NaN when loading from state_dict
bug
Something isn't working
#1382
opened Oct 2, 2024 by
darius-lam
Paged optimizer resuming from checkpoint - attributeError: 'int' object has no attribute 'cpu'
#1381
opened Oct 1, 2024 by
shivam15s
Model architecture is modified when I use BitsAndBytesConfig with default params
#1371
opened Sep 25, 2024 by
yunhao-tech
RuntimeError: CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasGemmEx
#1363
opened Sep 17, 2024 by
LukeLIN-web
quantize_4bit/dequantize_4bit gives wrong output on in-contiguous tensor
#1342
opened Aug 30, 2024 by
chenqianfzh
Linear8bitLt can not be moved back to cpu
bug
Something isn't working
#1332
opened Aug 24, 2024 by
Nerogar
Pretrained Causal LM cannot be loaded in 4bit/8bit
likely not a BNB issue
#1331
opened Aug 23, 2024 by
adrienchaton
Previous Next
ProTip!
Updated in the last three days: updated:>2024-10-22.