Missing support for AutoGPTQ on ARM64 #1097
Description
Seems to be caused by: AutoGPTQ/AutoGPTQ#373
For us to make this work, we have to downgrade to 0.3.2 or compile from source and redistribute ourselves.
{{ message }}
Seems to be caused by: AutoGPTQ/AutoGPTQ#373
For us to make this work, we have to downgrade to 0.3.2 or compile from source and redistribute ourselves.