You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This PR removes uint32 indices protection in quant/embedding_modules.py. Nevertheless, when indices and offsets inputs of uint64 dtype are provided, int_nbit_split_embedding_codegen_lookup_function triggers a RuntimeError: expected scalar type Int but found Long on the GPU. Would it be possible to add support for the uint64 dtype on GPU devices?
The text was updated successfully, but these errors were encountered:
This PR removes uint32 indices protection in quant/embedding_modules.py. Nevertheless, when
indices
andoffsets
inputs of uint64 dtype are provided, int_nbit_split_embedding_codegen_lookup_function triggers aRuntimeError: expected scalar type Int but found Long
on the GPU. Would it be possible to add support for the uint64 dtype on GPU devices?The text was updated successfully, but these errors were encountered: