You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
0.41.0 represents quant_state under Params4bits as a nested list with 7 elements, but in 0.42.0 this is drastically changed to a new QuantState class, and it seems some features are discarded (e.g data_type in 0.41.0), and some features are added (QuantState.code, state2 (what's its type?) ) and I'm not very sure what that means.
Motivation
Lots of local quantized model used 0.41.0's format, which makes it hard to run them on 0.42.0.
Your contribution
I still need time to figure out what state2 is (in QuantState.as_dict it seems like another nested QuantState, but how is it constructed?). Any help or guidance is appreciated on this topic!
The text was updated successfully, but these errors were encountered:
Feature request
0.41.0 represents quant_state under Params4bits as a nested list with 7 elements, but in 0.42.0 this is drastically changed to a new QuantState class, and it seems some features are discarded (e.g data_type in 0.41.0), and some features are added (QuantState.code, state2 (what's its type?) ) and I'm not very sure what that means.
Motivation
Lots of local quantized model used 0.41.0's format, which makes it hard to run them on 0.42.0.
Your contribution
I still need time to figure out what state2 is (in QuantState.as_dict it seems like another nested QuantState, but how is it constructed?). Any help or guidance is appreciated on this topic!
The text was updated successfully, but these errors were encountered: