NDArray.ScalarType.int4
A 4-bit signed integer.
Declaration
case int4Discussion
Four-bit signed integers can represent values in the range [-8, 7]. Widely used in model quantization for efficient storage and computation.
A 4-bit signed integer.
case int4Four-bit signed integers can represent values in the range [-8, 7]. Widely used in model quantization for efficient storage and computation.