hertz / quant

13.6 GB

1 contributor

History: 3 commits

ouasdg

Upload quant/scion_w4a8.pt with huggingface_hub

cc7c0da verified 10 months ago

caraway_w4a8.pt
Detected Pickle imports (16)
- "torch._tensor._rebuild_from_type_v2",
- "torchao.quantization.quant_primitives.ZeroPointDomain",
- "torchao.quantization.quant_api._int8_asymm_per_token_quant",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.serialization._get_layout",
- "torch.int8",
- "torch.BFloat16Storage",
- "torch.device",
- "torchao.dtypes.utils.PlainLayout",
- "collections.OrderedDict",
- "torchao.quantization.linear_activation_quantized_tensor.LinearActivationQuantizedTensor",
- "torchao.dtypes.uintx.plain_layout.PlainAQTTensorImpl",
- "torch._utils._rebuild_tensor_v2",
- "torch.CharStorage",
- "torch.bfloat16",
- "torchao.dtypes.affine_quantized_tensor.AffineQuantizedTensor"
How to fix it?
6.72 GB
xet

Rename quant/hertzlm_a8w4.pt to quant/caraway_w4a8.pt 10 months ago
scion_w4a8.pt
Detected Pickle imports (16)
- "torch.int8",
- "torch.bfloat16",
- "torchao.dtypes.affine_quantized_tensor.AffineQuantizedTensor",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch._utils._rebuild_wrapper_subclass",
- "torch._tensor._rebuild_from_type_v2",
- "torch.serialization._get_layout",
- "torchao.quantization.quant_api._int8_asymm_per_token_quant",
- "torch.CharStorage",
- "torchao.dtypes.utils.PlainLayout",
- "torchao.quantization.quant_primitives.ZeroPointDomain",
- "torchao.quantization.linear_activation_quantized_tensor.LinearActivationQuantizedTensor",
- "torchao.dtypes.uintx.plain_layout.PlainAQTTensorImpl",
- "torch.device",
- "torch.BFloat16Storage"
How to fix it?
6.85 GB
xet

Upload quant/scion_w4a8.pt with huggingface_hub 10 months ago

Detected Pickle imports (16)

Detected Pickle imports (16)