mindspore_gs.ptq.QuantGranularity

View Source On Gitee
class mindspore_gs.ptq.QuantGranularity[source]

Quant granularity for ptq quantizer.

  • PER_TENSOR: apply quant granularity to per_tensor.

  • PER_CHANNEL: apply quant granularity to per_channel.

  • PER_TOKEN: apply quant granularity to per_token.

  • PER_GROUP: apply quant granularity to per_group.

classmethod from_str(name: str)[source]

Convert name to quant granularity type.

Parameters

name (str) – the string name of the quant granularity.