mindspore.dataset.text.Truncate

class mindspore.dataset.text.Truncate(max_seq_len)

Truncate the input sequence so that it does not exceed the maximum length.

Parameters

max_seq_len (int) – Maximum allowable length.

Raises

• TypeError – If max_length_len is not of type int.

• ValueError – If value of max_length_len is not greater than or equal to 0.

• RuntimeError – If the input tensor is not of dtype bool, int, float, double or str.

Supported Platforms:

CPU

Examples

>>> import mindspore.dataset as ds
>>> import mindspore.dataset.text as text
>>>
>>> dataset = ds.NumpySlicesDataset(data=[['a', 'b', 'c', 'd', 'e']], column_names=["text"], shuffle=False)
>>> # Data before
>>> # |           col1            |
>>> # +---------------------------+
>>> # | ['a', 'b', 'c', 'd', 'e'] |
>>> # +---------------------------+
>>> truncate = text.Truncate(4)
>>> dataset = dataset.map(operations=truncate, input_columns=["text"])
>>> # Data after
>>> # |          col1          |
>>> # +------------------------+
>>> # |  ['a', 'b', 'c', 'd']  |
>>> # +------------------------+

Tutorial Examples:

• Illustration of text transforms