templates.SequenceTokenTypeTemplateSchema

class templates.SequenceTokenTypeTemplateSchema(*args, **kwargs)

Sequence Token Type template

Parameters:

• field (str) – Field

• token_type ({"lowercase", "capitalized", "uppercase"}) – Token type

• word_boundary_tokenizer (bool, default True) – Tokenize or not

• merge_token (bool, default False to maintain backward compatability) – Merge nearby tokens or not