Package co.elastic.clients.elasticsearch.ml

Class NlpBertTokenizationConfig

java.lang.Object

co.elastic.clients.elasticsearch.ml.NlpBertTokenizationConfig

All Implemented Interfaces:

TokenizationConfigVariant, JsonpSerializable

@JsonpDeserializable
public class NlpBertTokenizationConfig
extends Object
implements TokenizationConfigVariant, JsonpSerializable

BERT and MPNet tokenization configuration options

See Also:

• API specification

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	NlpBertTokenizationConfig.Builder	Builder for NlpBertTokenizationConfig.

Field Summary

Fields

Modifier and Type	Field	Description
static final JsonpDeserializer<NlpBertTokenizationConfig>	_DESERIALIZER	Json deserializer for NlpBertTokenizationConfig

Method Summary

Modifier and Type	Method	Description
TokenizationConfig.Kind	_tokenizationConfigKind()	TokenizationConfig variant kind.
final Boolean	doLowerCase()	Should the tokenizer lower case the text
final Integer	maxSequenceLength()	Maximum input sequence length for the model
static NlpBertTokenizationConfig	of(Function<NlpBertTokenizationConfig.Builder,ObjectBuilder<NlpBertTokenizationConfig>> fn)
void	serialize(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)	Serialize this object to JSON.
protected void	serializeInternal(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)
protected static void	setupNlpBertTokenizationConfigDeserializer(ObjectDeserializer<NlpBertTokenizationConfig.Builder> op)
final Integer	span()	Tokenization spanning options.
String	toString()
final TokenizationTruncate	truncate()	Should tokenization input be automatically truncated before sending to the model for inference
final Boolean	withSpecialTokens()	Is tokenization completed with special tokens

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface co.elastic.clients.elasticsearch.ml.TokenizationConfigVariant

_toTokenizationConfig

Field Details

_DESERIALIZER

public static final JsonpDeserializer<NlpBertTokenizationConfig> _DESERIALIZER

Json deserializer for NlpBertTokenizationConfig

Method Details

of

public static NlpBertTokenizationConfig of(Function<NlpBertTokenizationConfig.Builder,ObjectBuilder<NlpBertTokenizationConfig>> fn)

_tokenizationConfigKind

public TokenizationConfig.Kind _tokenizationConfigKind()

TokenizationConfig variant kind.

Specified by:

_tokenizationConfigKind in interface TokenizationConfigVariant

doLowerCase

@Nullable
public final Boolean doLowerCase()

Should the tokenizer lower case the text

API name: do_lower_case

withSpecialTokens

@Nullable
public final Boolean withSpecialTokens()

Is tokenization completed with special tokens

API name: with_special_tokens

maxSequenceLength

@Nullable
public final Integer maxSequenceLength()

Maximum input sequence length for the model

API name: max_sequence_length

truncate

@Nullable
public final TokenizationTruncate truncate()

Should tokenization input be automatically truncated before sending to the model for inference

API name: truncate

span

@Nullable
public final Integer span()

Tokenization spanning options. Special value of -1 indicates no spanning takes place

API name: span

serialize

public void serialize(jakarta.json.stream.JsonGenerator generator,
 JsonpMapper mapper)

Serialize this object to JSON.

Specified by:

serialize in interface JsonpSerializable

serializeInternal

protected void serializeInternal(jakarta.json.stream.JsonGenerator generator,
 JsonpMapper mapper)

toString

public String toString()

Overrides:

toString in class Object

setupNlpBertTokenizationConfigDeserializer

protected static void setupNlpBertTokenizationConfigDeserializer(ObjectDeserializer<NlpBertTokenizationConfig.Builder> op)