Package co.elastic.clients.elasticsearch.ml

Class NlpRobertaTokenizationConfig

java.lang.Object

co.elastic.clients.elasticsearch.ml.NlpRobertaTokenizationConfig

All Implemented Interfaces:

TokenizationConfigVariant, JsonpSerializable

@JsonpDeserializable
public class NlpRobertaTokenizationConfig
extends Object
implements TokenizationConfigVariant, JsonpSerializable

RoBERTa tokenization configuration options

See Also:

• API specification

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	NlpRobertaTokenizationConfig.Builder	Builder for NlpRobertaTokenizationConfig.

Field Summary

Fields

Modifier and Type	Field	Description
static final JsonpDeserializer<NlpRobertaTokenizationConfig>	_DESERIALIZER	Json deserializer for NlpRobertaTokenizationConfig

Method Summary

Modifier and Type	Method	Description
TokenizationConfig.Kind	_tokenizationConfigKind()	TokenizationConfig variant kind.
final Boolean	addPrefixSpace()	Should the tokenizer prefix input with a space character
final Integer	maxSequenceLength()	Maximum input sequence length for the model
static NlpRobertaTokenizationConfig	of(Function<NlpRobertaTokenizationConfig.Builder,ObjectBuilder<NlpRobertaTokenizationConfig>> fn)
void	serialize(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)	Serialize this object to JSON.
protected void	serializeInternal(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)
protected static void	setupNlpRobertaTokenizationConfigDeserializer(ObjectDeserializer<NlpRobertaTokenizationConfig.Builder> op)
final Integer	span()	Tokenization spanning options.
String	toString()
final TokenizationTruncate	truncate()	Should tokenization input be automatically truncated before sending to the model for inference
final Boolean	withSpecialTokens()	Is tokenization completed with special tokens

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface co.elastic.clients.elasticsearch.ml.TokenizationConfigVariant

_toTokenizationConfig

Field Details

_DESERIALIZER

public static final JsonpDeserializer<NlpRobertaTokenizationConfig> _DESERIALIZER

Json deserializer for NlpRobertaTokenizationConfig

Method Details

of

public static NlpRobertaTokenizationConfig of(Function<NlpRobertaTokenizationConfig.Builder,ObjectBuilder<NlpRobertaTokenizationConfig>> fn)

_tokenizationConfigKind

public TokenizationConfig.Kind _tokenizationConfigKind()

TokenizationConfig variant kind.

Specified by:

_tokenizationConfigKind in interface TokenizationConfigVariant

addPrefixSpace

@Nullable
public final Boolean addPrefixSpace()

Should the tokenizer prefix input with a space character

API name: add_prefix_space

withSpecialTokens

@Nullable
public final Boolean withSpecialTokens()

Is tokenization completed with special tokens

API name: with_special_tokens

maxSequenceLength

@Nullable
public final Integer maxSequenceLength()

Maximum input sequence length for the model

API name: max_sequence_length

truncate

@Nullable
public final TokenizationTruncate truncate()

Should tokenization input be automatically truncated before sending to the model for inference

API name: truncate

span

@Nullable
public final Integer span()

Tokenization spanning options. Special value of -1 indicates no spanning takes place

API name: span

serialize

public void serialize(jakarta.json.stream.JsonGenerator generator,
 JsonpMapper mapper)

Serialize this object to JSON.

Specified by:

serialize in interface JsonpSerializable

serializeInternal

protected void serializeInternal(jakarta.json.stream.JsonGenerator generator,
 JsonpMapper mapper)

toString

public String toString()

Overrides:

toString in class Object

setupNlpRobertaTokenizationConfigDeserializer

protected static void setupNlpRobertaTokenizationConfigDeserializer(ObjectDeserializer<NlpRobertaTokenizationConfig.Builder> op)