Class NlpRobertaTokenizationConfig
java.lang.Object
co.elastic.clients.elasticsearch.ml.NlpRobertaTokenizationConfig
- All Implemented Interfaces:
TokenizationConfigVariant,JsonpSerializable
@JsonpDeserializable public class NlpRobertaTokenizationConfig extends java.lang.Object implements TokenizationConfigVariant, JsonpSerializable
RoBERTa tokenization configuration options
- See Also:
- API specification
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static classNlpRobertaTokenizationConfig.BuilderBuilder forNlpRobertaTokenizationConfig. -
Field Summary
Fields Modifier and Type Field Description static JsonpDeserializer<NlpRobertaTokenizationConfig>_DESERIALIZERJson deserializer forNlpRobertaTokenizationConfig -
Method Summary
Modifier and Type Method Description TokenizationConfig.Kind_tokenizationConfigKind()TokenizationConfig variant kind.java.lang.BooleanaddPrefixSpace()Should the tokenizer prefix input with a space characterjava.lang.IntegermaxSequenceLength()Maximum input sequence length for the modelstatic NlpRobertaTokenizationConfigof(java.util.function.Function<NlpRobertaTokenizationConfig.Builder,ObjectBuilder<NlpRobertaTokenizationConfig>> fn)voidserialize(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)Serialize this object to JSON.protected voidserializeInternal(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)protected static voidsetupNlpRobertaTokenizationConfigDeserializer(ObjectDeserializer<NlpRobertaTokenizationConfig.Builder> op)java.lang.Integerspan()Tokenization spanning options.java.lang.StringtoString()TokenizationTruncatetruncate()Should tokenization input be automatically truncated before sending to the model for inferencejava.lang.BooleanwithSpecialTokens()Is tokenization completed with special tokensMethods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, waitMethods inherited from interface co.elastic.clients.elasticsearch.ml.TokenizationConfigVariant
_toTokenizationConfig
-
Field Details
-
_DESERIALIZER
Json deserializer forNlpRobertaTokenizationConfig
-
-
Method Details
-
of
public static NlpRobertaTokenizationConfig of(java.util.function.Function<NlpRobertaTokenizationConfig.Builder,ObjectBuilder<NlpRobertaTokenizationConfig>> fn) -
_tokenizationConfigKind
TokenizationConfig variant kind.- Specified by:
_tokenizationConfigKindin interfaceTokenizationConfigVariant
-
addPrefixSpace
@Nullable public final java.lang.Boolean addPrefixSpace()Should the tokenizer prefix input with a space characterAPI name:
add_prefix_space -
withSpecialTokens
@Nullable public final java.lang.Boolean withSpecialTokens()Is tokenization completed with special tokensAPI name:
with_special_tokens -
maxSequenceLength
@Nullable public final java.lang.Integer maxSequenceLength()Maximum input sequence length for the modelAPI name:
max_sequence_length -
truncate
Should tokenization input be automatically truncated before sending to the model for inferenceAPI name:
truncate -
span
@Nullable public final java.lang.Integer span()Tokenization spanning options. Special value of -1 indicates no spanning takes placeAPI name:
span -
serialize
Serialize this object to JSON.- Specified by:
serializein interfaceJsonpSerializable
-
serializeInternal
-
toString
public java.lang.String toString()- Overrides:
toStringin classjava.lang.Object
-
setupNlpRobertaTokenizationConfigDeserializer
protected static void setupNlpRobertaTokenizationConfigDeserializer(ObjectDeserializer<NlpRobertaTokenizationConfig.Builder> op)
-