Class NlpRobertaTokenizationConfig
java.lang.Object
co.elastic.clients.elasticsearch.ml.NlpRobertaTokenizationConfig
- All Implemented Interfaces:
TokenizationConfigVariant
,JsonpSerializable
@JsonpDeserializable public class NlpRobertaTokenizationConfig extends java.lang.Object implements TokenizationConfigVariant, JsonpSerializable
RoBERTa tokenization configuration options
- See Also:
- API specification
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static class
NlpRobertaTokenizationConfig.Builder
Builder forNlpRobertaTokenizationConfig
. -
Field Summary
Fields Modifier and Type Field Description static JsonpDeserializer<NlpRobertaTokenizationConfig>
_DESERIALIZER
Json deserializer forNlpRobertaTokenizationConfig
-
Method Summary
Modifier and Type Method Description TokenizationConfig.Kind
_tokenizationConfigKind()
TokenizationConfig variant kind.java.lang.Boolean
addPrefixSpace()
Should the tokenizer prefix input with a space characterjava.lang.Integer
maxSequenceLength()
Maximum input sequence length for the modelstatic NlpRobertaTokenizationConfig
of(java.util.function.Function<NlpRobertaTokenizationConfig.Builder,ObjectBuilder<NlpRobertaTokenizationConfig>> fn)
void
serialize(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)
Serialize this object to JSON.protected void
serializeInternal(jakarta.json.stream.JsonGenerator generator, JsonpMapper mapper)
protected static void
setupNlpRobertaTokenizationConfigDeserializer(ObjectDeserializer<NlpRobertaTokenizationConfig.Builder> op)
java.lang.Integer
span()
Tokenization spanning options.java.lang.String
toString()
TokenizationTruncate
truncate()
Should tokenization input be automatically truncated before sending to the model for inferencejava.lang.Boolean
withSpecialTokens()
Is tokenization completed with special tokensMethods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
Methods inherited from interface co.elastic.clients.elasticsearch.ml.TokenizationConfigVariant
_toTokenizationConfig
-
Field Details
-
_DESERIALIZER
Json deserializer forNlpRobertaTokenizationConfig
-
-
Method Details
-
of
public static NlpRobertaTokenizationConfig of(java.util.function.Function<NlpRobertaTokenizationConfig.Builder,ObjectBuilder<NlpRobertaTokenizationConfig>> fn) -
_tokenizationConfigKind
TokenizationConfig variant kind.- Specified by:
_tokenizationConfigKind
in interfaceTokenizationConfigVariant
-
addPrefixSpace
@Nullable public final java.lang.Boolean addPrefixSpace()Should the tokenizer prefix input with a space characterAPI name:
add_prefix_space
-
withSpecialTokens
@Nullable public final java.lang.Boolean withSpecialTokens()Is tokenization completed with special tokensAPI name:
with_special_tokens
-
maxSequenceLength
@Nullable public final java.lang.Integer maxSequenceLength()Maximum input sequence length for the modelAPI name:
max_sequence_length
-
truncate
Should tokenization input be automatically truncated before sending to the model for inferenceAPI name:
truncate
-
span
@Nullable public final java.lang.Integer span()Tokenization spanning options. Special value of -1 indicates no spanning takes placeAPI name:
span
-
serialize
Serialize this object to JSON.- Specified by:
serialize
in interfaceJsonpSerializable
-
serializeInternal
-
toString
public java.lang.String toString()- Overrides:
toString
in classjava.lang.Object
-
setupNlpRobertaTokenizationConfigDeserializer
protected static void setupNlpRobertaTokenizationConfigDeserializer(ObjectDeserializer<NlpRobertaTokenizationConfig.Builder> op)
-