Index
All Classes and Interfaces|All Packages|Constant Field Values
A
- AbstractSourceNativeInfo<K extends Comparable<K>,
N> - Class in io.aiven.commons.kafka.connector.source -
An abstract implementation of NativeInfo handling for Source.
- AbstractSourceNativeInfo(NativeInfo<K, N>) - Constructor for class io.aiven.commons.kafka.connector.source.AbstractSourceNativeInfo
-
Constructor.
- AbstractSourceTask - Class in io.aiven.commons.kafka.connector.source
-
This class handles extracting records from an iterator and returning them to Kafka.
- AbstractSourceTask() - Constructor for class io.aiven.commons.kafka.connector.source.AbstractSourceTask
-
Constructor.
- add(Template.Bound) - Method in class io.aiven.commons.kafka.connector.common.templating.Template.BoundBuilder
-
Adds all the bindings from the Template.Bound to this builder.
- add(Template.BoundBuilder) - Method in class io.aiven.commons.kafka.connector.common.templating.Template.BoundBuilder
-
Adds all the bindings from the builder to this builder.
- add(TemplateVariable) - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariableRegistry.Builder
-
Adds a template variable to the builder.
- add(TemplateVariableRegistry) - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariableRegistry.Builder
-
Adds a template variable registry to the builder.
- add(ExtractorInfo...) - Method in class io.aiven.commons.kafka.connector.source.extractor.ExtractorRegistry.Builder
-
Adds one or more ExtractorInfo records to the builder.
- add(ExtractorRegistry) - Method in class io.aiven.commons.kafka.connector.source.extractor.ExtractorRegistry.Builder
-
Adds all the extractors from a registry to the builder.
- add(K) - Method in class io.aiven.commons.kafka.connector.source.lookback.Buffer
- add(K) - Method in class io.aiven.commons.kafka.connector.source.lookback.LastKey
- add(K) - Method in interface io.aiven.commons.kafka.connector.source.lookback.Lookback
-
Adds a key to the lookback tracking.
- add(K) - Method in class io.aiven.commons.kafka.connector.source.lookback.None
- addEntry(OffsetManager.OffsetManagerEntry) - Method in class io.aiven.commons.kafka.connector.source.OffsetManager
-
Get add an entry to the offset manager.
- ALL - Enum constant in enum class io.aiven.commons.kafka.connector.source.task.DistributionType
-
ALL accepts all contexts.
- allFeatures(int) - Method in record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Determines if the extractor supports all the features.
- allFeatures(int) - Method in class io.aiven.commons.kafka.connector.source.extractor.ExtractorRegistry
-
Gets the list of extractor info for this registry that have all the specified feature flags
- any() - Method in class io.aiven.commons.kafka.connector.source.extractor.ExtractorRegistry
-
Gets one of the extractors from the registry.
- anyFeature(int) - Method in class io.aiven.commons.kafka.connector.source.extractor.ExtractorRegistry
-
Gets the list of extractor info that have any of the feature flags
- anyFeatures(int) - Method in record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Determines if the extractor supports any of the features.
- asBoolean() - Method in class io.aiven.commons.kafka.connector.common.templating.Parameter
-
Returns the parameter value as a boolean.
- asPredicate(int, int) - Method in enum class io.aiven.commons.kafka.connector.source.task.DistributionType
-
Creates a context predicate from this distribution type.
- AvroExtractor - Class in io.aiven.commons.kafka.connector.source.extractor
-
Transforms a stream of Avro records into individual kafka messages, one per record.
- AvroExtractor(SourceCommonConfig) - Constructor for class io.aiven.commons.kafka.connector.source.extractor.AvroExtractor
-
Constructs the AvroExtractor.
B
- bind(String, Function<Parameter, String>) - Method in class io.aiven.commons.kafka.connector.common.templating.Template.BoundBuilder
-
Bind the variable to a function to convert a parameter to a string.
- bind(String, Supplier<String>) - Method in class io.aiven.commons.kafka.connector.common.templating.Template.BoundBuilder
-
Bind the variable to the supplier of string.
- boundBuilder() - Method in class io.aiven.commons.kafka.connector.common.templating.Template
-
Creates a bound builder.
- Buffer<K extends Comparable<K>> - Class in io.aiven.commons.kafka.connector.source.lookback
-
Lookback that uses a buffer to track the last N records.
- build() - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor.Builder
-
Builds the parameter descriptor.
- build() - Method in class io.aiven.commons.kafka.connector.common.templating.Template.BoundBuilder
-
Builds the bound template.
- build() - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable.Builder
-
Creates a TemplateVariable.
- build() - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariableRegistry.Builder
-
Builds a new TemplateVariableRegistry from this builder.
- build() - Method in class io.aiven.commons.kafka.connector.source.extractor.ExtractorRegistry.Builder
-
Build the registry.
- builder() - Static method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariableRegistry
-
Creates a new builder of TemplateVariableRegistries.
- builder() - Static method in class io.aiven.commons.kafka.connector.source.extractor.ExtractorRegistry
-
Creates the builder for a new registry.
- builder(String) - Static method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
-
Create a builder for a ParameterDescriptor.
- builder(String) - Static method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable
-
Gets the builder for TemplateVariables.
- ByteArrayExtractor - Class in io.aiven.commons.kafka.connector.source.extractor
-
ByteArrayExtractor chunks an entire object into a maximum size specified by the extractorBuffer
SourceConfigFragment.Setter.extractorBuffer(int)configuration option. - ByteArrayExtractor(SourceCommonConfig) - Constructor for class io.aiven.commons.kafka.connector.source.extractor.ByteArrayExtractor
-
Constructs a ByteArray extractor using the values from the config.
C
- characteristics() - Method in class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor.StreamSpliterator
- checkMalformed(String, String, TemplateVariableRegistry) - Static method in class io.aiven.commons.kafka.connector.common.templating.TemplateParser
-
Checks if a text string may contain malformed templates.
- close() - Method in class io.aiven.commons.kafka.connector.source.extractor.CsvExtractor
- close() - Method in class io.aiven.commons.kafka.connector.source.extractor.Extractor
- close() - Method in class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor.StreamSpliterator
-
Closes the StreamSplitter by calling
InputStreamExtractor.StreamSpliterator.doClose()and then closing the input stream. - close() - Method in class io.aiven.commons.kafka.connector.source.extractor.JsonExtractor
- close() - Method in class io.aiven.commons.kafka.connector.source.NativeSourceData
- closeResources() - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceTask
-
Close any resources the source has open.
- commonName() - Method in record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Returns the value of the
commonNamerecord component. - compareTo(NativeInfo<K, N>) - Method in record class io.aiven.commons.kafka.connector.common.NativeInfo
- compareTo(AbstractSourceNativeInfo<K, N>) - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceNativeInfo
- compressionType(CompressionType) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment.Setter
-
Sets the compression type expected for I/O to storage.
- config - Variable in class io.aiven.commons.kafka.connector.source.extractor.Extractor
-
The source configuration for the Kafka task.
- configure(Map<String, String>, OffsetManager) - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceTask
-
Called by
AbstractSourceTask.start(java.util.Map<java.lang.String, java.lang.String>)to allows the concrete implementation to configure itself based on properties. - ConnectorCommonConfig - Class in io.aiven.commons.kafka.connector.common.config
-
The definition of the common connector config functions.
- ConnectorCommonConfig(ConnectorCommonConfigDef, Map<String, String>) - Constructor for class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfig
-
Constructor.
- ConnectorCommonConfigDef - Class in io.aiven.commons.kafka.connector.common.config
-
The configuration definition for the common connector.
- ConnectorCommonConfigDef() - Constructor for class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigDef
-
Constructor.
- ConnectorCommonConfigFragment - Class in io.aiven.commons.kafka.connector.common.config
-
The common connector fragment.
- ConnectorCommonConfigFragment(FragmentDataAccess) - Constructor for class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment
-
Construct the ConfigFragment.
- ConnectorCommonConfigFragment.Setter - Class in io.aiven.commons.kafka.connector.common.config
-
Gets the setter for this fragment.
- contains(K) - Method in class io.aiven.commons.kafka.connector.source.lookback.Buffer
- contains(K) - Method in class io.aiven.commons.kafka.connector.source.lookback.LastKey
- contains(K) - Method in interface io.aiven.commons.kafka.connector.source.lookback.Lookback
-
Determines if the key is in the lookback.
- contains(K) - Method in class io.aiven.commons.kafka.connector.source.lookback.None
- Context - Class in io.aiven.commons.kafka.connector.source.task
-
A Context which captures all the details about the source object that are required to successfully send a source record onto Kafka
- Context(Context) - Constructor for class io.aiven.commons.kafka.connector.source.task.Context
-
Creates a defensive copy of the Context
- Context(Comparable<?>) - Constructor for class io.aiven.commons.kafka.connector.source.task.Context
-
Constructor.
- createOffsetManagerEntry(Context) - Method in class io.aiven.commons.kafka.connector.source.NativeSourceData
-
Creates an offset manager entry from a context.
- createOffsetManagerEntry(Map<String, Object>) - Method in class io.aiven.commons.kafka.connector.source.NativeSourceData
-
Creates an offset manager entry using the data in the map.
- createSchemaAndValue(Object) - Static method in class io.aiven.commons.kafka.connector.source.extractor.SchemaAndValueFactory
-
Creates a SchemaAndValue for the Object.
- createSpliterator(IOSupplier<InputStream>, long, Context) - Method in class io.aiven.commons.kafka.connector.source.extractor.AvroExtractor
- createSpliterator(IOSupplier<InputStream>, long, Context) - Method in class io.aiven.commons.kafka.connector.source.extractor.ByteArrayExtractor
- createSpliterator(IOSupplier<InputStream>, long, Context) - Method in class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor
-
Creates the stream spliterator for this extractor.
- createSpliterator(IOSupplier<InputStream>, long, Context) - Method in class io.aiven.commons.kafka.connector.source.extractor.JsonExtractor
- createSpliterator(IOSupplier<InputStream>, long, Context) - Method in class io.aiven.commons.kafka.connector.source.extractor.ParquetExtractor
- CsvExtractor - Class in io.aiven.commons.kafka.connector.source.extractor
-
This class provides a extractor to take a List of CSVRecord generated from apache csv-commons and transforms that data into a SchemaAndValue Object usable by Connect to add messages to Kafka.
- CsvExtractor(SourceCommonConfig) - Constructor for class io.aiven.commons.kafka.connector.source.extractor.CsvExtractor
-
Constructor.
- csvExtractorHeaders(String) - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment.Setter
-
Sets the headers for the CSV.
- csvExtractorHeadersEnabled(boolean) - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment.Setter
-
Sets the header flag for the CSV extractor.
D
- description() - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable
-
Gets the description of this TemplateVariable.
- description() - Method in record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Returns the value of the
descriptionrecord component. - description(String) - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor.Builder
-
Sets the description.
- description(String) - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable.Builder
-
Sets the description for the variable.
- distributionType(DistributionType) - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment.Setter
-
Sets the distribution type.
- DistributionType - Enum Class in io.aiven.commons.kafka.connector.source.task
-
An enumeration of distribution strategies.
- doAdvance(Consumer<? super SchemaAndValue>) - Method in class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor.StreamSpliterator
-
Attempt to read the next record.
- doClose() - Method in class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor.StreamSpliterator
-
Method to close additional inputs if needed.
E
- EMPTY - Static variable in class io.aiven.commons.kafka.connector.common.templating.Parameter
-
An EMPTY parameter
- enableKeyConverterRegistry(boolean) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment.Setter
-
Sets the value converter schema registry flag.
- enableSchemaRegistry(boolean) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment.Setter
-
Sets the schema registry flag.
- enableValueConverterRegistry(boolean) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment.Setter
-
Sets the value converter schema registry flag.
- ensureValid(String, Object) - Method in class io.aiven.commons.kafka.connector.common.config.validator.TemplateValidator
- equals(Object) - Method in record class io.aiven.commons.kafka.connector.common.NativeInfo
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in class io.aiven.commons.kafka.connector.common.templating.Parameter
- equals(Object) - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
- equals(Object) - Method in record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Indicates whether some other object is "equal to" this one.
- errorsTolerance(ToleranceType) - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment.Setter
-
Sets the error tolerance.
- estimateInputStreamLength() - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceNativeInfo
-
Gets an estimate of the input stream length.
- estimateInputStreamLength() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Gets the input stream supplier.
- estimateSize() - Method in class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor.StreamSpliterator
- EvolvingSourceRecord - Class in io.aiven.commons.kafka.connector.source
-
An evolving source record initially retrieved from the storage layer.
- EvolvingSourceRecord(AbstractSourceNativeInfo<?, ?>, OffsetManager.OffsetManagerEntry, Context) - Constructor for class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Construct a source record from a native item.
- EvolvingSourceRecord(EvolvingSourceRecord) - Constructor for class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Copy constructor for an abstract source record.
- EvolvingSourceRecordIterator - Class in io.aiven.commons.kafka.connector.source
-
Iterator that processes Native Source Data and creates AbstractSourceRecords.
- EvolvingSourceRecordIterator(SourceCommonConfig, NativeSourceData<?>) - Constructor for class io.aiven.commons.kafka.connector.source.EvolvingSourceRecordIterator
-
Constructor.
- example() - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
-
Creates an example for the described parameter.
- example() - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable
-
Generates an example of this variable.
- extract(String) - Method in class io.aiven.commons.kafka.connector.common.templating.Template.Extractor
-
Performs the variable extraction from the input string.
- extract(Map<String, String>) - Method in interface io.aiven.commons.kafka.connector.common.templating.TemplatePart
-
Extracts the original template string from the rendered text.
- extract(Map<String, String>) - Method in class io.aiven.commons.kafka.connector.common.templating.TextTemplatePart
- extract(Map<String, String>) - Method in class io.aiven.commons.kafka.connector.common.templating.VariableTemplatePart
- extractor() - Method in class io.aiven.commons.kafka.connector.common.templating.Template
-
Creates an extractor to parse variable values back from the rendered string.
- Extractor - Class in io.aiven.commons.kafka.connector.source.extractor
-
Extracts data from the native abstract source record to Key SchemaAndValue object and a stream of SchemaAndValue objects for the values.
- Extractor(SourceCommonConfig, ExtractorInfo) - Constructor for class io.aiven.commons.kafka.connector.source.extractor.Extractor
-
Constructor.
- extractorBuffer(int) - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment.Setter
-
Sets the extractor buffer size.
- extractorCache(int) - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment.Setter
-
Sets the cache size in bytes.
- extractorClass() - Method in record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Returns the value of the
extractorClassrecord component. - extractorClass(Class<? extends Extractor>) - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment.Setter
-
Sets the extractor class for this source.
- ExtractorInfo - Record Class in io.aiven.commons.kafka.connector.source.extractor
-
The Information about the extractor.
- ExtractorInfo(String, Class<? extends Extractor>, int, String) - Constructor for record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Creates an instance of a
ExtractorInforecord class. - ExtractorRegistry - Class in io.aiven.commons.kafka.connector.source.extractor
-
A registry of extractors.
- ExtractorRegistry.Builder - Class in io.aiven.commons.kafka.connector.source.extractor
-
A ExtractorRegistry builder.
F
- FEATURE_INTERNAL_COMPRESSION - Static variable in record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Feature flag signifying: Extractor handles compression internally.
- FEATURE_NONE - Static variable in record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Feature flag signifying: No additional features.
- featureFlags() - Method in record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Returns the value of the
featureFlagsrecord component. - fragmentPostProcess(CommonConfig.ChangeTrackingMap) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfig
- fromProperties(Map<String, Object>) - Method in interface io.aiven.commons.kafka.connector.source.OffsetManager.OffsetManagerEntry
-
Creates a new OffsetManagerEntry by wrapping the properties with the current implementation.
- fromString(String) - Method in interface io.aiven.commons.kafka.connector.source.NativeSourceData.KeySerde
-
Creates a native key from a parsable string representation.
G
- generateKeyData(EvolvingSourceRecord) - Method in class io.aiven.commons.kafka.connector.source.extractor.Extractor
-
Convert the native key into a Schema and Value for Kafka.
- generateRecords(EvolvingSourceRecord) - Method in class io.aiven.commons.kafka.connector.source.extractor.CsvExtractor
-
Gets a stream of SchemaAndValue records from the input stream.
- generateRecords(EvolvingSourceRecord) - Method in class io.aiven.commons.kafka.connector.source.extractor.Extractor
-
Gets a stream of SchemaAndValue records from the input stream.
- generateRecords(EvolvingSourceRecord) - Method in class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor
-
Gets a stream of SchemaAndValue records from the input stream.
- get() - Method in class io.aiven.commons.kafka.connector.source.lookback.Buffer
- get() - Method in class io.aiven.commons.kafka.connector.source.lookback.LastKey
- get() - Method in interface io.aiven.commons.kafka.connector.source.lookback.Lookback
-
Gets the key to query for.
- get() - Method in class io.aiven.commons.kafka.connector.source.lookback.None
- get(String) - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariableRegistry
-
Gets the template variable for the specified name.
- get(String) - Method in class io.aiven.commons.kafka.connector.source.extractor.ExtractorRegistry
-
Gets the ExtractorInfo for the specific name.
- getCompressionType() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfig
-
Gets the compression type expected for I/O to storage.
- getCompressionType() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment
-
Gets the compression type expected for I/O to storage.
- getContext() - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceNativeInfo
-
Creates the context for the native info.
- getContext() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Gets the Context for this source record.
- getCsvExtractorHeader() - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig
-
Gets the specified headers, if any, for the CSV extractor.
- getCsvExtractorHeader() - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Gets the list of header for the CSV input.
- getDescription() - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
-
Gets the description of this parameter
- getDistributionType() - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig
-
Gets the distribution type.
- getDistributionType() - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Gets the distribution type
- getDocumentation() - Method in enum class io.aiven.commons.kafka.connector.source.task.DistributionType
-
Gets the documentation for the distribution type.
- getEntryData(OffsetManager.OffsetManagerKey) - Method in class io.aiven.commons.kafka.connector.source.OffsetManager
-
Get entry data from the offset manager.
- getErrorsTolerance() - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig
-
Gets the tolerance for errors.
- getErrorsTolerance() - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Gets the error tolerance.
- getExtractor() - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig
-
Gets the extractor defined for this source.
- getExtractor(SourceCommonConfig) - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Gets the Extractor instance for this source.
- getExtractorBufferSize() - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig
-
Gets the size of the Extractor buffer if the extractor builds a buffered input stream.
- getExtractorBufferSize() - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Gets the size, in bytes, of the extractor buffer in bytes.
- getExtractorCacheSize() - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig
-
Gets the size of the Extractor cache if the extractor supports a cache.
- getExtractorCacheSize() - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Gets the size, in bytes, of the extractor cache size in bytes.
- getIgnoreCase(String) - Method in class io.aiven.commons.kafka.connector.source.extractor.ExtractorRegistry
-
Gets a ExtractorInfo for the specific name.
- getInputStream() - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceNativeInfo
-
Read the input data from the nativeInfo.
- getInputStream(CompressionType) - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Gets the input stream supplier.
- getInputStreamSupplier() - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceNativeInfo
-
Gets an InputStream supplier.
- getInt(String) - Method in interface io.aiven.commons.kafka.connector.source.OffsetManager.OffsetManagerEntry
-
Gets the value of the named property as an
int. - getIterator(SourceCommonConfig) - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceTask
-
Gets the iterator of SourceRecords.
- getKey() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Gets the key data for this source record.
- getKeyConverterSchemaRegistryUrl() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfig
-
Gets the key converter schema registry URL.
- getKeyConverterSchemaRegistryUrl() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment
-
Gets the key converter schema registry URL.
- getLong(String) - Method in interface io.aiven.commons.kafka.connector.source.OffsetManager.OffsetManagerEntry
-
Gets the value of the named property as a
long - getManagerKey() - Method in interface io.aiven.commons.kafka.connector.source.OffsetManager.OffsetManagerEntry
-
Gets the OffsetManagerKey for this entry.
- getMaxPollRecords() - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig
-
Gets the maximum number of records to return in a single poll.
- getMaxPollRecords() - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Gets the maximum number of records to poll at one time.
- getName() - Method in class io.aiven.commons.kafka.connector.common.templating.Parameter
-
Gets the parameter name.
- getName() - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
-
Gets the parameter name.
- getName() - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable
-
Gets the name of the variable.
- getNativeItemIterator(K) - Method in class io.aiven.commons.kafka.connector.source.NativeSourceData
-
Get an iterator of Native objects from the underlying storage layer.
- getNativeKey() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Gets then key for the native object.
- getNativeKey() - Method in class io.aiven.commons.kafka.connector.source.task.Context
-
Get the native key as specified by this context.
- getNativeKeySerde() - Method in class io.aiven.commons.kafka.connector.source.NativeSourceData
-
Returns a KeySerde for the native keys.
- getNativeStartKey() - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig
-
Gets the native start key for the initial file to scan.
- getNativeStartKey() - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Gets the nativeStartKey.
- getOffset() - Method in class io.aiven.commons.kafka.connector.source.task.Context
-
Gets the native offset for this context.
- getOffsetManagerEntry() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Gets the offset manager entry for this source record.
- getOffsetManagerKey(K) - Method in class io.aiven.commons.kafka.connector.source.NativeSourceData
-
Creates an offset manager key for the native key.
- getOriginalPlaceholder() - Method in class io.aiven.commons.kafka.connector.common.templating.VariableTemplatePart
-
Returns the original placeholder for the template.
- getParameter() - Method in class io.aiven.commons.kafka.connector.common.templating.VariableTemplatePart
-
Returns the associated parameter.
- getParameterDescriptor() - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable
-
Gets the parameter descriptor for this variable.
- getPartition() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Gets the partition for the source record.
- getPartition() - Method in class io.aiven.commons.kafka.connector.source.task.Context
-
Gets the Kafka partition as specified by the context.
- getPartitionMap() - Method in interface io.aiven.commons.kafka.connector.source.OffsetManager.OffsetManagerKey
-
Gets the partition map used by Kafka to identify this Offset entry.
- getProperties() - Method in interface io.aiven.commons.kafka.connector.source.OffsetManager.OffsetManagerEntry
-
Extracts the data from the entry in the correct format to return to Kafka.
- getProperty(String) - Method in interface io.aiven.commons.kafka.connector.source.OffsetManager.OffsetManagerEntry
-
Gets the value of the named property.
- getRecordCount() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Gets the record count as recorded by the OffsetManager for the native item that this source record is working with.
- getRecordCount() - Method in interface io.aiven.commons.kafka.connector.source.OffsetManager.OffsetManagerEntry
-
Gets the current record count.
- getRingBufferSize() - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig
-
Gets the size of the ring buffer used to track read files.
- getRingBufferSize() - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Gets the ring buffer size.
- getSchemaRegistryUrl() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfig
-
Gets the schema registry URL.
- getSchemaRegistryUrl() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment
-
Gets the schema registry URL.
- getSourceName() - Method in class io.aiven.commons.kafka.connector.source.NativeSourceData
-
Gets the name for the source type.
- getSourceNativeInfo() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Gets the AbstractNativeSource info from the constructor.
- getSourceRecord(ToleranceType, OffsetManager) - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Creates a SourceRecord that can be returned to a Kafka topic
- getString(String) - Method in interface io.aiven.commons.kafka.connector.source.OffsetManager.OffsetManagerEntry
-
Gets the value of the named property as a String.
- getTargetTopic() - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig
-
Gets the target topic to write messages to.
- getTargetTopic() - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Gets the target topic.
- getTopic() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Gets the topic for the source record.
- getTopic() - Method in class io.aiven.commons.kafka.connector.source.task.Context
-
Gets the Kafka topic as specified by the context.
- getValidatorHelp() - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
-
Gets the validator help text.
- getValue() - Method in class io.aiven.commons.kafka.connector.common.templating.Parameter
-
Gets the parameter value.
- getValue() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Gets the value data for this source record.
- getValueConverterSchemaRegistryUrl() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfig
-
Gets the value converter schema registry URL.
- getValueConverterSchemaRegistryUrl() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment
-
Gets the value converter schema registry URL.
- getVariableName() - Method in class io.aiven.commons.kafka.connector.common.templating.VariableTemplatePart
-
Returns the variable name.
H
- has(String) - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariableRegistry
-
Determines if the name is in the registry.
- hashCode() - Method in record class io.aiven.commons.kafka.connector.common.NativeInfo
-
Returns a hash code value for this object.
- hashCode() - Method in class io.aiven.commons.kafka.connector.common.templating.Parameter
- hashCode() - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
- hashCode() - Method in record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Returns a hash code value for this object.
- hasNext() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecordIterator
-
Gets the logger for the concrete implementation.
- hasParameter() - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable
-
Determines if there is a parameter descriptor.
- hasParameter() - Method in class io.aiven.commons.kafka.connector.common.templating.VariableTemplatePart
-
Determines if this variable template has a parameter associated.
- hasValidator() - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
-
Determines if a validator is available.
- hideCompressionType(boolean) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigDef
-
This method hides the compression type from documentation but does not make it unconfigurable
- hideDistributionType(boolean) - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig.SourceCommonConfigDef
-
This method hides the distribution type from documentation but does not make them unconfigurable
- hideExtractorBuffer(boolean) - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig.SourceCommonConfigDef
-
This method hides the extractor buffer from documentation but does not make them unconfigurable
- hideExtractorCacheSize(boolean) - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig.SourceCommonConfigDef
-
This method hides the extractor cache size from documentation but does not make them unconfigurable
- hideExtractorCSVHeaders(boolean) - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig.SourceCommonConfigDef
-
This method hides the extractor csv headers from documentation but does not make them unconfigurable
- hideExtractorCSVHeadersEnabled(boolean) - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig.SourceCommonConfigDef
-
This method hides the extractor csv headers enabled from documentation but does not make them unconfigurable
- hideExtractorExtractorClass(boolean) - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig.SourceCommonConfigDef
-
This method hides the extractor class enabled from documentation but does not make them unconfigurable
- hideNativeStartKey(boolean) - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig.SourceCommonConfigDef
-
This method hides the native start key from documentation but does not make them unconfigurable
- hideRingBufferSize(boolean) - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig.SourceCommonConfigDef
-
This method hides the ring buffer size from documentation but does not make them unconfigurable.
I
- incrementRecordCount() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Increments the record count as recorded by the OffsetManager for the native item that this source record is working with.
- incrementRecordCount() - Method in interface io.aiven.commons.kafka.connector.source.OffsetManager.OffsetManagerEntry
-
Increments the record count.
- info - Variable in class io.aiven.commons.kafka.connector.source.extractor.Extractor
-
The info for this Extractor
- info() - Static method in class io.aiven.commons.kafka.connector.source.extractor.AvroExtractor
-
Gets the registry information for this extractor.
- info() - Static method in class io.aiven.commons.kafka.connector.source.extractor.ByteArrayExtractor
-
Gets the registry information for this extractor.
- info() - Static method in class io.aiven.commons.kafka.connector.source.extractor.CsvExtractor
-
Gets the registry information for this extractor.
- info() - Static method in class io.aiven.commons.kafka.connector.source.extractor.JsonExtractor
-
Gets the registry information for this extractor.
- info() - Static method in class io.aiven.commons.kafka.connector.source.extractor.ParquetExtractor
-
Gets the registry information for this extractor.
- inputOpened(InputStream) - Method in class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor.StreamSpliterator
-
Allows modification of input stream.
- inputStream - Variable in class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor.StreamSpliterator
-
* The input stream.
- InputStreamExtractor - Class in io.aiven.commons.kafka.connector.source.extractor
-
Extracts data from the EvolvingSourceRecord to a Key SchemaAndValue object and a stream of SchemaAndValue objects for the values.
- InputStreamExtractor(SourceCommonConfig, ExtractorInfo) - Constructor for class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor
-
Constructs a extractor that processes an input stream rather than a stream of objects.
- InputStreamExtractor.StreamSpliterator - Class in io.aiven.commons.kafka.connector.source.extractor
-
A Spliterator that performs various checks on the opening/closing of the input stream.
- io.aiven.commons.kafka.connector.common - package io.aiven.commons.kafka.connector.common
- io.aiven.commons.kafka.connector.common.config - package io.aiven.commons.kafka.connector.common.config
- io.aiven.commons.kafka.connector.common.config.validator - package io.aiven.commons.kafka.connector.common.config.validator
- io.aiven.commons.kafka.connector.common.documentation - package io.aiven.commons.kafka.connector.common.documentation
- io.aiven.commons.kafka.connector.common.templating - package io.aiven.commons.kafka.connector.common.templating
-
Contains code to support Templating in connectors.
- io.aiven.commons.kafka.connector.source - package io.aiven.commons.kafka.connector.source
- io.aiven.commons.kafka.connector.source.config - package io.aiven.commons.kafka.connector.source.config
- io.aiven.commons.kafka.connector.source.extractor - package io.aiven.commons.kafka.connector.source.extractor
- io.aiven.commons.kafka.connector.source.lookback - package io.aiven.commons.kafka.connector.source.lookback
- io.aiven.commons.kafka.connector.source.task - package io.aiven.commons.kafka.connector.source.task
- isCsvExtractorHeaderEnabled() - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig
-
Gets the CSV header enabled flag.
- isCsvExtractorHeaderEnabled() - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Gets the CSV extractor header enable flag.
- isEmpty() - Method in class io.aiven.commons.kafka.connector.common.templating.Parameter
-
Determines if this is empty.
- isKeyConverterRegistryEnabled() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfig
-
Returns
trueif the key converter schema registry is enabled. - isKeyConverterRegistryEnabled() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment
-
Gets the key converter schema registry enabled flag.
- isRequired() - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
-
Gets the required flag.
- isRunning() - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceTask
-
Returns the running state of the task.
- isSchemaRegistryEnabled() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfig
-
Returns
trueif the schema registry is enabled. - isSchemaRegistryEnabled() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment
-
Gets the schema registry enabled flag.
- isValueConverterRegistryEnabled() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfig
-
Returns
trueif the value converter schema registry is enabled. - isValueConverterRegistryEnabled() - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment
-
Gets the value converter schema registry enabled flag.
J
- JsonExtractor - Class in io.aiven.commons.kafka.connector.source.extractor
-
Transforms an input stream into a number of Jason records.
- JsonExtractor(SourceCommonConfig) - Constructor for class io.aiven.commons.kafka.connector.source.extractor.JsonExtractor
-
Constructs the JSON Extractor with the specified config.
K
- KEY - Static variable in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable
-
The standard key definition
- keyConverterSchemaRegistry(String) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment.Setter
-
Sets the key converter schema registry URL.
- keyConverterSchemaRegistry(URI) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment.Setter
-
Sets the key converter schema registry URL.
L
- lastEvolution(EvolvingSourceRecord) - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceTask
-
An insertion point for the last evolution step in the EvolvingSourceRecord.
- LastKey<K extends Comparable<K>> - Class in io.aiven.commons.kafka.connector.source.lookback
-
A Lookback that only tracks the last key seen.
- LastKey() - Constructor for class io.aiven.commons.kafka.connector.source.lookback.LastKey
-
Constructor.
- list() - Method in class io.aiven.commons.kafka.connector.source.extractor.ExtractorRegistry
-
Gets the list of extractor info for this registry.
- listVariables() - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariableRegistry
-
Returns a list of registered template variables.
- logger - Variable in class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor.StreamSpliterator
-
The logger to be used by all instances of this class.
- Lookback<K extends Comparable<K>> - Interface in io.aiven.commons.kafka.connector.source.lookback
-
Defines the strategy for providing the next key for the client to search for.
M
- MAX_POLL_TIME - Static variable in class io.aiven.commons.kafka.connector.source.AbstractSourceTask
-
The maximum time to spend polling.
- maxPollRecords(int) - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment.Setter
-
Set the maximum poll records.
- multiValidate(Map<String, ConfigValue>) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigDef
- multiValidate(Map<String, ConfigValue>) - Method in class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig.SourceCommonConfigDef
N
- NATIVE_START_KEY - Static variable in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
The name of the native start key property.
- nativeInfo - Variable in class io.aiven.commons.kafka.connector.source.AbstractSourceNativeInfo
-
Package protected for NativeSourceData use
- NativeInfo<K extends Comparable<K>,
N> - Record Class in io.aiven.commons.kafka.connector.common -
Information about the Native object.
- NativeInfo(K, N) - Constructor for record class io.aiven.commons.kafka.connector.common.NativeInfo
-
Creates an instance of a
NativeInforecord class. - nativeItem() - Method in record class io.aiven.commons.kafka.connector.common.NativeInfo
-
Returns the value of the
nativeItemrecord component. - nativeKey() - Method in record class io.aiven.commons.kafka.connector.common.NativeInfo
-
Returns the value of the
nativeKeyrecord component. - nativeKey() - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceNativeInfo
-
Gets the native key.
- NativeSourceData<K extends Comparable<K>> - Class in io.aiven.commons.kafka.connector.source
-
A data source for native info from a source.
- NativeSourceData(SourceCommonConfig, OffsetManager) - Constructor for class io.aiven.commons.kafka.connector.source.NativeSourceData
-
Constructor
- NativeSourceData.KeySerde<K> - Interface in io.aiven.commons.kafka.connector.source
-
A serializer / deserializer pair for a native key.
- nativeStartKey(String) - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment.Setter
-
Sets the initial native key to start from.
- next() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecordIterator
- NO_PARAMETER - Static variable in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
-
The NO PARAMETER instance.
- noFeatures() - Method in record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Determines if the extractor supports no additional features.
- None<K extends Comparable<K>> - Class in io.aiven.commons.kafka.connector.source.lookback
-
Lookback that does not track any keys.
- None() - Constructor for class io.aiven.commons.kafka.connector.source.lookback.None
-
Constructor.
- NULL_RESULT - Static variable in class io.aiven.commons.kafka.connector.source.AbstractSourceTask
-
A
nulllist representing no values in the polling functionality.
O
- OBJECT_HASH - Enum constant in enum class io.aiven.commons.kafka.connector.source.task.DistributionType
-
Object_Hash takes the context and uses the storage key implementation to get a hash value of the storage key and return a modulus of that relative to the number of maxTasks to decide which task should process a given object
- of(String) - Static method in class io.aiven.commons.kafka.connector.common.templating.Template
-
Deprecated.
- of(String, String) - Static method in class io.aiven.commons.kafka.connector.common.templating.Parameter
-
Creates a Parameter from a name and value.
- OffsetManager - Class in io.aiven.commons.kafka.connector.source
-
An offset manager that handles local updates to Kafka offset manager.
- OffsetManager(SourceTaskContext) - Constructor for class io.aiven.commons.kafka.connector.source.OffsetManager
-
Constructor
- OffsetManager.OffsetManagerEntry - Interface in io.aiven.commons.kafka.connector.source
-
The definition of an entry in the OffsetManager.
- OffsetManager.OffsetManagerKey - Interface in io.aiven.commons.kafka.connector.source
-
The OffsetManager Key.
- ofSize(int) - Static method in interface io.aiven.commons.kafka.connector.source.lookback.Lookback
-
Creates a Lookback of the specified size.
- originalTemplate() - Method in class io.aiven.commons.kafka.connector.common.templating.Template
-
Return the original template pattern.
P
- Parameter - Class in io.aiven.commons.kafka.connector.common.templating
-
A parameter is a name/value pair
- parameterDescriptor(ParameterDescriptor) - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable.Builder
-
Sets the parameter descriptor for this variable.
- parameterDescriptor(ParameterDescriptor.Builder) - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable.Builder
-
Sets the parameter descriptor for this variable.
- ParameterDescriptor - Class in io.aiven.commons.kafka.connector.common.templating
-
The Description of a parameter including the name and an input validator.
- ParameterDescriptor(String, boolean, List<String>) - Constructor for class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
-
Deprecated.use
ParameterDescriptor.builder(String)and fluent builder. - ParameterDescriptor.Builder - Class in io.aiven.commons.kafka.connector.common.templating
-
The builder for a ParameterDescriptor.
- ParquetExtractor - Class in io.aiven.commons.kafka.connector.source.extractor
-
A Extractor that converts an input stream from a Parquet file into individual kafka messages, one per record.
- ParquetExtractor(SourceCommonConfig) - Constructor for class io.aiven.commons.kafka.connector.source.extractor.ParquetExtractor
-
Constructs a ParquetExtractor using the values from the configuration.
- parse(String, TemplateVariableRegistry) - Static method in class io.aiven.commons.kafka.connector.common.templating.TemplateParser
-
Parses the template.
- PARTITION - Enum constant in enum class io.aiven.commons.kafka.connector.source.task.DistributionType
-
Partition takes the context and requires the context contain the partition id for it to be able to decide the distribution across the max tasks, using a modulus to ensure even distribution against the configured max tasks
- PARTITION - Static variable in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable
-
the standard partition definition
- poll() - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceTask
- populateOffsetManager(Collection<OffsetManager.OffsetManagerKey>) - Method in class io.aiven.commons.kafka.connector.source.OffsetManager
-
Gets any offset information stored in the offsetStorageReader and adds to the local offsets Map.
- postProcess(CommonConfig.ChangeTrackingMap) - Static method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment
-
Ensure that the various URLs and enablements are set correctly.
- PRIVATE_FEATURE_SHIFT - Static variable in record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Offset shift for private features.
R
- registry(String) - Method in class io.aiven.commons.kafka.connector.common.documentation.TemplateVarsFactory
-
Constructs the TemplateVariableRegistry for the named class that will create an instance of TemplateVariableRegistry.
- RELAX_SCHEMES - Static variable in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment
-
name of java property that if set allows http to be used in URLs
- remove() - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecordIterator
- remove(TemplateVariable) - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariableRegistry.Builder
-
Removes a template variable from the builder.
- remove(TemplateVariableRegistry) - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariableRegistry.Builder
-
Removes a template variable registry from the builder.
- removeEntry(OffsetManager.OffsetManagerKey) - Method in class io.aiven.commons.kafka.connector.source.OffsetManager
-
Removes the specified entry from the in memory table.
- removeEntry(SourceRecord) - Method in class io.aiven.commons.kafka.connector.source.OffsetManager
-
Removes the specified entry from the in memory table.
- render() - Method in class io.aiven.commons.kafka.connector.common.templating.Template.Bound
-
Renders the template parts.
- render(Map<String, Function<Parameter, String>>) - Method in interface io.aiven.commons.kafka.connector.common.templating.TemplatePart
-
Renders the template part using the bindings as necessary.
- render(Map<String, Function<Parameter, String>>) - Method in class io.aiven.commons.kafka.connector.common.templating.TextTemplatePart
- render(Map<String, Function<Parameter, String>>) - Method in class io.aiven.commons.kafka.connector.common.templating.VariableTemplatePart
- required(boolean) - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor.Builder
-
Sets the required flag.
- resize(int) - Method in class io.aiven.commons.kafka.connector.source.lookback.Buffer
- resize(int) - Method in interface io.aiven.commons.kafka.connector.source.lookback.Lookback
-
Resize the lookback.
- ringBufferSize(int) - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment.Setter
-
Sets the ring buffer size.
S
- SchemaAndValueFactory - Class in io.aiven.commons.kafka.connector.source.extractor
-
A factory to create
SchemaAndValueinstances from arbitrary Objects. - schemaRegistry(String) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment.Setter
-
Sets the schema registry URL.
- schemaRegistry(URI) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment.Setter
-
Sets the schema registry URL.
- setKeyData(SchemaAndValue) - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Sets the key data for this source record.
- setOffset(Long) - Method in class io.aiven.commons.kafka.connector.source.task.Context
-
Sets the native offset for this context.
- setOffsetManagerEntry(OffsetManager.OffsetManagerEntry) - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Sets the offset manager entry for this source record.
- setPartition(Integer) - Method in class io.aiven.commons.kafka.connector.source.task.Context
-
Sets the Kafka partition for this context.
- setProperty(String, Object) - Method in interface io.aiven.commons.kafka.connector.source.OffsetManager.OffsetManagerEntry
-
Sets a key/value pair.
- setter(Map<String, String>) - Static method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment
-
Creates a Setter for this fragment.
- setter(Map<String, String>) - Static method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Creates a Setter for this fragment.
- Setter(Map<String, String>) - Constructor for class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment.Setter
-
Constructor.
- Setter(Map<String, String>) - Constructor for class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment.Setter
-
Constructor.
- setTopic(String) - Method in class io.aiven.commons.kafka.connector.source.task.Context
-
Sets the Kafka topic for this context.
- setValueData(SchemaAndValue) - Method in class io.aiven.commons.kafka.connector.source.EvolvingSourceRecord
-
Sets the value data for this source record.
- size() - Method in class io.aiven.commons.kafka.connector.source.lookback.Buffer
- size() - Method in class io.aiven.commons.kafka.connector.source.lookback.LastKey
- size() - Method in interface io.aiven.commons.kafka.connector.source.lookback.Lookback
-
Gets the number of keys this Lookback can store.
- size() - Method in class io.aiven.commons.kafka.connector.source.lookback.None
- SourceCommonConfig - Class in io.aiven.commons.kafka.connector.source.config
-
The common definitions for source connectors.
- SourceCommonConfig(SourceCommonConfig.SourceCommonConfigDef, Map<String, String>) - Constructor for class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig
-
Constructor.
- SourceCommonConfig.SourceCommonConfigDef - Class in io.aiven.commons.kafka.connector.source.config
-
The common source configuration definition.
- SourceCommonConfigDef() - Constructor for class io.aiven.commons.kafka.connector.source.config.SourceCommonConfig.SourceCommonConfigDef
-
Constructor.
- SourceConfigFragment - Class in io.aiven.commons.kafka.connector.source.config
-
Defines properties that are shared across all Source implementations.
- SourceConfigFragment(FragmentDataAccess) - Constructor for class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Construct the SourceConfigFragment.
- SourceConfigFragment.Setter - Class in io.aiven.commons.kafka.connector.source.config
-
The SourceConfigFragment setter.
- STANDARD - Static variable in class io.aiven.commons.kafka.connector.source.extractor.ExtractorRegistry
-
The standard extractors.
- STANDARD_SINK - Static variable in class io.aiven.commons.kafka.connector.common.templating.TemplateVariableRegistry
-
A registry of the standard variables used in a Sink connector.
- start(Map<String, String>) - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceTask
- START_OFFSET - Static variable in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable
-
the standard start offset definition
- stillPolling() - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceTask
-
Returns
trueif the connector is not stopped and the timer has not expired. - stop() - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceTask
- StreamSpliterator(Logger, IOSupplier<InputStream>) - Constructor for class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor.StreamSpliterator
-
Constructor.
- STRING_SERDE - Static variable in interface io.aiven.commons.kafka.connector.source.NativeSourceData.KeySerde
-
Many storage implementations use String keys.
T
- targetTopic(String) - Method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment.Setter
-
Sets the target topic.
- Template - Class in io.aiven.commons.kafka.connector.common.templating
-
A parsed template string.
- Template.Bound - Class in io.aiven.commons.kafka.connector.common.templating
-
A Template with bindings for the variables.
- Template.BoundBuilder - Class in io.aiven.commons.kafka.connector.common.templating
-
A builder for Template.Bound instances.
- Template.Extractor - Class in io.aiven.commons.kafka.connector.common.templating
-
Given a template, the
Template.Extractorfinds the matching variables from a string. - TemplateParser - Class in io.aiven.commons.kafka.connector.common.templating
-
A parser for a template
- TemplatePart - Interface in io.aiven.commons.kafka.connector.common.templating
-
A fragment of the template as segregated by the parser.
- TemplateValidator - Class in io.aiven.commons.kafka.connector.common.config.validator
-
A validator for templates.
- TemplateValidator(TemplateVariableRegistry) - Constructor for class io.aiven.commons.kafka.connector.common.config.validator.TemplateValidator
-
Creates a TemplateValidator that will, at a minimum, validate that the format of the template is correct.
- TemplateVariable - Class in io.aiven.commons.kafka.connector.common.templating
-
The template variable definition.
- TemplateVariable.Builder - Class in io.aiven.commons.kafka.connector.common.templating
-
A builder for TemplateVariable instances.
- TemplateVariableRegistry - Class in io.aiven.commons.kafka.connector.common.templating
-
A registry of template variables.
- TemplateVariableRegistry.Builder - Class in io.aiven.commons.kafka.connector.common.templating
-
Builder for VariableTemplateRegistries.
- TemplateVarsFactory - Class in io.aiven.commons.kafka.connector.common.documentation
-
Creates instances of TemplateVariableRegistry for generated documentation.
- TemplateVarsFactory() - Constructor for class io.aiven.commons.kafka.connector.common.documentation.TemplateVarsFactory
-
default constructor
- TextTemplatePart - Class in io.aiven.commons.kafka.connector.common.templating
-
A piece of static text extracted by the parser.
- TIMESTAMP - Static variable in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable
-
The standard timestamp definition
- TOPIC - Static variable in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable
-
the standard topic definition
- toString() - Method in class io.aiven.commons.kafka.connector.common.config.validator.TemplateValidator
- toString() - Method in record class io.aiven.commons.kafka.connector.common.NativeInfo
-
Returns a string representation of this record class.
- toString() - Method in class io.aiven.commons.kafka.connector.common.templating.Parameter
- toString() - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
-
Gets the validator description.
- toString() - Method in class io.aiven.commons.kafka.connector.common.templating.Template
- toString() - Method in class io.aiven.commons.kafka.connector.source.AbstractSourceNativeInfo
- toString() - Method in record class io.aiven.commons.kafka.connector.source.extractor.ExtractorInfo
-
Returns a string representation of this record class.
- toString() - Method in class io.aiven.commons.kafka.connector.source.task.Context
- toString(K) - Method in interface io.aiven.commons.kafka.connector.source.NativeSourceData.KeySerde
-
Creates a parsable string representation of a native key.
- tryAdvance(Consumer<? super SchemaAndValue>) - Method in class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor.StreamSpliterator
- trySplit() - Method in class io.aiven.commons.kafka.connector.source.extractor.InputStreamExtractor.StreamSpliterator
U
- UNKNOWN_STREAM_LENGTH - Static variable in class io.aiven.commons.kafka.connector.source.AbstractSourceNativeInfo
-
Value to be returned when the length of the stream is unknown.
- update(ConfigDef) - Static method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment
-
Update the configuration definition with the properties for this fragment.
- update(ConfigDef) - Static method in class io.aiven.commons.kafka.connector.source.config.SourceConfigFragment
-
Update the configuration definition with the properties for the source configuration.
V
- validate(String, String, Parameter) - Method in class io.aiven.commons.kafka.connector.common.templating.TemplateVariable
-
Validate the parameter against the template variable.
- validate(String, String, TemplateVariableRegistry) - Static method in class io.aiven.commons.kafka.connector.common.templating.TemplateParser
-
Validates that the template string is parsable.
- validate(String, String, String) - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
-
Validates that the template contains a proper value.
- validate(Map<String, ConfigValue>) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment
- validator() - Method in class io.aiven.commons.kafka.connector.source.extractor.ExtractorRegistry
-
Creates a validator that restricts input to the extractor names in this registry.
- validator(ConfigDef.Validator) - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor.Builder
-
Sets the validator.
- validValues() - Method in class io.aiven.commons.kafka.connector.common.templating.ParameterDescriptor
-
Gets the valid values for this parameter.
- valueConverterSchemaRegistry(String) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment.Setter
-
Sets the value converter schema registry URL.
- valueConverterSchemaRegistry(URI) - Method in class io.aiven.commons.kafka.connector.common.config.ConnectorCommonConfigFragment.Setter
-
Sets the value converter schema registry URL.
- valueOf(String) - Static method in enum class io.aiven.commons.kafka.connector.source.task.DistributionType
-
Returns the enum constant of this class with the specified name.
- values() - Static method in enum class io.aiven.commons.kafka.connector.source.task.DistributionType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- variables() - Method in class io.aiven.commons.kafka.connector.common.templating.Template
-
Creates a new list of variable names.
- variablesSet() - Method in class io.aiven.commons.kafka.connector.common.templating.Template
-
Creates a new set of variable names.
- variablesWithNonEmptyParameters() - Method in class io.aiven.commons.kafka.connector.common.templating.Template
-
Gets a list of variable names to parameters where the parameters are known to be non empty.
- variablesWithParameters() - Method in class io.aiven.commons.kafka.connector.common.templating.Template
-
Gets a list of variable names to parameters.
- VariableTemplatePart - Class in io.aiven.commons.kafka.connector.common.templating
-
A template part tht contains a variable definition.
All Classes and Interfaces|All Packages|Constant Field Values
TemplateParser.parse(String, TemplateVariableRegistry)