pyflink.datastream.formats.orc.OrcBulkWriters

class OrcBulkWriters

Convenient builder to create a BulkWriterFactory that writes records with a predefined schema into Orc files in a batch fashion.

Example:

>>> row_type = DataTypes.ROW([
...     DataTypes.FIELD('string', DataTypes.STRING()),
...     DataTypes.FIELD('int_array', DataTypes.ARRAY(DataTypes.INT()))
... ])
>>> sink = FileSink.for_bulk_format(
...     OUTPUT_DIR, OrcBulkWriters.for_row_type(
...         row_type=row_type,
...         writer_properties=Configuration(),
...         hadoop_config=Configuration(),
...     )
... ).build()
>>> ds.sink_to(sink)

Added in version 1.16.0.

Methods

for_row_type(row_type[, writer_properties, ...])

Create a BulkWriterFactory that writes records with a predefined schema into Orc files in a batch fashion.