Skip to main content
Ctrl+K
PyFlink 1.20+vvr.11.7.dev0 documentation - Home PyFlink 1.20+vvr.11.7.dev0 documentation - Home
  • API Reference
  • Examples
  • API Reference
  • Examples

Section Navigation

  • PyFlink Table
  • PyFlink DataStream
    • StreamExecutionEnvironment
    • DataStream
    • Functions
    • State
    • Timer
    • Window
    • Checkpoint
    • Side Outputs
    • Asynchronous I/O
    • Connectors
    • Formats
  • PyFlink DataFrame
  • PyFlink Common
  • API Reference
  • PyFlink DataStream
  • Connectors
  • pyflink.datastream.connectors.file_system.BucketAssigner

pyflink.datastream.connectors.file_system.BucketAssigner#

class BucketAssigner(j_bucket_assigner)[source]#

A BucketAssigner is used with a file sink to determine the bucket each incoming element should be put into.

The StreamingFileSink can be writing to many buckets at a time, and it is responsible for managing a set of active buckets. Whenever a new element arrives it will ask the BucketAssigner for the bucket the element should fall in. The BucketAssigner can, for example, determine buckets based on system time.

Methods

base_path_bucket_assigner()

Creates a BucketAssigner that does not perform any bucketing of files.

date_time_bucket_assigner([format_str, ...])

Creates a BucketAssigner that assigns to buckets based on current system time.

get_java_object()

previous

pyflink.datastream.connectors.file_system.FileSource

next

pyflink.datastream.connectors.file_system.RollingPolicy

On this page
  • BucketAssigner

This Page

  • Show Source

Created using Sphinx 7.4.7.

Built with the PyData Sphinx Theme 0.16.1.