pyspark.sql.datasource.DataSourceStreamReader.commit#

DataSourceStreamReader.commit(end)[source]#

Informs the source that Spark has completed processing all data for offsets less than or equal to end and will only request offsets greater than end in the future.

Parameters
enddict

The latest offset that the streaming query has processed for this source.