Skip to main content

io.VersionedSource

What a pipeline needs of a source: a table with integer versions that

Usage

Source

io.VersionedSource()

hands out its snapshot and its change between two versions. Delta and Iceberg tables implement it (sverify.io).

Sources you write yourself usually subclass sverify.io.Source instead, which implements this protocol on top of one read method. Implement it directly for a table format with metadata facts and a change feed; SourceBatch.from_changes and from_snapshot build what changes returns.

Attributes

name: str
The table’s name in the plans that read it.

Attributes

Name Description
name The table’s name in the views that read it.

name

The table’s name in the views that read it.

name: str

Methods

Name Description
changes() The change from version since to until (default: the latest).
latest() The table’s latest version.
schema() The table’s schema at its latest version.
snapshot() The table at version, or at its latest version.

changes()

The change from version since to until (default: the latest).

Usage

Source

changes(since, until=None)

latest()

The table’s latest version.

Usage

Source

latest()

schema()

The table’s schema at its latest version.

Usage

Source

schema()

snapshot()

The table at version, or at its latest version.

Usage

Source

snapshot(version=None)