io.VersionedSource
What a pipeline needs of a source: a table with integer versions that
Usage
io.VersionedSource()hands out its snapshot and its change between two versions. Delta and Iceberg tables implement it (sverify.io).
Sources you write yourself usually subclass sverify.io.Source instead, which implements this protocol on top of one read method. Implement it directly for a table format with metadata facts and a change feed; SourceBatch.from_changes and from_snapshot build what changes returns.
Attributes
name: str- The table’s name in the plans that read it.
Attributes
| Name | Description |
|---|---|
| name | The table’s name in the views that read it. |
name
The table’s name in the views that read it.
name: str
Methods
| Name | Description |
|---|---|
| changes() |
The change from version since to until (default: the latest).
|
| latest() | The table’s latest version. |
| schema() | The table’s schema at its latest version. |
| snapshot() |
The table at version, or at its latest version.
|
changes()
The change from version since to until (default: the latest).
Usage
changes(since, until=None)latest()
The table’s latest version.
Usage
latest()schema()
The table’s schema at its latest version.
Usage
schema()snapshot()
The table at version, or at its latest version.
Usage
snapshot(version=None)