Andy Carter
04/17/2023, 8:55 AMsince
timestamp parameter, it just returns all appropriate records, but I can override get_records
and only yield row where timestamp
is after the last time I ran.
How can I get the relevant state in get_records
if this is a child stream?
def get_records(self, context: dict | None) -> Iterable[dict[str, Any]]:
for record in self.request_records(context):
transformed_record = self.post_process(record, context)
if self.stream_state: # do something here?
yield record