Can I use state just to limit the amount of data g...
# singer-tap-development
a
Can I use state just to limit the amount of data getting written to the target? i.e. the API doesn't support a
since
timestamp parameter, it just returns all appropriate records, but I can override
get_records
and only yield row where
timestamp
is after the last time I ran. How can I get the relevant state in
get_records
if this is a child stream?
Copy code
def get_records(self, context: dict | None) -> Iterable[dict[str, Any]]:
        for record in self.request_records(context):
            transformed_record = self.post_process(record, context)
            if self.stream_state:  # do something here?
                yield record