Hi everyone I m trying to troubleshoot some issues with stat Meltano #troubleshooting

Hi everyone. I'm trying to troubleshoot some issue...

luke_pammant

01/18/2023, 5:19 PM

Hi everyone. I'm trying to troubleshoot some issues with state in my google analytics tap. I can see that the state looks correct via the CLI:

Copy code

$  meltano state get daily-ga-web-vitals-load
{"singer_state": {"bookmarks": {"web_vitals_13893214": {"replication_key": "ga_date", "replication_key_value": "20230117"}}}}

But the value I get for the state when running the tap is this:

State: {'starting_replication_value': '2022-09-01'}

This is the code I'm using to log the state in the tap:

Copy code

state = self.get_context_state(context)
<http://self.logger.info|self.logger.info>(f"State: {state}")

Any idea why the state isn't coming through properly? I'm wanting to get the "replication_key_value" so I can make sure not to re-query data that I already have.

luke_pammant

01/18/2023, 8:19 PM

Actually it looks like my

context

None

in the tap method

get_records

. Anyone have any insights on how I may be able to fix that? My understanding is that the base implementation of the

Stream

should get pass the context into

get_records

but it's always

None

even though I have verified the

state

is valid. I've even passed in the

state

via

--state

argument and it's always coming back empty

luke_pammant

01/19/2023, 5:27 AM

How can I debug the extractor in the context of the Meltano ELT pipeline? I’ve managed to get debugging working directly with the tap itself but I’m trying to see what is happening thats causing the context/state to not make it into my extractor when run via the

meltano elt

command

Open in Slack

Previous Next