Hi guys! I just discovered Meltano today and am currently trying to create a custom tap. I've been following one of the tutorials on YouTube by @aaronsteers (), am stuck while editing the streams.py file as my source (tap) has a different URL format than the one shown in the tutorial. Source: https://sunrise-sunset.org/api I've set the base URL as such, url_base = "https://api.sunrise-sunset.org/json", but I get responses with https://api.sunrise-sunset.org/json?lat=36.7201600&lng=-4.4203400&date=2022-06-15. I'm trying to get historical as well as incremental data from the source. Any help would be appreciated! Thanks in advance! :)

Hi @tushar_choudhary! Have you looked at get_url_params? You can override that method to define

lat

and

lng

, as well as

date

that you can get from get_starting_replication_key_value or get_starting_timestamp. For example: https://github.com/MeltanoLabs/tap-stackexchange/blob/fccd7e17643992930119f856cd7a34791265c36c/tap_stackexchange/client.py#L88-L116

Hi, @tushar_choudhary. Any luck with this? I was out last week but saw your ping today as I was catching up on threads. Let us know if we can help! 🙂