Cross posting from #CMN8HELB0 since I think this may be the right channel:

Hi all, I'm just getting into Meltano right now as I evaluate it and I'm a bit confused on the schema relationship between

streams.py

and

tap.py

specifically in the tap template. I read through the "Getting Started" template and the Code Samples on the site but still not really understanding it.

From my understanding is that the schema defined in the

streams.py

is the JSON that is being sent from the source and

tap.py

is the target? But then what happens when we load the cookiecutter target template? I thought taps was used for bringing in data from the source and target was used to send data to a target.

For example this is the flow I'm trying to create:

API source (using a tap) -> S3 bucket -> Postgres (I assume using a target?)

Hi Edward, I think your understanding of

streams.py

is correct. However, on the

tap.py

, you are defining the config settings for interacting with the API if needed, not target settings. For example, this is where you would add an API token or any other any other settings the API expects. You'll define your target as a separate package if needed and there is an SDK for that as well.

Additional comments added in the other thread: https://meltano.slack.com/archives/CMN8HELB0/p1647979665498349?thread_ts=1647904907.669799&cid=CMN8HELB0