benjamin_maquet
11/27/2020, 1:45 PMtap.properties.json file...: where should it be stored to be correctly picked-up by meltano?
I have it stored under .meltano/extractors/tap_salesforce_soap/tap.properties.json but it does not seem to work.
When running meltano elt tap_salesforce_soap target-csv , it runs for 2 seconds, I get
meltano | Running extract & load...
meltano | No state was found, complete import.
tap-salesforce-soap | INFO Attempting login via SOAP <https://test.salesforce.com/services/Soap/u/41.0>
target-csv | INFO Sending version information to <http://singer.io|singer.io>. To disable sending anonymous usage data, set the config parameter "disable_collection" to true
tap-salesforce-soap | INFO SOAP login successful
meltano | Extract & load complete!
meltano | Transformation skipped.
but nothing happens (no data being extracted).
However, when I output my config to config.json (meltano config tap_salesforce_soap > config.json) and then I run .meltano/extractors/tap_salesforce_soap/venv/bin/tap_salesforce_soap --config config.json --properties .meltano/extractors/tap_salesforce_soap/tap.properties.json, it runs perfectly, and I see data being extracted.
What am I missing here?
thanks a mildouwe_maan
12/01/2020, 4:36 PM.meltano/extractors/tap_salesforce_soap/tap.properties.json directly doesn't work, you can either provide your own catalog file using catalog: <path> in meltano.yml or --catalog=<path> on meltano elt , or use Meltano's own catalog discovery and generation capabilities.douwe_maan
12/01/2020, 4:37 PMmeltano --log-level=debug elt ...benjamin_maquet
12/01/2020, 4:38 PMdouwe_maan
12/01/2020, 4:38 PMbenjamin_maquet
12/01/2020, 4:39 PMbenjamin_maquet
12/02/2020, 9:34 AMsalesforce tap that accepts connection via SOAP, and this tap didn't recognize --catalog , it only worked with --properties. I have made the changes on my custom tap and now it works. Thanks!