Hi there, I'm struggling with the `tap.properties....
# announcements
b
Hi there, I'm struggling with the
tap.properties.json
file...: where should it be stored to be correctly picked-up by
meltano
? I have it stored under
.meltano/extractors/tap_salesforce_soap/tap.properties.json
but it does not seem to work. When running
meltano elt tap_salesforce_soap target-csv
, it runs for 2 seconds, I get
Copy code
meltano             | Running extract & load...
meltano             | No state was found, complete import.
tap-salesforce-soap | INFO Attempting login via SOAP <https://test.salesforce.com/services/Soap/u/41.0>
target-csv          | INFO Sending version information to <http://singer.io|singer.io>. To disable sending anonymous usage data, set the config parameter "disable_collection" to true
tap-salesforce-soap | INFO SOAP login successful
meltano             | Extract & load complete!
meltano             | Transformation skipped.
but nothing happens (no data being extracted). However, when I output my config to
config.json
(
meltano config tap_salesforce_soap > config.json
) and then I run
.meltano/extractors/tap_salesforce_soap/venv/bin/tap_salesforce_soap --config config.json --properties .meltano/extractors/tap_salesforce_soap/tap.properties.json
, it runs perfectly, and I see data being extracted. What am I missing here? thanks a mil
d
@benjamin_maquet Did you see https://meltano.com/docs/integration.html#extractor-catalog-generation? Modifying
.meltano/extractors/tap_salesforce_soap/tap.properties.json
directly doesn't work, you can either provide your own catalog file using
catalog: <path>
in
meltano.yml
or
--catalog=<path>
on
meltano elt
, or use Meltano's own catalog discovery and generation capabilities.
If you want to see exactly how the tap gets executed, you can use
meltano --log-level=debug elt ...
b
thanks, didnt see this catalog option! will look at it
d
Also see the "What if I already have a catalog file" section in https://meltano.com/docs/getting-started.html#select-entities-and-attributes-to-extract 🙂
b
perfect! amazing!
Hey @douwe_maan, it still didnt work as-is but I was able to understand the problem. I'm using a custom
salesforce
tap that accepts connection via SOAP, and this tap didn't recognize
--catalog
, it only worked with
--properties
. I have made the changes on my custom tap and now it works. Thanks!