hello, i have a question not sure where to ask it: 1. I’m currently trying to extract (tap-salesforce) data from salesforce and load it onto a json file (target-jsonl). 2. Then I want to extract (tap-singer-jsonl) from the json and load it onto mongodb (target-mongodb). however, the tap-singer-jsonl does not successfully extract the data from the json file. I also tried using targer-singer-jsonl instead of target-jsonl (in step 1) to test the singer config, but it says “run invocation could not be completed as block failed: Loader failed. Seems like a singer issue since I was able to do step 1 with target-jsonl

Can you share • the

meltano

command(s) you are running? • your

meltano.yml

file with secrets redacted • the full error stack trace if you can

I believe

tap-singer-jsonl

is only really meant to read JSONL records that conform to the Singer standard, so it wouldn't work with the output of

target-jsonl

. I believe you'd either want to use

tap-spreadsheets-anywhere

which does support reading from JSONL files, or use a database specific feature to read JSON files into MongoDB (like mongoimport)

thank you Andy and Mark for replying, Mark, I’m currently trying to configure the tap-spreadsheets-anywhere, but Im not sure what to set the tables to. So Im cd’d into a meltano_project in a k8s container, and have an Account.jsonl file stored in output. I would like to perform an extract and load, extracting the contents of Account.jsonl and load it onto mongodb (localhost) Andy, the commands I’m running are: 1. meltano add extractor tap-singer-jsonl 2. meltano add loader target-mongodb (ill paste the meltano.yml file below so you can see the config) 3. meltano run tap-singer-jsonl target-mongodb // under extractors - name: tap-singer-jsonl variant: kgpayne pip_url: tap-singer-jsonl config: files: - meltano_tenant2/output/Account_singer.jsonl // under loaders - name: target-mongodb variant: hotgluexyz pip_url: git+https://gitlab.com/hotglue/target-mongodb.git config: connection_string: mongodb//usernamepassword@mongodb-mongo:27017 db_name: tenant2_db I dont get a specific error but when I run 3. it says Block run completed. But nothing loads onto mongo. thank you!

I don't use tap-spreadsheets-anywhere or target-mongodb myself so it'd probably be best to post this to the channel and see if anyone else knows

no problem, figured it out