I'm using this simple workflow

meltano run tap-jaffle-shop target-s3

The extractor works fine when run standalone, but when I use the full pipeline it fails over a

BrokenPipeError

. I couldn't find the specific error even in the logs. Any idea how to troubleshoot that?

Check out these troubleshooting tips and see if they help. Usually writing the tap output to a file

meltano invoke tap-jaffle-shop > data.json

then passing that into the target helps isolate the issue

cat data.json | meltano invoke target-s3

Here's ther yml

version: 1
default_environment: dev
project_id: 64d48650-31b5-42e2-844a-be27341a6b33
environments:
- name: dev
- name: staging
- name: prod
plugins:
  extractors:
  - name: tap-jaffle-shop
    variant: meltanolabs
    pip_url: git+<https://github.com/MeltanoLabs/tap-jaffle-shop.git>
  loaders:
  - name: target-jsonl
    variant: andyh1203
    pip_url: target-jsonl
  - name: target-s3
    variant: crowemi
    pip_url: git+<https://github.com/crowemi/target-s3.git>
    config:
      aws_region: us-east2
      bucket: mytest

Try adding

format_type: csv

I think thats a mandatory config but the tap doesnt advertise it that way