Do it possible to edit code of tap-facebook after install in meltano?

@anton_parfenyuk Yes! Locally, you'll want to clone https://gitlab.com/meltano/tap-facebook/ to a directory of your choice, make the changes, increment the version number in

setup.py

, change the

pip_url

for

tap-facebook

in your

meltano.yml

to

-e path/to/tap-facebook

, and then run

meltano install extractor tap-facebook

. Because of the

-e

flag, it'll be installed as editable, so you can keep making changes and rerun

meltano elt

to see the result, without having to rerun

meltano install

each time. Then when you're happy with your changes, you can fork https://gitlab.com/meltano/tap-facebook/ to your own namespace, push up your own changes, and change the

pip_url

to point at your own repo instead of Meltano's, followed by another run of

meltano install extractor tap-facebook

. If

meltano install extractor tap-facebook

doesn't seem to actually install the new version, you can delete the current installation at

.meltano/extractors/tap-facebook/venv

and re-run the install command to make sure you get the new version

@douwe_maan also have questions about extractors. Is possible to create multiple extractors with different ads accounts?

@anton_parfenyuk I found this issue to be helpful in figuring out different profiles! https://gitlab.com/meltano/meltano/-/issues/764

Case: I have 50+ ads accounts and i need download data from all this accounts every day to database. But, in meltano web panel i didn’t see button for add additional extractor.

I can send a config and cli example if that’s helpful! But I don’t use the ui, so not sure how to integrate things there

@paul_blankley, maybe you know. Currently i download data in test mode for understand how much data i can download. And I have questions. 1. I run pipeline 2 days ago and he still working. Elapsed 2 days 20 hours 2 min 28 sec 2. This pipeline not extract any data for next tables : adcreative, ads, adsets, campaigns. And i sure that this data exist. Permissions next: Scopes ads_management, ads_read, public_profile

@anton_parfenyuk it sounds like your

start_date

field is set before the account creation. I had a similar problem, and that was my issue

account created in pass year. Date set to 2020-01-01

btw my

meltano.yml

config example for multiple profiles looks like this

version: 1
send_anonymous_usage_stats: false
plugins:
  extractors:
  - name: tap-shopify
    pip_url: tap-shopify==1.2.0
    config:
      shop: not-sure-if-this-needs-to-be-here
    select:
    - abandoned_checkouts.*
    - collects.*
    - custom_collections.*
    - customers.*
    - order_refunds.*
    - orders.*
    - products.*
    - transactions.*
    profiles:
    - name: my-profile
      label: Profile_name
      config:
        api_key: <YOUR_API_KEY>
        shop: random-store
        start_date: '2020-07-23'
    - name: other-profile
      label: Other_profile_name
      config:
        api_key: <YOUR_API_KEY>
        shop: diff-store
        start_date: '2020-08-04'

Is possible to create multiple extractors with different ads accounts?

@anton_parfenyuk Yes! You're going to want to add multiple pipelines using the same extractor, rather than add multiple extractors. Check out https://meltano.com/docs/command-line-interface.html#plugin-configuration