Open minor issue in `tap-ga4` <https://github.com/...
# plugins-general
d
p
@dima_anoshin thanks for raising this! It should be fixed now
d
@pat_nadolny does Google Analytics support incremental load? I am using this plugin:
Copy code
extractors:
    - name: tap-google-analytics-4
      namespace: tap_google_analytics_4
      variant: meltanolabs
      pip_url: git+<https://github.com/MeltanoLabs/tap-google-analytics.git>
      executable: tap-google-analytics
      config:
        start_date: "2023-06-22"
        client_secrets:
          type: service_account
          project_id: $GOOGLE_ANALYTICS_PROJECT_ID
          private_key_id: $GOOGLE_ANALYTICS_PRIVATE_KEY_ID
          private_key: $GOOGLE_ANALYTICS_PRIVATE_KEY
          client_email: $GOOGLE_ANALYTICS_CLIENT_EMAIL
          client_id: $GOOGLE_ANALYTICS_CLIENT_ID
          auth_uri: $GOOGLE_ANALYTICS_AUTH_URI
          token_uri: $GOOGLE_ANALYTICS_TOKEN_URI
          auth_provider_x509_cert_url: $GOOGLE_ANALYTICS_AUTH_PROVIDER_X509_CERT_URL
          client_x509_cert_url: $GOOGLE_ANALYTICS_CLIENT_X509_CERT_URL
          universe_domain: $GOOGLE_ANALYTICS_UNIVERSE_DOMAIN
        property_id: $GOOGLE_ANALYTICS_PROPERTY_ID_GLOBAL
        reports: google_analytics_reports/reports.json
        capabilities:
          - state
        metadata:
          "*":
            replication-method: INCREMENTAL
            replication-key: date
and run extract to S3 using
--state_id
Copy code
meltano elt tap-google-analytics-4 target-s3 --state-id google_analytics_default_reports_s3
but I noticed that every day it still loads all data.
p
it should support state. It looks like you have some attributes in your configuration that are only used for custom plugins (i.e. not listed on the hub and native supported by meltano). I wonder if those are affecting this somehow. I'd suggest removing and re-adding that plugin from your project and only add the
config
and
metadata
settings back in
d
thank you Pat, do you mean
capabilities
?
my bad, wrong identation for settings