Hi I'm using `tap-s3-csv` to sync data to `target-...
# troubleshootingb
boggdan_barrientos
10/06/2021, 5:07 PMHi I'm using
tap-s3-csvtarget-redshift Copy code
[2021-10-06 14:43:40,191] [58|MainThread|urllib3.connectionpool] [DEBUG] Starting new HTTPS connection (1): <http://www.google-analytics.com:443|www.google-analytics.com:443>
[2021-10-06 14:43:40,217] [58|MainThread|urllib3.connectionpool] [DEBUG] <https://www.google-analytics.com:443> "POST /collect HTTP/1.1" 200 35--log-level=debug eltboggdan_barrientos
10/06/2021, 5:09 PM Copy code
target-redshift-raw | time=2021-10-06 14:43:38 name=target_redshift level=INFO message=Getting catalog objects from table cache...
tap-s3-csv | time=2021-10-06 14:43:39 name=tap_s3_csv level=INFO message=Attempting to create AWS session
meltano | DEBUG Deleted configuration at /meltano-project/.meltano/run/elt/2021-10-06T144328--tap-s3-csv--target-redshift-raw/22a658d1-1178-437d-a168-896bd0d6811f/target.89a2a2f8-0183-4b98-964c-00af529a6155.config.json
meltano | DEBUG Deleted configuration at /meltano-project/.meltano/run/elt/2021-10-06T144328--tap-s3-csv--target-redshift-raw/22a658d1-1178-437d-a168-896bd0d6811f/tap.c4dc297a-4f0a-4b73-a28f-1e24f6ae5cf0.config.json
meltano | INFO Extract & load complete!
meltano | INFO Transformation skipped.
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Attempting to create AWS session
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Starting discover
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Sampling records to determine table schema.
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Sampling files (max files: 5)
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Checking bucket "appunisuper" for keys matching "correos/*.csv"
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Skipping files which have a LastModified value older than 2021-09-01 00:00:00+00:00
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Found 1 files.
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Will download key "correos/correos.csv" as it was last modified 2021-10-06 07:56:06+00:00
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Sampling correos/correos.csv (max records: 1000, sample rate: 5)
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Sampled 200 rows from correos/correos.csv
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Sampled 400 rows from correos/correos.csv
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Sampled 600 rows from correos/correos.csv
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Sampled 800 rows from correos/correos.csv
meltano | time=2021-10-06 14:43:37 name=tap_s3_csv level=INFO message=Sampled 1000 rows from correos/correos.csv
meltano | time=2021-10-06 14:43:38 name=tap_s3_csv level=INFO message=Finished discover
[2021-10-06 14:43:40,191] [58|MainThread|urllib3.connectionpool] [DEBUG] Starting new HTTPS connection (1): <http://www.google-analytics.com:443|www.google-analytics.com:443>
[2021-10-06 14:43:40,217] [58|MainThread|urllib3.connectionpool] [DEBUG] <https://www.google-analytics.com:443> "POST /collect HTTP/1.1" 200 35e
edgar_ramirez_mondragon
10/06/2021, 5:20 PMhmm seems like it's connecting to S3 after the elt has finished 🤔. Does
meltano invoke tap-s3-csvb
boggdan_barrientos
10/06/2021, 5:23 PMThis displays when I run
meltano invoke tap-s3-csv Copy code
time=2021-10-06 17:22:17 name=tap_s3_csv level=INFO message=Attempting to create AWS session