dylan_just
09/27/2024, 4:41 AMEdgar RamĂrez (Arch.dev)
09/27/2024, 2:46 PMdylan_just
09/29/2024, 10:17 PM2024-09-27T04:52:57.806328Z [info ] 2024-09-27 14:52:57,805 | INFO | singer_sdk.metrics | METRIC: {"type": "counter", "metric": "record_count", "value": 1, "tags": {"stream": "public-usage_events", "pid": 38540, "context": {}}} cmd_type=elb consumer=False job_name=experimental:tap-rockefeller-v3-to-target-warehouse-postgres name=tap-rockefeller-v3 producer=True run_id=2faf1b21-c9b0-4e25-98d3-5bf802bcd646 stdio=stderr string_id=tap-rockefeller-v3
2024-09-27T04:52:57.918855Z [info ] 2024-09-27 14:52:57,918 | INFO | target-postgres | Target 'target-postgres' completed reading 2841 lines of input (5 schemas, 2830 records, 0 batch manifests, 6 state messages). cmd_type=elb consumer=True job_name=experimental:tap-rockefeller-v3-to-target-warehouse-postgres name=target-warehouse-postgres producer=False run_id=2faf1b21-c9b0-4e25-98d3-5bf802bcd646 stdio=stderr string_id=target-warehouse-postgres
2024-09-27T04:52:58.021565Z [info ] 2024-09-27 14:52:58,020 | INFO | target-postgres.public-customers | Inserting with SQL: INSERT INTO "32ac6651_f5e3_4506_a41e_584c144613e2" (customer_id, chargify_id, customer_type, email_domain, _sdc_extracted_at, _sdc_received_at, _sdc_batched_at, _sdc_deleted_at, _sdc_sequence, _sdc_table_version, _sdc_sync_started_at) VALUES (:customer_id, :chargify_id, :customer_type, :email_domain, :_sdc_extracted_at, :_sdc_received_at, :_sdc_batched_at, :_sdc_deleted_at, :_sdc_sequence, :_sdc_table_version, :_sdc_sync_started_at) cmd_type=elb consumer=True job_name=experimental:tap-rockefeller-v3-to-target-warehouse-postgres name=target-warehouse-postgres producer=False run_id=2faf1b21-c9b0-4e25-98d3-5bf802bcd646 stdio=stderr string_id=target-warehouse-postgres
dylan_just
09/29/2024, 10:21 PMversion: 1
disable_existing_loggers: false
formatters:
structured_plain_no_locals:
(): meltano.core.logging.console_log_formatter
colors: False
show_locals: False
handlers:
console:
class: logging.StreamHandler
level: INFO
formatter: structured_plain_no_locals
stream: "<ext://sys.stderr>"
root:
level: INFO
propagate: yes
handlers: [console]
Edgar RamĂrez (Arch.dev)
09/30/2024, 3:52 PMdylan_just
09/30/2024, 10:50 PMUnable to configure handler 'file'
I think the main thing I'm after is the ability to suppress some of the key/value pairs.dylan_just
09/30/2024, 10:50 PMcmd_type=elb consumer=True job_name=experimental:tap-rockefeller-v3-to-target-warehouse-postgres name=target-warehouse-postgres producer=False run_id=2faf1b21-c9b0-4e25-98d3-5bf802bcd646 stdio=stderr string_id=target-warehouse-postgres
In a json logger in production they're useful, but in a console logger for local they're noisy.Edgar RamĂrez (Arch.dev)
10/01/2024, 12:58 AM