I am concerned who’s the responsible to tell Melta...
# singer-tapsa
Alejandro A
06/16/2024, 10:54 AMI am concerned who’s the responsible to tell Meltano’s that a run has successfully completed or if Meltano could be potentially closing it too early(I don’t think so)
e
Edgar Ramírez (Arch.dev)
06/17/2024, 9:41 AMMeltano waits for the subprocess to terminate and uses the exit status to determine if it was successful. When you run in debug mode and are able to see the missing records, do you also happen to see a final
STATEa
Alejandro A
06/17/2024, 1:33 PMHey morning Edgar, let me take a look at the logs again real quick later today
👍 1
Alejandro A
06/17/2024, 10:57 PMHey @Edgar Ramírez (Arch.dev), that is all what I found regarding state, not sure if it helps or comes from the tap but the target is def updating the state:
Copy code
[2024-06-04T08:24:44.411+0000] INFO - [base] 2024-06-04T08:24:41.783388Z [info ] 2024-06-04 08:24:41,782 | INFO | target-bigquery | Emitting completed target state {"currently_syncing": null, "bookmarks": {**REDACTED**}
[2024-06-04T08:24:44.412+0000] INFO - [base] 2024-06-04T08:24:41.871687Z [debug ] Added to state **REDACTED** state payload {'singer_state': {'currently_syncing': None, 'bookmarks': {**REDACTED**}
[2024-06-04T08:24:44.412+0000] INFO - [base] 2024-06-04T08:24:41.886613Z [info ] Incremental state has been updated at 2024-06-04 08:24:41.886427.
[2024-06-04T08:24:44.412+0000] INFO - [base] 2024-06-04T08:24:41.887201Z [debug ] Incremental state: {'currently_syncing': None, 'bookmarks': {'**REDACTED**'}
[2024-06-04T08:24:44.413+0000] INFO - [base] 2024-06-04T08:24:41.887456Z [info ] {"currently_syncing": null, "bookmarks": {"**REDACTED**"}
[2024-06-04T08:24:44.413+0000] INFO - [base] 2024-06-04T08:24:42.275396Z [debug ] Deleted configuration at /code/**REDACTED**/.meltano/run/**REDACTED**/tap.8c17fda8-442c-4540-8a3a-de07114d41be.config.json
[2024-06-04T08:24:44.413+0000] INFO - [base] 2024-06-04T08:24:42.275903Z [debug ] Deleted configuration at /code/**REDACTED**/.meltano/run/**REDACTED**/target.ed5e90a5-24e5-4bd0-b177-d56f7c90210d.config.json
[2024-06-04T08:24:44.414+0000] INFO - [base] 2024-06-04T08:24:42.314062Z [info ] Block run completed. block_type=ExtractLoadBlocks err=None set_number=0 success=True2 Views