Running Airflow + Meltano and running into a situa...
# troubleshootingp
philip_johnson
09/09/2022, 2:43 PMRunning Airflow + Meltano and running into a situation where for whatever reason a job that is happily running along gets marked as failed, then it retries (even though it shouldn't) and the retried task job out because the first task is actually still running. Anyone know what would cause that? At this point I'm willing to pay for some help to get this project wrapped up. Output of both runs in thread:
philip_johnson
09/09/2022, 3:27 PMJob 1:
```...
[2022-09-09, 132318 UTC] {subprocess.py:92} INFO - [2m2022-09-09T132318.940186Z[0m [[32m[1minfo [0m] [1m{"type": "RECORD", "stream": "line_items", "record": {"id": 11310102, "ordered_unit_price": {"amount": 235.0, "currency": "USD"}, "quantity": "10.0000", "order": "f5b23eb7-c418-4766-98bd-b5c027bda632", "product": 313684, "notes": "", "is_sample": false, "sale_price": {"amount": 0.0, "currency": "USD"}, "unit_multiplier": 10, "is_medical_line_item": false, "is_packed": false, "packed_at": null, "packed_by": null, "unit_of_measure": "Unit", "position": 3, "bulk_units": 1, "on_sale": false, "is_backorder": false, "order_id": 1858371, "batch": null, "package_tags": []}, "time_extracted": "2022-09-09T132318.879799Z"}[0m [36mcmd_type[0m=[35melb[0m [36mconsumer[0m=[35mFalse[0m [36mname[0m=[35mtap-leaflink[0m [36mproducer[0m=[35mTrue[0m [36mstdio[0m=[35mstdout[0m [36mstring_id[0m=[35mtap-leaflink[0m
[2022-09-09, 132318 UTC] {subprocess.py:92} INFO - [2m2022-09-09T132318.940904Z[0m [[32m[1minfo [0m] [1m{"type": "RECORD", "stream": "line_items", "record": {"id": 11310184, "ordered_unit_price": {"amount": 235.0, "currency": "USD"}, "quantity": "10.0000", "order": "b35c8951-7975-4415-af07-602a1d63c902", "product": 313685, "notes": "", "is_sample": false, "sale_price": {"amount": 0.0, "currency": "USD"}, "unit_multiplier": 10, "is_medical_line_item": false, "is_packed": false, "packed_at": null, "packed_by": null, "unit_of_measure": "Unit", "position": 3, "bulk_units": 1, "on_sale": false, "is_backorder": false, "order_id": 1858383, "batch": null, "package_tags": []}, "time_extracted": "2022-09-09T132318.880134Z"}[0m [36mcmd_type[0m=[35melb[0m [36mconsumer[0m=[35mFalse[0m [36mname[0m=[35mtap-leaflink[0m [36mproducer[0m=[35mTrue[0m [36mstdio[0m=[35mstdout[0m [36mstring_id[0m=[35mtap-leaflink[0m
[2022-09-09, 132318 UTC] {subprocess.py:92} INFO - [2m2022-09-09T132318.945221Z[0m [[32m[1minfo [0m] [1m{"type": "RECORD", "stream": "line_items", "record": {"id": 11311298, "ordered_unit_price": {"amount": 0.1, "currency": "USD"}, "quantity": "2.0000", "order": "53265c8e-9426-4e88-8066-904c7d53231b", "product": 240813, "notes": "", "is_sample": true, "sale_price": {"amount": 0.0, "currency": "USD"}, "unit_multiplier": 1, "is_medical_line_item": false, "is_packed": false, "packed_at": null, "packed_by": null, "unit_of_measure": "Unit", "position": 3, "bulk_units": 2, "on_sale": false, "is_backorder": false, "order_id": 1858332, "batch": null, "package_tags": []}, "time_extracted": "2022-09-09T132318.880452Z"}[0m [36mcmd_type[0m=[35melb[0m [36mconsumer[0m=[35mFalse[0m [36mname[0m=[35mtap-leaflink[0m [36mproducer[0m=[35mTrue[0m [36mstdio[0m=[35mstdout[0m [36mstring_id[0m=[35mtap-leaflink[0m
[2022-09-09, 132318 UTC] {subprocess.py:92} INFO - [2m2022-09-09T132318.946979Z[0m [[32m[1minfo [0m] [1m{"type": "RECORD", "stream": "line_items", "record": {"id": 11313205, "ordered_unit_price": {"amount": 225.0, "currency": "USD"}, "quantity": "10.0000", "order": "ee186ab6-342d-4751-88ad-a4c059413fdb", "product": 313687, "notes": "", "is_sample": false, "sale_price": {"amount": 0.0, "currency": "USD"}, "unit_multiplier": 10, "is_medical_line_item": false, "is_packed": false, "packed_at": null, "packed_by": null, "unit_of_measure": "Unit", "position": 3, "bulk_units": 1, "on_sale": false, "is_backorder": false, "order_id": 1858856, "batch": null, "package_tags": []}, "time_extracted": "2022-09-09T132318.880813Z"}[0m [36mcmd_type[0m=[35melb[0m [36mconsumer[0m=[35mFalse[0m [36mname[0m=[35mtap-leaflink[0m [36mproducer[0m=[35mTrue[0m [36mstdio[0m=[35mstdout[0m [36mstring_id[0m=[35mtap-leaflink[0m
[2022-09-09, 132318 UTC] {subprocess.py:92} INFO - [2m2022-09-09T132318.951323Z[0m [[32m[1minfo [0m] [1m{"type": "RECORD", "stream": "line_items", "record": {"id": 11321082, "ordered_unit_price": {"amount": 0.1, "currency": "USD"}, "quantity": "2.0000", "order": "e132378a-cbfb-441e-8b67-b15fe5342a33", "product": 4…
philip_johnson
09/09/2022, 7:52 PMAt this point, probably just going to try Airbyte ¯\_(ツ)_/¯
3 Views