Does anybody tried to integrate greatexpectation i...
# troubleshootingm
monika_rajput
06/10/2021, 6:01 PMDoes anybody tried to integrate greatexpectation in meltano project along with airflow?
a
aaronsteers
06/10/2021, 10:30 PMHi, @monika_rajput - I have not yet tried the great expectations integration, but we have others in the community who are interested in this as well. If you have any success in this area, or if you want to connect with others, I recommend adding your voice here in the related issue: Support for data validation with Great Expectations (#2454) · Issues · meltano / Meltano · GitLab
aaronsteers
06/10/2021, 10:30 PMIs this helpful at all?
aaronsteers
06/10/2021, 10:30 PMIn regards to Airflow, we do support Airflow out of box for elt operations. Do you mean Airflow for elt or Airflow for great expectations validation?
m
monika_rajput
06/25/2021, 7:51 AMAs we already implement airflow for elt pipeline in meltano and now we want to integrate great expectation validations on airflow meltano elt pipeline @aaronsteers
monika_rajput
06/25/2021, 7:52 AM@edward_ryan @kai_yokoyama @mohsin
a
aaronsteers
06/25/2021, 5:24 PMIn theory, can can customize airflow to run any steps you would like. This might (of might not) be helpful for general airflow config/orchestration. What you describe is certainly possible though. Orchestration | Meltano