I'm trying to create a dag to trigger dbt jobs, bu...
# troubleshooting
s
I'm trying to create a dag to trigger dbt jobs, but I'm getting this info message:
Copy code
No DAG created for schedule 'dbt-job' because its interval is set to `@once`.
Is this a normal interaction?
a
Hi, @Stéphane Burwash. Do you actually have the schedule set to
@once
in your yaml file? If not, if you don't see something like
interval: @once
in yaml, that would appear to be a bug on the Meltano side.
Do you mind sharing the yaml snippet from
schedules:
for reference?
s
I do have it set in my schedule:
Copy code
- name: dbt-job
  extractor: tap-dummy
  loader: target-stitch
  transform: run
  interval: '@once'
  start_date: 2015-12-01 00:00:00
But that's because if I remove it, my IDE hates me: My goal is to have a dag that is ONLY meant to be manually triggered
a
Do you mind opening an issue for us in the
files-airflow
repo? In the meanwhile, if you are comfortable with Python and airflow, I think you can modify your own project's
meltano.py
file here: https://github.com/meltano/files-airflow/blob/main/bundle/orchestrate/dags/meltano.py#L54-L58
If you make a fix and want to contribute back, we'd also welcome that.
I think our original intent was to not schedule them if there was no interval defined. But I definitely can also see value of having dags defined anyway, for use cases where you might want to launch via airflow manually - which sounds like is also your goal.
s
Yeah my use case was to create dags for dbt (we're in a trial phase) and for running full-refresh directly in the airflow webserver