Hi, I am running meltano from within Dagster ( Orchestration tool ). Dagster has an ability to generate data lineage and it can also render “data assets” on UI, with details of the assets ( count, last updated, freshness) etc. There is no official plugin either from Meltano.com or Dagster.io so I am working on building something that works for us. Our basic meltano flows are ready. I am looking for some meta information of the last EL run Get some metadata stats of the last run which includes: 1. Count of records that were sync’ed 2. Last Date range of Records transfered from source to target If the above can be extracted from somewhere, they can be attached to the “Dagster Data Asset” and displayed on the UI So if possible, where would I be able to find such information

Jules seems to be working on an updated integration. https://meltano.slack.com/archives/C013EKWA2Q1/p1661199643607629

@jules_huisman is it possible to get some view into your SDA based meltano-dagster codebase ?

Hi Binoy, yes of course. I will setup some code in the

dagster-meltano

repo. I will ping you when I have a first version.

Hi Jules, I am not able to resolve following

from meltano.cli.elt import _elt_context_builder, _run_extract_load
from meltano.core.job import Job
from meltano.core.logging import JobLoggingService, OutputLogger
from meltano.core.plugin import PluginDefinition
from meltano.core.plugin.singer.catalog import SelectionType
from meltano.core.select_service import SelectService

and the requirements.txt file appears to be empty

Yes of course!