Hello :waves: is it possible to run an arbitrary ...
# getting-startedj
jacob_mulligan
08/16/2023, 2:11 PMHello waves is it possible to run an arbitrary Python script or Jupyter notebook in Meltano? I want to run a notebook after Meltano runs some dbt models. Right now our data stack is just Meltano running in a Github action, I'm wondering if I can also orchestrate a notebook/python script without also setting up dagster/airflow.
jacob_mulligan
08/16/2023, 2:13 PManother alternative i'm considering is running the notebook in a github action, but i think i'd be preferable to have it orchestrated in Meltano as well so that everything is together in the
meltano.ymlu
user
08/16/2023, 2:23 PM@jacob_mulligan check out https://docs.meltano.com/guide/advanced-topics/#running-custom-scripts which I've personally used before with success. Also https://docs.meltano.com/tutorials/jupyter/#4-execute-notebooks-via-nbconvert-or-papermill looks relevant but I havent work with jupyter notebooks personally
j
jacob_mulligan
08/16/2023, 2:27 PMamazing, thanks Pat!
r
Reuben (Matatika)
08/16/2023, 4:56 PMThere is a utility for running notebooks: https://hub.meltano.com/utilities/notebook/ 🙂
j
jacob_mulligan
08/18/2023, 7:48 AMoh, the first time i looked at that utility i somehow only noticed the part of the docs for converting notebooks, not running them.