Looking to modularize my Meltano project. Is using...
# best-practices
s
Looking to modularize my Meltano project. Is using
pkl
modules still considered a good practice here? I know there are some limitations to
include_paths
.
1
e
Hey @Steven Searcy 👋
pkl
would definitely do the job but it's not documented and there's no official module for it yet (feature requests issues in GitHub welcome!) What limitations have you run into with
include_paths
?
s
I haven't run into any personally, but was searching the Slack group and found that
select
wasn't supported, which led me to
pkl
. I will likely stick with
include_paths
for now as the plan is to retain ALL of my raw data and shouldn't really need to use
select
. Thanks Edgar!
👌 1