Hello everyone, I am trying to add a new loader "p...
# announcements
z
Hello everyone, I am trying to add a new loader "pipelinewise-target-snowflake" to Meltano (this target is not known to Meltano). I installed pipelinewise-target-snowflake with the following command:
meltano add loader pipelinewise-target-snowflake
Meltano created virtual environment for target and I configured it as suggested. But when I run etl process like:
meltano elt mytap target-snowflake --job_id=mytap-to-snowflake
I am getting the following error from target: ModuleNotFoundError: No module named 'azure.storage.common' It doesn't see the module. I checked the virtual env directory of target
.meltano/loaders/target-snowflake/venv/lib/python3.6/site-packages/
that module exists. Before I used this target in standard singer commands and never had a problem. Is there problem between Meltano and Azure? Is it possible to create manually virtual env and install target, without using Meltano? If possible, does it communicate with Meltano?
d
Hmm, I'm seeing the same behavior. This looks like a bug. Let me see what's going on!
You can try it out by reinstalling Meltano from the Git repo using
pip3 install git+<https://gitlab.com/meltano/meltano.git>
, then running
meltano install
in your project, and then running your ELT pipeline again, or running
pipelinewise-target-postgres
by itself using
meltano invoke pipelinewise-target-postgres
.
I'll release a new version of Meltano with this fix tomorrow 🙂