Hello, might be dumb and simple but I have been tr...
# getting-started
m
Hello, might be dumb and simple but I have been trying to use target-azureblobstorage and I need to supply it with a json config file and I just don't know where to put it within the project so the target will get the account_name/key and such. Has anyone used this loader before, or just know where to put a config file with this kind of information. I have tried putting it in .meltano/loaders/target-azureblobstorage as well as plugins/loaders both unsuccessful. I think this is a simple fix so any help would be appreciated. Thanks
v
Best way to ask this question is to include what you're trying and what the error is. What is your
meltano.yml
file, what command are you running, and what error are you getting back
m
Here is my meltano.yml and command/error along with where I ended up putting that config file.
e
Meltano manages the config file for you. See https://docs.meltano.com/guide/configuration/
Since this also goes for extractors and loaders, you do not need to manually craft the `config.json` files expected by Singer taps and targets, because Meltano will generate them on the fly whenever an extractor or loader is used through
meltano run
or
meltano invoke
.
You can try running
meltano config target-azureblobstorage list
to see the expected settings, or even better
meltano config target-azureblobstorage set --interactive
to set the config interactively.
m
Okay I did the interactive config and set everything. Now getting this error, looks like an issue with the target to me but I'm not really sure.
v
That looks like a target bug to me but I don't know the target. Seems like it's saying
state['currently_syncing']
should be set. Maybe there's some reason I don't know! We're at a different issue though! Just with the target now
e
Yeah, the target is trying to use the "currently_syncing" key as a signal that a a file is not being updated anymore and can be uploaded. There's no spec for STATE in Singer so it's wrong that a target expects anything from it...
m
I have switched my approach to adapting the target-jsonl and just adding a step that dumps the json file to the blob. I have got it working but need to get the account key out of the code. How can I change what config values the target is expecting and how can I get the account_key in from a .env file or something like that?