Since I upgraded meltano to 3.x I've been having a...
# troubleshooting
a
Since I upgraded meltano to 3.x I've been having an issue with
tap-instagram
. Not sure this is 3.x related though. I have a fork of the voxmedia variant so no code changes to the tap. One config input is the ig_users which is an array of ints. I used to be able to provide this in my .env as
TAP_INSTAGRAM_IG_USER_IDS='[12345]'
but now this doesn't seem to work, I get this error from meltano.
Copy code
Config validation error: '[12345]' is not of type 'array'
If I hard-code the user ids into
meltano.yml
as a list of ints it works fine. Any suggestions how to solve? I only really need a single user id, so I could alter my tap to work off an int rather than array of ints as well. But if there's a simple change here that would be great
👀 1
Copy code
Could not append type because the JSON schema for the dictionary `{'oneOf': [{'type': ['number']}, {'type': ['string']}, {'type': ['boolean']}]}` appears to be invalid.
Could not append type because the JSON schema for the dictionary `{'oneOf': [{'type': ['string']}, {'type': 'array', 'items': {'type': ['string']}}]}` appears to be invalid.
2024-08-01 08:53:15,366 | ERROR    | tap-instagram        | Config validation error: '12345' is not of type 'array'
v
in your
meltano.yml
for settings do you have user_id's defined as an array?
a
Copy code
config:
      ig_user_ids: ${TAP_INSTAGRAM_IG_USER_IDS}
That's how it's been setup for the longest time with meltano 2.x
v
Settings is what I'm asking about, not config. Is the setting for ig_user_id's set to a type of array?
Probably not on a lock file so the setting changed on you? Just a guess
a
I see now, yes that could be it. I had to generate the .lock files when migrating to 3.x
âž• 1
v
Whereever those settings were coming from I bet you had a setting type of an array before, and for some reason it doesn't anymore
🙌 1
a
Gotcha, I'm happy to hardcode the value into yml for now as that's not particularly sensitive, just curious to know why. Cheers, hope you are staying cool.
e
also, this might be a bit redundant
Copy code
config:
  ig_user_ids: ${TAP_INSTAGRAM_IG_USER_IDS}
removing that and just putting
TAP_INSTAGRAM_IG_USER_IDS
in the
.env
should be enough.
🙌 2