martin_morset
07/29/2022, 1:03 PMEnvironment 'dev' is active (see screenshot). After about 15 minutes or so, the actual task completes, but the container keeps hanging telling me that the meltano run process has not yet exited and is blocked somehow. To me it seems like it is either stuck in an infinite loop, or trying to call something over the network with (seemingly) infinite retries/timeout.
We have a strict firewall policy where we explicitly name the domains to be whitelisted for egress out from our environment (required as we are in the telco business with very strict data protection requirements). My theory is that meltano is trying to call out to some external site. I have disabled telemetry in meltano in general (MELTANO_SEND_ANONYMOUS_USAGE_STATS="False" as stated in the docs).
Any ideas?martin_morset
07/29/2022, 1:13 PMmartin_morset
07/29/2022, 1:17 PMWill Da Silva (Arch)
07/29/2022, 1:20 PM.meltano/analytics.json. It contains a dictionary. Set the value of the key send_anonymous_usage_stats to false.visch
07/29/2022, 1:21 PMMELTANO_SEND_ANONYMOUS_USAGE_STATS is set
run meltano config meltano --list it'll give you all the meltano settings that should be one. Then you can set ``MELTANO_SEND_ANONYMOUS_USAGE_STATS` either by a bunch of ways a few of which are by env variable or in your meltano.ymlvisch
07/29/2022, 1:22 PM<http://sp.meltano.com|sp.meltano.com> though?Will Da Silva (Arch)
07/29/2022, 1:22 PMvisch
07/29/2022, 1:24 PM.meltano being ephemeral, but for a test that's a good idea!Will Da Silva (Arch)
07/29/2022, 1:29 PM.meltano/analytics.json does not exist (e.g. because it's your first run, or you're re-creating the environment each time) then you can build it manually like so (Python code):
import hashlib
import json
import uuid
with open(".meltano/analytics.json", "w") as analytics_json_file:
json.dump(
{
"send_anonymous_usage_stats": False,
"project_id": str(
uuid.UUID(hashlib.sha256(b"<your project ID>").hexdigest()[::2])
),
"client_id": str(uuid.uuid4()), # Any UUID will work for the client ID
},
analytics_json_file,
)Will Da Silva (Arch)
07/29/2022, 1:31 PMmartin_morset
07/29/2022, 1:33 PMmartin_morset
07/29/2022, 1:33 PMmartin_morset
07/29/2022, 1:38 PMWill Da Silva (Arch)
07/29/2022, 1:39 PMmeltano to fully prevent any requests from being sent.martin_morset
07/29/2022, 1:39 PMWill Da Silva (Arch)
07/29/2022, 1:44 PManalytics.json as shown above yourself might be to just run some other command before meltano runWill Da Silva (Arch)
07/29/2022, 1:44 PMmeltano config --help > /dev/null 2>&1Will Da Silva (Arch)
07/29/2022, 1:44 PM.meltano/analytics.json to what we want it to be.Will Da Silva (Arch)
07/29/2022, 1:48 PMtimeout --kill-after=3.0 2.0 meltano config --help > /dev/null 2>&1Will Da Silva (Arch)
07/29/2022, 5:47 PMWill Da Silva (Arch)
07/29/2022, 8:51 PMWill Da Silva (Arch)
07/29/2022, 8:51 PM