Based on this SO question: <https://stackoverflow....
# show-us-what-you-got
m
Based on this SO question: https://stackoverflow.com/questions/28798014/is-there-a-way-to-automatically-and-programmatically-download-the-latest-ip-rang I've built a very simple Meltano SDK tap that goes to the Microsoft Download page "Azure IP Ranges and Service Tags – Public Cloud", finds the download url for a JSON file (which changes weekly) and extracts the IP Address ranges used by Microsoft Azure. tap: tap-msipranges (open to suggestions on a better name!) https://github.com/mjsqu/tap-msipranges Inspiration - Microsoft's own scripts: https://github.com/microsoft/mstic/blob/master/.script/get-msftpubliip-servicetags.py If nothing else, it's an example of dynamically obtaining the base_url for a json-based tap, if you need to get that url from another statically named page. Paired up with target-snowflake, our Snowflake engineers are going to use this data to set security rules:
🔥 3
p
This is awesome! I was doing something similar manually with spread sheets anywhere but was never able to find a way to get the URL dynamically so I had to bump the file date when it changed, this is great! I also found this along the way https://github.com/femueller/cloud-ip-ranges. Would you ever consider evolving this tap to something generic like tap-cloud-ip-ranges so we can add streams for other IP range sources?
m
Sorry for the slow reply @Pat Nadolny (Arch) I'm just taking a colleague along on the Meltano journey getting this tap implemented into our environment. We use AWS too so something like a generic tap for cloud IP ranges could be very useful.