Am I able to log out the URL and headers that the ...
# troubleshootingt
Tanner Wilcox
02/28/2025, 9:45 PMAm I able to log out the URL and headers that the rest tap is about to use before it sends out the request?
v
visch
02/28/2025, 9:48 PMCould you give some more context?
t
Tanner Wilcox
02/28/2025, 9:49 PMI'm using the tap-rest-api-msdk and I would like to see the URL it's calling and the headers it's passing
Tanner Wilcox
02/28/2025, 9:50 PMSetting the log level to debug doesn't show it. I think at this point I need to clone the repo, add some logging, then load it into my meltano project manually
Tanner Wilcox
02/28/2025, 9:55 PMWith my current yaml I'm getting a 400 back from the api. That's hard to troubleshoot without knowing what request I'm sending
c
Chad
03/03/2025, 12:00 AMThere is some commented out code in the tap_rest_api-msdk/streams.py files that can be uncommented to print debug messages. Do note that though by default it logs to std out so will break the stream. I often replace it with the following to avoid that. It will print sensitive headers etc so beware how/where you use it
Copy code
# Remove commented section to show http_request for debugging
import logging
import http.client
http.client.HTTPConnection.debuglevel = 1
logging.basicConfig()
logging.getLogger().setLevel(logging.DEBUG)
requests_log = logging.getLogger("requests.packages.urllib3")
requests_log.setLevel(logging.DEBUG)
requests_log.propagate = True
def print_to_log(*args):
requests_log.debug(" ".join(args))
http.client.print = print_to_log6 Views