I am using tap-s3-csv plugin to load the data. for...
# troubleshooting
s
I am using tap-s3-csv plugin to load the data. for some reason, I got the following error when I tried to load 1.5G of CSV file. it was working fine to load 2.7G of CSV file before. does anyone know how to fix this issue? ```2023-11-08T032248.638466Z [info ] time=2023-11-08 032248 name=tap_s3_csv level=CRITICAL message=("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.638900Z [info ] Traceback (most recent call last): cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.639177Z [info ] File "/opt/dagster/dagster_home/meltano/.meltano/extractors/tap-s3-csv/venv/lib/python3.9/site-packages/urllib3/response.py", line 444, in _error_catcher cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.639491Z [info ] yield cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.639744Z [info ] File "/opt/dagster/dagster_home/meltano/.meltano/extractors/tap-s3-csv/venv/lib/python3.9/site-packages/urllib3/response.py", line 567, in read cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.639976Z [info ] data = self._fp_read(amt) if not fp_closed else b"" cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.640201Z [info ] File "/opt/dagster/dagster_home/meltano/.meltano/extractors/tap-s3-csv/venv/lib/python3.9/site-packages/urllib3/response.py", line 533, in _fp_read cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.640433Z [info ] return self._fp.read(amt) if amt is not None else self._fp.read() cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.640650Z [info ] File "/usr/local/lib/python3.9/http/client.py", line 463, in read cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.640875Z [info ] n = self.readinto(b) cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.641086Z [info ] File "/usr/local/lib/python3.9/http/client.py", line 507, in readinto cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.641397Z [info ] n = self.fp.readinto(b) cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.641677Z [info ] File "/usr/local/lib/python3.9/socket.py", line 704, in readinto cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.641922Z [info ] return self._sock.recv_into(b) cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.642150Z [info ] File "/usr/local/lib/python3.9/ssl.py", line 1275, in recv_into cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.642369Z [info ] return self.read(nbytes, buffer) cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.642587Z [info ] File "/usr/local/lib/python3.9/ssl.py", line 1133, in read cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.642805Z [info ] return self._sslobj.read(len, buffer) cmd_type=elb consumer=False name=tap-s3-csv producer=True stdio=stderr string_id=tap-s3-csv 2023-11-08T032248.643025Z [info ] Connectio…
e
Connection reset by peer
usually means a transient server issue
s
got it, thanks. I just tried again, and it is working this time. I think there are some issues with S3.