I'm not sure if this is docker related or not (I'm doing this inside a container), but when I install a plugin it takes a lot longer than I would expect it to (~4m), mostly spent upgrading pip. Is this normal, or is there a way to improve the timing on this?

Installing extractor 'tap-mssql--client-eirb'...

2022-12-02T19:02:11.504916Z [debug    ] Packages for 'extractors/tap-mssql' have changed so performing a clean install.

2022-12-02T19:02:11.520064Z [debug    ] Removed old virtual environment for 'extractors/tap-mssql'

2022-12-02T19:02:11.520198Z [debug    ] Creating virtual environment for 'extractors/tap-mssql'

2022-12-02T19:03:12.401624Z [debug    ] Upgrading pip for 'extractors/tap-mssql'

2022-12-02T19:06:32.060084Z [debug    ] Installing 'tap-mssql' into virtual environment for 'extractors/tap-mssql'

Installed extractor 'tap-mssql--client-eirb'

Depending on the Python version and base docker image,

pip

may be building some of the dependencies under the hood. You can confirm by setting an

PIP_ONLY_BINARY=":all:"

env var in your container before running

meltano install

.

For now, I'm just building from meltano/meltano:latest which has python 3.9.15 by default

are you running this on an m1 mac? I had same issue with ARM (runs fine in AMD64 env)

Afraid not @jacob_matson, this is on an x64 (core i7 to be more detailed)

interesting. ok. I ended up splitting my meltano install into multiple steps to get build times down. Which is a work around. maybe we need to open an issue for this

That makes sense, will definitely do that to help with the build times. What does the PIP_ONLY_BINARY setting do? Google is failing me

It’s the same as the

--only-binary

flag: https://pip.pypa.io/en/stable/cli/pip_install/#cmdoption-only-binary I think the offending library is `ciso8601`:

$ export PIP_ONLY_BINARY="ciso8601"
$ meltano install extractor tap-mssql --clean
Installing 1 plugins...
Installing extractor 'tap-mssql'...
Extractor 'tap-mssql' could not be installed: failed to install plugin 'tap-mssql'.
ERROR: Could not find a version that satisfies the requirement ciso8601 (from singer-python) (from versions: none)
ERROR: No matching distribution found for ciso8601

Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.

Failed to install plugin(s)

It’s a known issue in both

singer-python

and `pipelinewise-singer-python`: https://github.com/transferwise/pipelinewise-singer-python/issues/67

The way I read the log, the time is actually spent on

tap-mssql