bassel
09/19/2023, 6:02 PMplugins:
extractors:
- name: tap-mysql
variant: transferwise
pip_url: git+<https://github.com/B2tGame/pipelinewise-tap-mysql-ONMO.git@master>
Today, I had this error when was building the docker image
[+] Building 2.5s (10/10) FINISHED docker:desktop-linux
=> [internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 534B 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 193B 0.0s
=> [internal] load metadata for <http://docker.io/meltano/meltano:latest|docker.io/meltano/meltano:latest> 0.0s
=> [1/6] FROM <http://docker.io/meltano/meltano:latest|docker.io/meltano/meltano:latest> 0.0s
=> [internal] load build context 0.0s
=> => transferring context: 672B 0.0s
=> CACHED [2/6] WORKDIR /project 0.0s
=> CACHED [3/6] COPY ./requirements.txt . 0.0s
=> CACHED [4/6] RUN pip install -r requirements.txt 0.0s
=> CACHED [5/6] COPY . . 0.0s
=> ERROR [6/6] RUN meltano install 2.5s
------
> [6/6] RUN meltano install:
1.066 Extractor 'tap-mysql' is not known to Meltano. Try running `meltano lock --update --all` to ensure your plugins are up to date.
------
Dockerfile:13
--------------------
11 | # Copy over Meltano project directory
12 | COPY . .
13 | >>> RUN meltano install
14 |
15 | # Don't allow changes to containerized project files
--------------------
ERROR: failed to solve: process "/bin/sh -c meltano install" did not complete successfully: exit code: 1
Not sure of the reason .. was there any recent changes on the meltano image referenced in the docker file?
# <http://registry.gitlab.com/meltano/meltano:latest|registry.gitlab.com/meltano/meltano:latest> is also available in GitLab Registry
ARG MELTANO_IMAGE=meltano/meltano:latest
FROM $MELTANO_IMAGE
WORKDIR /project
# Install any additional requirements
COPY ./requirements.txt .
RUN pip install -r requirements.txt
# Copy over Meltano project directory
COPY . .
RUN meltano install
# Don't allow changes to containerized project files
ENV MELTANO_PROJECT_READONLY 1
# Expose default port used by `meltano ui`
EXPOSE 5000
ENTRYPOINT ["meltano"]
visch
09/19/2023, 11:15 PMmeltano/meltano:latest
changes you can either point to a specefic version of the container image or make it work with the latest version of meltano.
Meltano v3 migration guide https://docs.meltano.com/guide/v3-migration/bassel
09/20/2023, 11:26 AMvisch
09/20/2023, 12:25 PM