hi all, i'm a first time user, tried tap-mssql and...
# troubleshootingj
jochem_zwienenberg
06/07/2023, 11:05 AMhi all, i'm a first time user, tried tap-mssql and tap-snowflake, but because of my lack of knowledge on python etc. i cannot get this to work:
a
aaron_phethean
06/07/2023, 7:32 PMHi @jochem_zwienenberg your not alone. I find the python setup a pain from time to time, and then again the next time I have to do it! Windows with meltano might still have issues too I recall.
At the risk of sounding like a vendor (sorry), you could create your project with docker and our community edition, then take your meltano project wherever you like https://www.matatika.com/docs/getting-started/community-edition
Happy to experiment with this on a call if you wanted to take a further look. DM me.
aaron_phethean
06/07/2023, 7:41 PMYou might also have some joy running meltano docker container to pass all your meltano project commands to it - https://docs.meltano.com/guide/containerization
j
jochem_zwienenberg
06/09/2023, 6:58 AMthnx @aaron_phethean, i will try the Docker
a
aaron_phethean
06/09/2023, 7:30 AMTo give you some confidence we’ve used tap-mssql without issues. Not tap-snowflake (only the target).
j
jochem_zwienenberg
06/09/2023, 7:30 AMbut from within a docker?
jochem_zwienenberg
06/09/2023, 7:31 AMor linux, not Windows?
a
aaron_phethean
06/09/2023, 7:36 AMA docker container yes, not usually the meltano one. Should only take a few minutes to send you and example if that’s useful. Which target do you want?
aaron_phethean
06/09/2023, 7:36 AMLinux, yes.
j
jochem_zwienenberg
06/09/2023, 7:36 AMsnowflake would be nice, but just want to test, so csv is also ok
a
aaron_phethean
06/09/2023, 7:44 AM👍 I’ll send you an example when I get to the office
j
jochem_zwienenberg
06/09/2023, 7:45 AMno hurries! today i won't have time to test, so will be next week i think! But thnx very Much! and have a nice weekend 👍
a
aaron_phethean
06/09/2023, 8:40 AMHi @jochem_zwienenberg
Here are the commands to create your project with the meltano image https://hub.docker.com/r/meltano/meltano
Copy code
docker pull meltano/meltano
docker run --volume $(pwd):/project meltano/meltano init myproject
cd myproject
docker run --volume $(pwd):/project meltano/meltano add extractor tap-mssqlaaron_phethean
06/09/2023, 8:56 AMAlso, you have quite a few options for running the extract
e.g. create a .env or export the following
Copy code
TAP_MSSQL_USER=user
TAP_MSSQL_PASSWORD=password
TAP_MSSQL_HOST=host
TAP_MSSQL_DATABASE=database
TARGET_SNOWFLAKE_ACCOUNT=ACCOUNT
TARGET_SNOWFLAKE_USERNAME=USERNAME
TARGET_SNOWFLAKE_PASSWORD=PASSWORD
TARGET_SNOWFLAKE_ROLE=ROLE
TARGET_SNOWFLAKE_DATABASE=DATABASE
TARGET_SNOWFLAKE_WAREHOUSE=WAREHOUSE
LOADER=target-snowflake
EXTRACTOR=tap-mssql
DBT_TARGET=snowflake
DBT_SOURCE_SCHEMA=analytics
DBT_TARGET_SCHEMA=analytics
MELTANO_DATABASE_URI=<postgresql://dxyuwns:36WdJjNf_E6Lp42aR_02OsmqPv@db:5432/dxyuwns?options=-csearch_path%3Dpublic>
MELTANO_ENVIRONMENT=dev Copy code
docker run --volume $(pwd):/project meltano/meltano run tap-mssql target-snowflakej
jochem_zwienenberg
06/09/2023, 8:57 AMok think i got some work / learning to do
jochem_zwienenberg
06/09/2023, 8:58 AMwill try it ASAP! also will have a look at Matatika as a product
jochem_zwienenberg
06/09/2023, 8:58 AMthnx, for now have a nice weekend, like i said today i don't have time to test further!