Heya! I'm new to Meltano and working with Singer (...
# troubleshooting
j
Heya! I'm new to Meltano and working with Singer (Previously happy customer of Stitch). I'm struggling with incremental table replication (key) mssql => Redshift 😞 The initial replication works without an issue, however the consequent ones all will fail with following message
Copy code
2023-01-19T15:45:55.793714Z [error    ] Extraction failed              code=1 message=TypeError: Boolean value of this clause is not defined name=meltano run_id=031441cf-c7bc-49eb-b82d-7394b4e9c251 state_id=mssql-to-redshift-test
(Full log in attachment) CLI
Copy code
❯ meltano elt tap-mssql target-redshift --transform=skip --select 'dbo-Subscription.*' --state-id=mssql-to-redshift-test
Plugins used: • tap-mssql (buzzcutnorman variant)target-redshift (transferwise variant)
Resetting the state for
mssql-to-redshift-test
will allow me to run the initial sync again without issues, however the same problem would return the next run
It seems something broken in tap-mssql (buzzcutnorman variant) Reinstalled the tap with the default variant and things are working perfectly fine. 🤷
If I have the time over weekend, will create a MRE and open issue on the buzzcutnorman's repo
t
just reading the symptom, and being no meltano-expert at all: My first look would be if the stored state makes sense. I’d also try to just run the
tap-mysql
via
invoke
to reduce the possible culprits
b
I am sorry that you ran into trouble right out of the gate with the buzzcutnorman variant. It is a work in progress and I wouldn't use it in production just yet. Glad to hear that you were able to get things working using the default variant.
j
I'll be damned.. I'm not able to reproduce the error in a fresh
meltano init
dir at all... unfortunately I did not save the exact config I used and very vaguely remember having custom pip_url that was pointing to one of the PRs https://github.com/BuzzCutNorman/tap-mssql. For the sake of me, I can not remember why I had this set it up like that. I strongly suspect my described issue had been coming from me experimenting and consequently breaking stuff 😞 If I manage to run into this same problem again, I will report back and open appropriate MRE. Sorry for the escalation, everyone!
b
@janis_puris No worries, Thank you for taking the time to attempt replicating the issue and your willingness to put in an Issue or PR. The installation instructions found at the GitHub repo of tap-mssql were updated last week so you might have started with one set of install instructions and followed the updated version this weekend. Yes, please report back if you run into the same problem again.