Hello there, I'm trying to connect to an sql database, and I'm running into a problem:

Plugin configuration is invalid
Exception: only INCREMENTAL, LOG_BASED and FULL TABLE replication methods are supported

This does seem to be an easy to solve issue, although I can't find this field in the properites.json Any idea how to configure this? Seems to be obvious, but it is still in the morning

with sql database you mean MSSQL? What tap (variant) do you use? How exactly your configuration looks like?

In the meantime I got it running, the issue was that I had to manually add the selected table and create the metadata for it with the correct replication method

Don't have experience yet, but generally IMO it could depend on the replication type. I mean, I expect that e.g. LOG_BASED replication can replicate only physical entities like tables or materialized views, but not views.

I have no idea, it is refusing to work and google was not a big help yet

Here my skills end, we need someone more experienced to help...

Can you share your meltano.yml @zoltan_gatmezei ? And the command you're running to run meltnao. There's a bunch of small questions I have to ask about which tap, and what this looks like. Someone is more likely to be able to help then

I have replicated views in FULL_TABLE mode, and I see no reason INCREMENTAL wouldn't work. But LOG_BASED can't - there are no loggable changes to a view.

Here is my meltano.yml, I'm trying to test it with

meltano config tap-mssql test

And I'm getting a no record recieved error

It looks pretty close so you're doing something right! 😄 Instead of running the

test

command could you try just running

meltano invoke tap-mssql

Since I have barely any idea of what I'm doing I just followed the instructions 😄

Well we are getting closer. I'm not super familiar with the internals of the config test command, I think it runs the tap and tries to make sure it pulls some data, then fails if it doesn't pull data. One thing to try is to switch from INCREMENTAL to FULL_TABLE just to make sure you can pull some data. What it looks like right now is the table you think you're selecting isn't quite right. I'd start my removing that select statement, swapping it to

*.*

and then running

meltano select --list

that should show you all of the tables including

JOBADS

, maybe it's a dash instead of a dot or something for the stream name

Yeah, the select rules need to be

schema-table.*

Thank you, I'll look into it, now it is time to get some data out with this (now it is working 😄) the plan is to get this one working and transition to the variant advised by you