I made this free directory to find tools that supp...
# show-us-what-you-gotk
kevin_galang
08/09/2023, 7:03 PMI made this free directory to find tools that support the integrations that you need! Meltano definitely shines in its coverage đź’Ż
https://www.definite.app/connector-db
kevin_galang
08/09/2023, 7:05 PMcc: @douwe_maan this is what I was telling you and @taylor about last week!
v
visch
08/09/2023, 7:08 PMLooks like it's missing stuff like target-mssql and other things. Is this open source? A website like this that's open and allows everyone to add/remove stuff (even if it's via scrapers) seems much better than closed / proprietary stuff. You'd still host the site and be able to slap ads etc
visch
08/09/2023, 7:09 PMI like it don't get me wrong but I was just surprised to find missing things
k
kevin_galang
08/09/2023, 7:10 PMHey @visch! I think it should be in the mysql grouping of integrations. Let me know if that’s off!
Open sourcing is a good idea. Will consider more đź‘Ť
v
visch
08/09/2023, 7:10 PMno it's mssql not mysql
visch
08/09/2023, 7:10 PMhttps://www.definite.app/connector-db/mysql-source only lists airbyte's and mysql shouldn't be under this one
visch
08/09/2023, 7:11 PMcategorizing and ontology is a hard question with this stuff, dbt had a good thread a while back on this there's been some attempts most get to where you are and stop
k
kevin_galang
08/09/2023, 7:45 PMoof that’s my fault. I manually cleaned up the data during this first go to see if it’d be helpful.
Must’ve messed up the mssql integration
h
Henning Holgersen
08/10/2023, 10:17 AMNice, I like it! Two observations (that shows the general difficulty of creating something like this): tap-spreadsheets-anywhere handles excel-files, but is not listed. It is hard to scrape that fact from the hub or repo though.
A perhaps impossible edge-case, meltano has “tap-sharepointsites” that currently only supports sharepoint lists, while fivetran only supports sharepoint files (files are coming to tap-sharepointsites soon). It is really difficult to surface this, and we should perhaps accept that for complex connectors stuff like this can’t be surfaced.
v
visch
08/10/2023, 12:27 PMYeah the nuance there the practitioners understand and really understand why having open source taps allows you to actually use a platform to do this kind of work. Which is why meltano and Airbyte are superior on that list but it's hard to articulate if you don't do the work
My question for @kevin_galang is do you actually care about this nuance and will you open source it
k
kevin_galang
08/10/2023, 12:37 PMThese are gems!
Sounds like open sourcing is a good option for folks to share this kinda nuance. Crowdsourcing everyone’s insight is probably the way to go here.
Just need to think of a way to do this that is manageable.
I’m thinking maybe an OS set of yaml files would be the easiest way to do this 🤔
v
visch
08/10/2023, 12:39 PMIt'll get nutty as there's like lots of tools that will want to get their own stuff added. Someone has the be the dictator and invest the time to get it right!
k
kevin_galang
08/10/2023, 12:39 PM@visch I just want to make something useful lol
v
visch
08/10/2023, 12:40 PMId be happy if it was you lol
visch
08/10/2023, 12:40 PM:) I just don't know if you want to!
k
kevin_galang
08/10/2023, 12:40 PMHappy to do my best to invest some time into it 🙂
kevin_galang
08/10/2023, 12:41 PMHaha yea didn’t expect this to be a one shot release. Definitely expecting to iterate!
v
visch
08/10/2023, 12:41 PMvisch
08/10/2023, 12:41 PMHere's the thread
2 Views