I found the following post/issue related to tap-pr...
# troubleshootingj
jan_soubusta
04/04/2023, 2:24 PMI found the following post/issue related to tap-prometheus:
https://meltano.slack.com/archives/C0344MRGK8E/p1666188024560259
This tap is the only one which wasn't fixed as a part of the activity led by@pat_nadolny , the issue is still opened:
https://github.com/meltano/hub/issues/941
Looks like the owner (only single owner) is no longer maintaining the tap, am I right?
We are going to include Prometheus data into our internal analytics.
What would you recommend?
Should I fork it, and fix it? Would you be so kind to take it over and officially support it?
p
pat_nadolny
04/04/2023, 2:32 PM@jan_soubusta I found a couple other variants that are worth exploring https://github.com/meshcloud/tap-prometheus is a fork of the variant listed on the hub that has commits in the last 2 weeks and https://github.com/signal-ai/tap-prometheus which is another implementation that looks decent from a quick skim.
pat_nadolny
04/04/2023, 2:33 PMI'm happy to assist with refreshing the hub to get one of those set to default if you find that they're in good shape
pat_nadolny
04/04/2023, 2:34 PMBut also an SDK re-write seems pretty straight forward seeing as those variants arent very much code. If you wanted to you could rewrite it in MeltanoLabs
j
jan_soubusta
04/04/2023, 2:34 PMDo I understand it well that the variant you mention is not documented here?
https://hub.meltano.com/extractors/tap-prometheus/
p
pat_nadolny
04/04/2023, 2:35 PMYes I just found those two. We definitely want to add them to the hub if theyre good though
j
jan_soubusta
04/04/2023, 2:37 PMInteresting is that neither from these alternatives can be found with Google (at least I did not succeed when searching for
tap-prometheustap-prometheus meltanojan_soubusta
04/04/2023, 2:37 PMThanks for pointing me out to these alternatives. I try them
jan_soubusta
04/06/2023, 6:37 AMmeshcloud/tap-prometheus works as expected except it does not provide an option to extract incrementally.
In this case, the source data are immutable by design and there can be a huge amount of data, so it seems to be a blocker.
The second variant you mentioned also does not seem to provide an incremental mode, it even does not provide the state at all.
I guess the only option how to overcome this limitation is to fork the tap and add an incremental mode there, right?