Hii all I am using cloudwatch connector with Kafka-loader, basically there lots of data I passed through kafka-loader to Kafka but all data didn't pass Ex: if 100000 records are there only 70000 records were passed. Is there any change in configuration in meltano or Kafka? @here plz let me know!!

Can you share your

meltano.yml

with secrets removed? Are you using

start_date

to restrict the records synced? Can you check that your tap actually produces the right records using

target-jsonl

?

By using meltano invoke I got exact no. Of records

I'm not familiar with kafka target, can you share meltano.yml?

I'll second Andy's request to share your

meltano.yml

. Also, try running with

--full-refresh

.

meltano.yml

Where is the source for the kafka loader? Can you link to a github? Or is it a custom target you have built? I don't see a

target-kafka

on the hub.