Hi All, I created a custom tap following, <https:/...
# troubleshooting
p
Hi All, I created a custom tap following, https://meltano.com/blog/how-to-build-a-custom-extractor-with-meltano/ and added mongodb target. can see the run flow working but state isn't getting updated. I set the state backend to filesystem and saw that bookmarks is not getting filled.
Copy code
{
  "completed": {
    "singer_state": {
      "bookmarks": {
        "files": {}
      }
    }
  },
  "partial": {}
}
e
I think that blog post leaves a few things out for simplicity:
You can leave the capabilities and settings fields blank for now.
You might wanna enable the
state
capability on the tap: https://docs.meltano.com/reference/plugin-definition-syntax#capabilities
p
Thanks @Edgar Ramírez (Arch.dev) , added the capability but bookmarks seem to be not updating still.
```2024-05-16T191235.048413Z [info ] 2024-05-17 004235,048 | INFO | target-mongodb | Emitting completed target state {"bookmarks": {"files": {}}} cmd_type=elb consumer=True job_name=dev:tap-gdrive-to-target-mongodb name=target-mongodb producer=False run_id=93e28d5a-be8f-4988-9405-c0199992db80 stdio=stderr string_id=target-mongodb
2024-05-16T191235.055085Z [info ] Writing state to Local Filesystem
2024-05-16T191235.056060Z [info ] Incremental state has been updated at 2024-05-16 191235.056040.
2024-05-16T191235.598731Z [info ] Block run completed. block_type=ExtractLoadBlocks err=None set_number=0 success=True```
saw this documentation:
Declares that the plugin is able to perform incremental processing using the
--state
CLI option.
but running it with
meltano run
is giving
Error: No such option: --state Did you mean --merge-state?
where should this
--state
be added?
e
Does the
files
stream in your custom class declare a
replication_key
?
p
appreciate you for helping always, thank you so much!! @Edgar Ramírez (Arch.dev)
np 1