During my exploration of Meltano, I encountered an issue related to the configuration of CSV extractor. After configuring the extractor, I proceeded to test it, but unfortunately, Meltano displayed an error indicating that the extractor was not properly configured. In this discussion, I would like to share my experience and seek assistance from the community to resolve this problem.
Problem Description
Configuration Process: I followed the documentation and guidelines provided to configure the desired extractor within Meltano. This involved specifying the necessary parameters and credentials required for the extractor to connect to the data source.
Testing the Extractor: Once the extractor was configured, I attempted to test it using the provided testing functionality in Meltano. However, upon executing the test command, an error message was displayed stating that the extractor was not configured correctly.
System: MacBook Pro, running on macOS Ventura 13.2.1.
meltano.yml file:
version: 1
default_environment: dev
project_id: 0f3dfccb-fbc9-49f5-94c7-6ed7c63dda3d
environments:
• name: dev
• name: staging
• name: prod
• plugins:
• extractors:
• name: tap-csv
• variant: meltanolabs
• pip_url: git+
https://github.com/MeltanoLabs/tap-csv.git
• config:
• csv_files_definition: input/csv/config.json
◦ add_metadata_columns: true
config.json:
{
"csv_files_definition": "input/csv/files_def.json"
}
definition.json:
[
{
"entity": "customerData",
"path": "input/csv/customerData.csv",
"keys": ["Id"]
}
]
Commands used:
For configuration: meltano config tap-csv set --interactive
For testing: meltano config tap-csv test