info517
09/16/2023, 8:41 PMFailed validating 'type' in schema['properties']['amount']: {'type': ['string', 'null']} On instance['amount']:Decimal('500.0')
This is my config, I also tried to manually override the schema:
extractors:
- name: tap-google-sheets
variant: matatika
pip_url: git+<https://github.com/Matatika/tap-google-sheets.git>
config:
child_sheet_name: ''
flattening_enabled: false
flattening_max_depth: 5
stream_maps:
finance:
amount: float(record['amount'])
schema:
amount:
type: ["float","null"]
If i just call invoke on tap-google-sheets i get this in the logs:
2023-09-16 20:24:32,070 | INFO | tap-google-sheets | Tap has custom mapper. Using 1 provided map(s).
{"type": "SCHEMA", "stream": "finance", "schema": {"properties": {"date": {"type": ["string", "null"]}, "what": {"type": ["string", "null"]}, "amount": {"type": ["number", "null"]}, "account": {"type": ["string", "null"]}, "category": {"type": ["string", "null"]}, "one_time": {"type": ["string", "null"]}}, "type": "object"}, "key_properties": []}
which has the correct type on amount, but then a few lines below it seems to use the auto generated schema:
`{"type": "SCHEMA", "stream": "finance", "schema": {"type": "object", "properties": {"date": {"type": ["string", "null"]}, "what": {"type": ["string", "null"]}, "amount": {"type": ["string", "null"]}, "account": {"type": ["string", "null"]}, "category": {"type": ["string", "null"]}, "one_time": {"type": ["string", "null"]}}}, "key_properties": []}
Does anyone know what I'm doing wrong? Thanks in advanceaaron_phethean
09/21/2023, 1:09 PM