Hi folks! I have a field from a mySql (5.7) table...
# troubleshooting
i
Hi folks! I have a field from a mySql (5.7) table which contains JSON data. This JSON blob contains (a lot of PII data 👀 ) When trying to hash specific fields, such as
email
the whole JSON data is hashed, not the chosen field.
Copy code
- name: transform-field
    variant: transferwise
    pip_url: pipelinewise-transform-field
    mappings:
      - name: hide-emails
        config:
          transformations:
            - field_id: "json_data"
              tap_stream_name: "sample-table"
              field_paths: [ "email" ]
              type: "HASH"
It looks very much as though the mapper is failing to convert the string of JSON data into a Dict. I'm using
tap-mysql
to extract the data.