Hi all, I'm revisiting Meltano and I've just been reading up on the stream maps functionality (bit late to the party, I know!) I'm using

tap-rest-api-msdk

to get data out of a third-party system called aXcelerate. I can run the tap and see the output, but right now it's not in a particularly usable format - the API returns data in this format and Meltano gives me an error about the buffer size being exceeded when I try and load it into e.g. Snowflake. I can increase the buffer size but what I really want to do is process the data properly and split it into just the attributes/values I need

{"REPORTTYPE": "Unit of Competency Enrolments - Warehoused", "DATA": "[{\"FULLNAME\": \"Jacqueline Adams\", \"USI\": \"6WQS3DY2KC\", \"CONTACTID\": 10470062, \"VSN\": null, \"WAEDUCATIONID\": \"0\", \"SKILLSFORALLNUMBERSA\": null, \"SACESTUDENTID\": null, \"AGE\": 36, \"CHESSN\": null, \"AVETMISS7ADDRESS\": true, \"VETFEEHELPELIGIBLE\": true, \"DIPLOMACODE\": \"HLT54115\", \"DIPLOMA\": \"Diploma of Nursing\", \"CLASSDESCRIPTOR\": \"E1224B WA 20 10 05 MON/TUE\", \"DIPLOMAID\": 17987, \"CLASSID\": 988835, \"FULLQUALIFICATION\": true, \"STARTDATE\": \"2020-10-05\" [SNIP]