Anyone tried to use email as a source for somethin...
# singer-taps
v
Anyone tried to use email as a source for something like spreadsheets anywhere (I know, run away now)
a
Do you mean receiving emails that have spreadsheet-type attachments, like a CSV attachment?
v
yes... 🤮
a
I once set up a data pipeline that needed to do something like this. What we did was this: 1. Setup a Team channel (yes, I was using Teams back then) with an email receipt address. 2. Upon receiving an email, the Teams channel would land in a Sharepoint-like document library. 3. From landing in the SharePoint library, we were able to detect new file entries and trigger a workflow. 4. The workflow used an open source library to open the
.msg
file find (in our case) any Zip file within the email, and move the (in our case) single Excel file into a processing folder. 5. Upon processing the Excel file, it would be moved to a "Completed" subdirectory. This wasn't using Meltano, but I can suggest a similar approach as a possible area to explore: 1. Create an email-based alias in Slack or similar that can receive the input. 2. Use something like tap-slack to process new incoming messages. 3. Somehow (?) pass the file contents into a location to be picked up by tap-spreadsheets-anywhere. The may also be a IFFT/Zapier based flow to handle the first steps. 🤷
Not pretty by any means, regardless of approach.
If this works, it would be much simpler: https://hub.meltano.com/extractors/tap-gmail-csv/
v
You're jogging my memory! Thank you! I did this with mailgun a while back as well, probably much easier fronting with an API I like that idea a lot
tap-gmail-csv might just do it as well
a
Yeah, I agree this is certainly a mess. Good luck!