Hi everyone, sorry if this has already been answered but I wasn't able to find it anywhere. I'm trying to run an extraction using tap-facebook as my extractor and target-bigquery as the loader, and I wanted to be able to extract only the selected fields, but whether I use a catalog file or just the select property on meltano.yml, the extraction always includes all the other fields as nulls. Is there a solution for this that allows my extraction to just extract the columns that I define under my select?

You can try using select: https://docs.meltano.com/reference/command-line-interface/#select

The issue I'm having is that when I use the select: the extraction includes all the fields I did not included under that select: but with null as the value. I was trying to understand if there is a workaround for that issue so that the extraction won't include all the columns.

Hi David! Which variant of tap-facebook are you using?

For tap-facebook I'm using singer-io, and in case it's relevant I'm using adswerve on target-bigquery

Hmm, so the tap does seem capable of using the catalog to query the api with a subset of the fields: https://github.com/singer-io/tap-facebook/blob/add18f14e7cc18e402aa1108e86dc934300256f7/tap_facebook/__init__.py#L198-L208 But I'm not sure if all the stream can use that.