Is it possible to use stream maps to rename a field in a stream? For example I would like to rename a field called

type

to

entity_type

. Motivation for this is it seems like when running discovery of the schema the field called

type

throws an error perhaps because type is already a reserved word in the schema spec. Did some testing and found that if I manually change the field name in the source (s3 jsonl) the tap runs as expected.

Yeah, should be possible - something like:

stream_maps:
  entity_type:
    __source__: type
  type: null

Unsure if defined order is important here.

hmm that seems to rename the entire stream? What if I wanted to rename a column/field within a stream? I tried something like this:

stream_maps:
  my_stream:
    type:
      __alias__: entity_type

But didn't seem to rename that column

Oh my bad, I didn't read your post very well. 😅 Try this:

stream_maps:
  my_stream:
    entity_type: type
    type: null