How can i configure flattening using

tap-rest-api-msdk

. My API response is an array of object...

{

"id": "1",

"a": 0,

"b": "0",

"c": {

"d": *true*

}

}

After loading data using

target-jsonl

,

d

is not saved and

c

is null.

{"id": "1", "a": 0, "b": "0", "c": null}

Inferred Schema

"schema": {

"properties": {

"id": {

"type": "string"

},

"a": {

"type": "integer"

},

"b": {

"type": "string"

},

"c": {

"type": "null"

}

},

"type": "object",

"required": [

"a",

"c",

"b",

"id"

]

},

You could try increasing

num_inference_records

or passing a custom

schema

to make it so

"c": {
  "type": "object",
  "properties": {...}
}

I am using default ``num_inference_records = 50`` . My test data has only

3

records.