Hi all. `Extraction failed code=1 mes...
# troubleshooting
t
Hi all.
Extraction failed              code=1 message=ValueError: Could not detect type from empty type_dict. Did you forget to define a property in the stream schema?
Does it mean that there is a stream returning 0 rows or what exactly? There is no significant infor in the log even with debug mode. To clarify, in general it works properly, so all properties are set in the schema, however when I introduce
replication_key
then it throws me this error
e
@tomk you may need to ensure whatever field youโ€™re setting as the
replication_key
is present in the stream schema (and yeah, the error message could be more informative)
t
@edgar_ramirez_mondragon, thanks. Just figured it out as well, however. by the chance someone did it, is there any way to select replication_key from inside of the nested structure? Let's say
replication_key = property
where
th.Property(
"monologue",
th.ObjectType(
th.Property("property", th.StringType),
th.Property("start_time", th.DateTimeType)
),
)
e
is there any way to select replication_key from inside of the nested structure?
Not at the moment, but there are workarounds. See https://github.com/meltano/sdk/issues/1198. Also, feel free to give issue a ๐Ÿ‘ and/or comment if the workaround is not useful for your use case.
t
I'll check that for sure and let you know, thanks! ๐Ÿ™‚
Hey @edgar_ramirez_mondragon, the workaround works like a charm (almost ๐Ÿ˜„ ) but I would make the example more clear by putting all the fields from PropertiesList in the workaround as well, not only
updated
field alone. In my case I have a list of dictionaries so had to do sth like this:
row["updated"] = max([s["updated"] for s in row["attributes"]])