tomk
01/18/2023, 1:06 PMExtraction failed code=1 message=ValueError: Could not detect type from empty type_dict. Did you forget to define a property in the stream schema?
Does it mean that there is a stream returning 0 rows or what exactly? There is no significant infor in the log even with debug mode. To clarify, in general it works properly, so all properties are set in the schema, however when I introduce replication_key
then it throws me this erroredgar_ramirez_mondragon
01/18/2023, 4:07 PMreplication_key
is present in the stream schema (and yeah, the error message could be more informative)tomk
01/18/2023, 4:59 PMreplication_key = property
where
th.Property(
"monologue",
th.ObjectType(
th.Property("property", th.StringType),
th.Property("start_time", th.DateTimeType)
),
)
edgar_ramirez_mondragon
01/18/2023, 5:08 PMis there any way to select replication_key from inside of the nested structure?Not at the moment, but there are workarounds. See https://github.com/meltano/sdk/issues/1198. Also, feel free to give issue a ๐ and/or comment if the workaround is not useful for your use case.
tomk
01/18/2023, 5:13 PMtomk
01/20/2023, 1:37 PMupdated
field alone. In my case I have a list of dictionaries so had to do sth like this:
row["updated"] = max([s["updated"] for s in row["attributes"]])