You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The problem is that when I try the export of a Bigquery table with that schema, even if the record is null it works fine and gives me empty array, when I try this in a dataflow, writing the TableRow object in a GenericRecord using this great utility, then it fails.
I think Google internally does the transformation in Proto (as documented here) first and then in Avro so in these steps it probably checks if the value List is null then serialize empty array. I personally applied this check in: Object read(Schema.Field field, Schema schema, Object value, Deque<String> path, boolean silently)
when case: ARRAY.
Thanks for help anyway.
The text was updated successfully, but these errors were encountered:
I got this exception message when running it on my json string from a TableRow object.
the record is null and the schema type is:
The problem is that when I try the export of a Bigquery table with that schema, even if the record is null it works fine and gives me empty array, when I try this in a dataflow, writing the TableRow object in a GenericRecord using this great utility, then it fails.
I think Google internally does the transformation in Proto (as documented here) first and then in Avro so in these steps it probably checks if the value List is null then serialize empty array. I personally applied this check in:
Object read(Schema.Field field, Schema schema, Object value, Deque<String> path, boolean silently)
when case: ARRAY.
Thanks for help anyway.
The text was updated successfully, but these errors were encountered: