Menu

#9 Is Avro Efficient for deepCopy

open
nobody
None
5
2012-04-17
2012-04-17
Jeremy Lewi
No

In the reducer, we often need to make copies of objects since the iterator over values reuses the same instances.

The Builder API in avro has some inefficiencies see:
https://issues.apache.org/jira/browse/AVRO-985
https://issues.apache.org/jira/browse/AVRO-989

we should check whether this affects us and whether we can do anything to improve performance.

Discussion

MongoDB Logo MongoDB