As an update to the previous post, it turns out Avro can append to an HDFS file after all. The capability is so obscure that even the experts on the Apache Avro mailing list weren't sure of the succinct way of accomplishing it. Sample code from GitHub.
But the demand for this capability will only grow, now that Hive supports Avro directly as of the Hive 0.10 release in January.
No comments:
Post a Comment