Redefining Data Engineering with Go and Apache Arrow
Original URL: https://medium.com/@mcgeehan/redefining-data-engineering-with-go-and-apache-arrow-df9059ddf55c
Article Written: February 4, 2025
Added: February 27, 2025
Type: poc
Summary
Sounds very first, but if we work with big dataset, how to handle the data transformation in the memory? If we work with small data, we can rewrite into Parquet format and the performance is not an issue.