#aws-glue

[ follow ]
#s3-server-access-logs #parquet #log-compaction #cost-optimization #amazon-s3 #apache-iceberg #data-compaction
Software development
fromInfoQ
20 hours ago

Yelp Publishes Blueprint for Managing S3 Server-Access Logs at Massive Scale

Yelp transforms terabytes of S3 access logs into compact Parquet archives, reducing storage by ~85% and object count by >99.99% for efficient, low-cost querying.
E-Commerce
fromInfoQ
4 months ago

Amazon S3 Adds Sort and Z-Order Compaction to Improve Apache Iceberg Query Performance

Amazon S3 now supports sort and z-order compaction for Apache Iceberg tables to improve query performance and reduce costs.
[ Load more ]