Using Python to Stream Large Data Sets from Postgres to AWS S3
Streaming allows you to move and transform data without holding the data in memory, or in a intermediary file location. This allows you to work with very large data sets, without having to scale up your hardware.