AWS – Announcing general availability of auto-copy for Amazon Redshift
Amazon Redshift announces the general availability of auto-copy, which simplifies data ingestion from Amazon S3 into Amazon Redshift. This new feature enables you to set up continuous file ingestion from your Amazon S3 prefix and automatically load new files to tables in your Amazon Redshift data warehouse without the need for additional tools or custom solutions.
Previously, Amazon Redshift customers had to build their data pipelines using COPY commands to automate continuous loading of data from S3 to Amazon Redshift tables. With auto-copy, you can now setup an integration which will automatically detect and load new files in a specified S3 prefix to Redshift tables. The auto-copy jobs keep track of previously loaded files and exclude them from the ingestion process. You can monitor auto-copy jobs using system tables.
Amazon Redshift auto-copy from Amazon S3 is now generally available for both Amazon Redshift Serverless and Amazon Redshift RA3 Provisioned data warehouses in all AWS commercial. To learn more, see the documentation or check out the AWS Blog.
Read More for the details.