AWS – Announcing AWS Glue Job Run Insights

AWS Glue now provides job run insights, a feature that reduces Apache Spark job development time by helping determine sources of errors and performance bottlenecks. AWS Glue is a data integration service that lets customers discover, prepare, and combine data for analytics using serverless Apache Spark and Python. Spark’s distributed processing and “lazy execution” model makes it hard and time-consuming for Data Engineers to diagnose errors and tune performance. With this launch, AWS Glue gives you automated analysis and interpretation of errors in your Spark jobs to make the process faster.

Read More for the details.