Welcome to above the clouds
GCP – Productionizing SQL-based workflows in Google Cloud
Despite its use and relevance in the Big Data realm, SQL can be cumbersome to manage from a DevOps perspective, as there are no standardized processes for managing, deploying, or orchestrating a repository of SQL scripts. Dataform is a tool that enables cross-team collaboration on SQL-based pipelines. By pairing SQL data transformations with configuration-as-code, data […]
GCP – New Cryptomining Protection Program offers $1 million for costly cryptomining attacks
Cryptomining is a pervasive and costly threat to cloud environments. A single attack can result in unauthorized compute costs of hundreds of thousands of dollars in just days. Further, the Google Cybersecurity Action Team (GCAT) September 2022 Threat Horizons Report revealed that 65% of compromised cloud accounts experienced cryptocurrency mining. Stopping a cryptomining attack requires […]
AWS – Amazon SageMaker Pipelines now supports Selective Executions
Today, AWS announced a new feature in SageMaker Pipelines, the ML workflow management service, to enable users run their desired steps in a pipeline as a sub-workflow. The new feature, called Selective Execution, allows you to run your selected steps in a pipeline while avoiding to rerun the entire pipeline. As a Data Scientist, Applied […]
AWS – Amazon QuickSight now supports APIs to automate and accelerate assets deployment
Amazon QuickSight launches new API capabilities that allow you to automate and accelerate your BI asset deployment and management. With these new APIs, you can get programmatic access to export and import QuickSight assets such as dashboards, analysis, datasets including ingestion schedules, datasources, themes, and VPC configurations across accounts and environments. You can interact with a […]
AWS – AWS Application Migration Service is now available in additional regions
AWS Application Migration Service (AWS MGN) is now available in the Europe (Zurich), Europe (Spain), Asia Pacific (Hyderabad), and Australia (Melbourne) regions. Starting today, you can use AWS Application Migration Service (AWS MGN) to migrate and modernize your applications in these regions. Read More for the details.
AWS – Amazon SageMaker Canvas supports retraining ML models, automating prediction workflows on updated datasets
Amazon SageMaker Canvas now provides the ability to retrain machine learning (ML) models and automate batch prediction workflows with updated datasets thereby making it easier to constantly learn and improve the model performance and drive efficiency. SageMaker Canvas is a visual interface that enables business analysts to generate accurate ML predictions on their own — […]
AWS – AWS CloudFormation StackSets skips suspended accounts for faster deployments
AWS CloudFormation StackSets is updating the deployment experience for CREATE, UPDATE, DELETE, IMPORT TO STACKSET, and DRIFT stack set operations to skip suspended AWS accounts during deployments. With this launch, StackSets will skip target AWS accounts that are suspended and flag the corresponding stack instances as SKIPPED_SUSPENDED_ACCOUNT instead of FAILED. Customers suspend their AWS accounts […]
AWS – Announcing Test Workbench for Amazon Lex
Amazon Lex is a service for building conversational interfaces into any application using voice and text. With Amazon Lex, you can quickly and easily build conversational bots (“chatbots”), virtual agents, and interactive voice response (IVR) systems. Today, we are excited to introduce Test workbench on Amazon Lex that enables customers to author and execute test […]
AWS – AWS Lambda adds support for Ruby 3.2
AWS Lambda now supports Ruby 3.2 as both a managed runtime and a container base image. Developers creating serverless applications in Lambda with Ruby 3.2 can take advantage of new features such as endless methods, a new Data class, improved pattern matching, and performance improvements. For more information on Lambda’s support for Ruby 3.2, see […]
AWS – Amazon Redshift Serverless now supports query scheduling and Single sign-on support
Amazon Redshift Serverless now allows you to schedule your SQL queries for staging in recurring schedules. You can now automate time sensitive or long running queries, loading or unloading your data using Amazon Redshift Query Editor V2 or Amazon Redshift Data API with flexible scheduling expressions, including cron expressions, for optimal control over query execution […]