The solution

Relevant features of the deployment included:

Separate accounts for development and production, and separate Bastion access to every AWS account, including a separate private key to access Amazon EC2 nodes Additionally, Virtusa implemented
AWS Identify and Access Management role-based access to edge nodes, clusters, and Amazon S3 resources defined security groups based on the project requirements, Single Sign-On, and Multi-factor Authentication access to the AWS console
The Amazon EMR workflow included automatic cluster launch and termination through scripts in the batch processing workflow
Since some of the big data jobs used HDFS for intermediate data storage, we deployed Amazon Relational Database Service ( Amazon RDS) for Oracle for DB procedure. The final output data was put in Amazon S3 buckets, and application of Amazon S3 bucket life cycle rules were applied
Automated management and deployment of clusters for the customer were carried out through AWS CLI with shell scripting. Bootstrapping was used to copy certain application-specific files into all data nodes

AWS Services Used: