Description:
As, we are seeking for an experienced AWS Principal Data Architect to lead the migration of Hadoop DWH workloads from on-premise to AWS EMR. As an AWS Data Architect, you will be a recognized expert in cloud data engineering, developing solutions designed for effective data processing and warehousing requirements of large enterprises. You will be responsible for designing, implementing, and optimizing the data architecture in AWS, ensuring highly scalable, flexible, secured and resilient cloud architectures solving business problems and helps accelerate the adoption of our client’s data initiatives on the cloud.
Key Responsibilities:
1. Lead the migration of Hadoop workloads from on-premise to AWS-EMR stack.
2. Design and implement data architectures on AWS, including data pipelines, storage, and security.
3. Collaborate with cross-functional teams to ensure seamless migration and integration.
4. Optimize data architectures for scalability, performance, and cost-effectiveness.
5. Develop and maintain technical documentation and standards.
6. Provide technical leadership and mentorship to junior team members.
7. Work closely with stakeholders to understand business requirements, and ensure data architectures meet business needs.
8. Work alongside customers to build enterprise data platforms using AWS data services like Elastic Map Reduce (EMR), Redshift, Kinesis, Data Exchange, Data Sync, RDS , Data Store, Amazon MSK, DMS, Glue, Appflow, AWA Zero-ETL, Glue Data Catalog, Athena, Lake Formation, S3, RMS, Data Zone, Amazon MWAA, APIs Kong
9. Deep understanding of Hadoop components, conceptual processes and system functioning and relative components in AWS EMR and other AWS services. Good experience on Spark-EMR
10. Experience in Snowflake/Redshift
11. Good idea of AWS system engineering aspects of setting up CI-CD pipelines on AWS using Cloudwatch, Cloudtrail, KMS, IAM IDC, Secret Manager, etc
12. Extract best-practice knowledge, reference architectures, and patterns from these engagements for sharing with the worldwide AWS solution architect community
Organization | iVEGA Consulting |
Industry | IT / Telecom / Software Jobs |
Occupational Category | AWS Data Architect |
Job Location | Sydney,Australia |
Shift Type | Morning |
Job Type | Full Time |
Gender | No Preference |
Career Level | Experienced Professional |
Experience | 10 Years |
Posted at | 2024-08-13 5:18 pm |
Expires on | 2024-12-23 |