Devops Engineer

Description:

As a DevOps Engineer you will join the Enterprise Technology Data & Analytics team who are responsible for managing Macquarie’s Corporate Data Platform. The businesses we support are highly reliant on the platform for a broad range of use cases including data science, self-service analytics, operational analytics and reporting.

We are looking for an experienced devops to help develop and support large scale data platform environments including development, performance tuning, monitoring, and alerting. This is an exciting time to join our team as several greenfield projects are about to start. These will transform the platform and the way the business uses it. In this role, you will combine problem solving skills with systems engineering in building out, automating, and supporting our critical systems on AWS infrastructure, Cloudera and / or Kubernetes. Key areas will include Big Data Platform maintenance working with applications operations support & management, in alignment with application and platform specific SLAs and you will be responsible for platform related Technical & Business Users support, query resolution you will need hands on experience in automations and scripting using any language (Python, Java etc)

You’ll bring a strong learning mindset, an in-depth knowledge of cloud infrastructure as well as a keen interest for big data technologies.

• working knowledge of big data storage, processing, and scheduling technologies
• good knowledge of AWS (including EC2, S3 and EBS)
• experience with Spark, Presto and/or Hive and Impala.
• knowledge of CICD processes, tools for iterative & Incremental builds
• knowledge of Spark on EKS, Docker, Containers
• experienced in Agile and scrum-based delivery model
• any certification in Cloudera Bigdata Administration / AWS / Presto / Spark on EKS.