Data Engineer

Description:

Main Duties Duties may include, but not limited to, some or all of the following:

1. collaborate with stakeholders as part of a cross functional agile team to assemble large, complex data sets that meet current and potential requirements

2. implement data flows to connect operational systems, data for

3. analytics and business intelligence systems

4. manage the design, build, development, and maintenance of enterprise data warehouse/data lake, data engineering solutions and data streaming systems

5. manage the administration and operation of the database solution

6. perform root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement

7. manage the development of data engineering frameworks and best practices for processes aimed at enhancing the availability, security, and performance of data assets

8. promote the delivery of the strategic data vision and build networks to share insights

9. review and prepare corporate and technical documentation

Main skills/attributes

Ability to:

1. recognise and initiate opportunities to re-use and align data models

2. undertake data profiling and source system analysis and synthesis, and support the end use of data

3. think strategically and align operational activity according to design, build and test data products that are complex or large scale, including building teams to complete data integration services

4. select and implement technologies to deliver resilient, scalable, and future-proofed data solutions

5. identify emerging trends in data tools, analysis techniques and data usage, and application within the agency context

6. use agreed standards and tools to design, code, test, correct and document moderate to complex programs and scripts from agreed specifications and subsequent iterations

7. apply expert skills in data quality, cleansing and validation

8. communicate effectively, adapting style appropriate to the audience, and facilitating discussions within a multidisciplinary team with potentially difficult dynamics

9. make balanced decisions based on professional judgement, risk evaluation and in the context of the situation/environment