Description:
Hudson is currently looking for a proficient Data Engineer to become a vital part of a large government organisation. In this role, you will play a pivotal function in crafting and deploying data solutions, empowering our business intelligence analysts, data scientists, and other users to derive valuable insights from our extensive enterprise-wide dataset.
Key Responsibilites
- Develop and implement data solutions in cloud-based technologies, adhering to existing branch standards.
- Design, build, and deliver data marts with strong quality and security controls for enterprise-wide use.
- Source data from various enterprise databases into AWS/Snowflake, establishing effective ingestion patterns and applying security controls.
- Build optimized data pipelines and automated data marts, ensuring scalability across the enterprise in Snowflake and Matillion.
- Develop and deliver test scripts and government data security controls to ensure data integrity and quality.
- Document delivered data solutions and assets in accordance with existing templates.
- Optimize business-critical requirements and curate data models to meet organizational needs.
- Extract and combine data from heterogeneous sources to establish enterprise-wide data consumption models.
- Collaborate with business architects to deliver information architecture documentation.
- Demonstrate current and varied experience across public and private sectors (highly desirable).
- Undertake other duties as required.
- May be assigned quarterly Key Performance Indicators to maintain.
Qualifications And Skills
- Significant experience in cloud-based technologies for designing, building, and delivering enterprise-wide data consumption models.
- Strong expertise in AWS/Snowflake and Matillion for data ingestion, integration, and pipeline development.
- Proven experience in developing and delivering test scripts and government data security controls.
- Familiarity with data warehousing and data mart build experience.
- Excellent documentation skills in accordance with industry standards.
- Ability to work with business architects to deliver information architecture documentation.
- Experience in extracting and combining data from various heterogeneous sources.
- Varied experience across public and private sectors is highly desirable.
- Immediate availability to start is appreciated.