Senior Data Engineer

One of our federal clients is seeking an experienced Senior Data Engineer to join the team.

About the role

Data Engineers prepare raw data for analytical or operational uses. They make data accessible so that it can be used for optimisation, delivery of services and enhanced analytics solutions. Data Engineers design, build and maintain data products, services and platforms that support the agency’s operational, analytical and business intelligence needs. They transform and manage data throughout the data lifecycle to ensure data assets are secure, reliable, accessible and fit for purpose. Data Engineers work collaboratively with business and technical stakeholders to deliver scalable data solutions, support evidence-based decision making, and contribute to the continuous improvement of the agency’s data ecosystem.

Senior Data Engineers apply technical expertise and judgement to design and develop integrated data solutions that address business and operational requirements. They translate requirements into practical outcomes, improve the effectiveness, reliability and maturity of data engineering practices, and resolve technical challenges. Senior Data Engineers contribute to the development of standards, innovative approaches and improved ways of working, while providing technical guidance and supporting knowledge sharing across teams.

Key duties and responsibilities

• Engage with stakeholders to define business requirements and shape data, analytics and software solutions that meet agency needs.
• Design, develop and maintain data engineering, enterprise data warehouse, data lake, streaming and software solutions.
• Build, maintain and support high-quality code, technical designs, prototypes and complex development solutions across the product lifecycle.
• Perform complex data extraction, manipulation, analysis, querying, programming, testing and troubleshooting to support effective business outcomes.
• Provide technical advice, documentation input, go-live support and ongoing maintenance for complex ICT and development activities.
• Apply endorsed methodologies, standards, security measures, risk controls and best practices to improve availability, performance, compliance and reliability of ICT solutions.

Essential criteria

• Demonstrated experience engaging stakeholders to define business requirements and design, develop, implement, maintain and support data engineering, enterprise data warehouse, data lake, streaming and software solutions that meet complex agency needs.
• Demonstrated ability to perform complex data extraction, manipulation, analysis, querying, programming, testing and troubleshooting, while applying data quality, integrity, security, risk controls and endorsed engineering standards to deliver reliable business outcomes.
• Demonstrated technical capability across data modelling, analysis, profiling, cleansing, validation, API integration, data replication, data acquisition, data reconciliation, ETL/ELT, batch and near real-time pipeline delivery.

Desirable criteria

• Experience with one or more of the following platforms: Teradata, Cloudera Data Platform, Red Hat OpenShift
• Experience in one or more of the following: Python, SQL, Apache Spark, Java, Apache NiFi, Hadoop
• Experience building and supporting data products using automated testing, secure coding practices, Git repositories, DevOps pipelines, code review processes and contemporary software engineering practices.
• Relevant qualification or equivalent practical experience in computer science, software engineering, data engineering, enterprise data warehousing or software development.

Technical skills, knowledge and qualifications

• Data modelling techniques (relational, dimensional, messaging and big data), data analysis and profiling using modern analytical tools and programming languages, and visualisation methods and tools.
• Experience with one or more of the following - Teradata, Cloudera Data Platform.
• Experience in implementing solutions on Red Hat Open shift platforms is highly desirable.
• Best-practice data cleansing, validation, quality assurance and feature preparation techniques for complex datasets.
• Programming & Software Engineering – one or more of following:
• Modern engineering practices supporting data products (API integration, Data Replication, Data Acquisition, Data Reconciliation, ETL/ELT using Batch and near Real Time)
• Programming in one or more of the following - Python, SQL, Apache Spark, Java, Apache NiFi.
• Experience in utilising Source control (Git) repositories, utilising and building CI/CD pipelines
• Automated testing, Secure coding practices, Code review processes
• Experience with tools and technologies: Teradata, Python, and Red Hat OpenShift platforms.
• Advanced degree in computer science, software engineering, or a related field, with a focus on data engineering, software design and development;
• Experience (typically 3-5+ years) in building data solutions, enterprise data warehousing, software programming/development.

Working arrangements

Hybrid

The Labour Hire Worker is expected to work onsite for the first 6 weeks before a hybrid flexible working arrangement can be considered, unless otherwise negotiated.

A hybrid flexible working arrangement may then be considered, ensuring the Labour Hire Worker’s residing address is within reasonable travel time and distance of the RFQ location to present onsite in cases of emergency or to meet business requirements. The location is the capital city of selected state/s.

Maximum hours: 80 hours per week

Estimated start date: 1 January 2027

Initial contract duration: Up to 12 months

About the organisation

Services Australia is at the frontline of government service delivery, supporting millions of Australians, and is front and centre of a vision to be a world leader in government service delivery. It’s using cutting-edge technology to build world class platforms and capabilities to help Australians get on with their lives.

Application requirements

• Latest copy of your CV
• A suitability statement addressing the skills/experiences.

If you believe you are the right fit, apply today.

If you know someone who can be a great fit, refer them via our referral page on the website.

New Vision Software acknowledges the Traditional Owners of the lands on which we live and work. We pay our respects to Aboriginal and Torres Strait Islander Peoples, and to Elders past and present.

We welcome people of all cultures, religions, backgrounds, beliefs, ages, abilities, genders, sexual orientations and identities.