We are looking for a Data Engineer for the Sydney location for a large-scale project. This is a permanent role with a global IT service leader.
Key Responsibilities:
- Designing, building, and maintaining data architectures, including databases and processing systems.
- Acquiring and integrating new data sources.
- Optimising data pipelines, automating processes where possible, and planning for scalability.
- Developing methods for identifying issues in data quality, reliability, and efficiency.
- Applying appropriate security controls to all relevant collections, databases, and systems.
- Maintaining documentation relating to the design and maintenance of data systems.
- Creating and maintaining the infrastructure and analytic tools to allow for efficient data extraction and transformation.
Key Skills and Qualifications:
- Degree qualified in data science, computer science, statistics, information systems, or related disciplines.
- Extensive experience with SQL, Python, and R.
- Experience or familiarity with Airflow, Spark, Hadoop, and PostgreSQL.
- Experience with data modelling and ETL tools.
- An understanding or interest in data science or analytics would be advantageous.
#J-18808-Ljbffr