Description:

The Data Engineering Head provides management and technical guidance, as well as overall strategy to the Data Engineering Team. The Head drives the delivery and implementation of automated data pipelines within a complex and multi-platform environment. He will also help and mentor the team of developers as well as guide the team by providing overall engineering strategy. He will help ensure compliance with data engineering best practices and data governance standards across the enterprise.

Duties and Responsibilities:

Data Engineering Strategy & Execution:
- Formulate strategy including (but not limited to) tools, framework, and architecture
- Act as a point of contact for senior management for solutioning and delivery of key data engineering initiatives
- Define, prioritize, and allocate resources; track and provide status reports of work assignments, projects, and programs performed in support of the Data Engineering team
- Review business and technical requirements and ensure the data integration platform meets requirements
Data Pipeline Development:
- Leading the design and implementation of robust data pipelines for ingesting, processing, and transforming data from various sources into usable formats for analysis, applying best practices for automated data pipeline design and development
- Lead design, development, and implementation of end-to-end complex automated data pipeline system using common Big Data Tools such as (but not limited to) Apache Spark, Talend, Kafka, Airflow, NiFi, and Hadoop Tools
Performance Optimization:
- Identifying bottlenecks and optimizing data processing and storage systems for improved performance and efficiency
- Implement monitoring and measurement of data quality as defined by business rules
Technology Evaluation and Adoption:
- Staying abreast of emerging technologies and trends in data engineering, evaluating their potential impact and suitability for the organization, and overseeing their adoption where appropriate

Team Leadership and Development: Building and leading a team of data engineers, providing mentorship, guidance, and support to enable their professional growth and foster a collaborative and innovative culture.

Cross-functional Collaboration: Collaborating with other departments such as data science, analytics, and IT to understand their data needs and requirements, and aligning data engineering efforts to support organizational goals and initiatives.

Compliance and Security: Ensuring compliance with data privacy regulations and implementing robust security measures to protect sensitive data from unauthorized access or breaches.

Requirements:

8-10 years experience in people management
5-8 years Java Experience
8 years of experience in ETL development and management
Exposure to company leadership/management and technical solutioning for key business requirements
In-depth experience in automated data pipeline design, implementation, and support
Experience with Big Data Platforms
Experience establishing and building operational data stores and analytic data stores (enterprise data warehouse)
Strong SQL & PL/SQL skills with the ability to solve highly complex challenges
Advanced technical experience and business knowledge in various SDLC methodologies including waterfall, iterative, agile software development life cycle or related disciplines/processes is preferred.
Experience in DevSecOps Process
Bachelor’s degree in Computer Science or an information technology related field

Skills:

In-depth knowledge of Tier 1 Data Engineering tools is preferred, Talend, Apache Spark, NiFi, Kafka, Airflow
Working knowledge of Apache Spark, Distributed computing and other Hadoop-related concepts
Advanced technical and business knowledge in software development life cycle, quality assurance, project management, and other related disciplines/processes
Understanding of data engineering design and development best practices
Understanding of data governance, master data management best practices

#J-18808-Ljbffr

Globe jobs

Software Engineering / Innovation Technical Director

Head of Data Engineering