About the role
We are seeking a Principal Data Engineer who has a passion for data and an obsession for delivering high quality solutions and value to customers. You will be part of a team focused on data ingestion, semantic modeling, access, and security. Your efforts will support activities in our data governance, informatics, and science pillars and directly impact our ability to use data for decision-making and driving outcomes for our customers.
What you’ll do
- Provide data engineering technical leadership and guide design decisions, best practices, and engineering standards for the team
- Contribute to team’s growth by sharing knowledge and improving existing documentation
- Collaborate with stakeholders to understand requirements and translate them into workable solutions (following agile development practices)
- Design, build and support scalable, highly available data pipelines using Azure Data Factory & Databricks
- Combine data sources, metrics calculations, and business logic into semantic data models, applying dimensional modelling techniques where appropriate
- Review architecture to transform raw data into business metrics and perform data quality checks
- Responsible to classify, document, and secure data within the data platform
- Technical lead who will remain current on industry trends and best practices, and inform the future direction of our data vision, architecture, and strategy
What you’ll bring
- 8 or more years of professional experience in data engineering
- Experience with Azure Synapse Analytics (Data Warehouse, Data Lake, and Data Factory)
- Expereince with Microsoft SQL, or similar
- Experience with Python
- Experience with REST APIs and other concepts related to data extraction
- Excellent collaboration & communication skills
- Passion for quality, attention to detail, and realizing value for your customers
What we’ll prefer you to have
- 3 or more years of experience with Databricks
- Knowledge and experience with DBT, Fivetran, or other relevant data pipeline technology
- Azure Data Engineer – Associate (DP-203) certification
- Azure AI Engineer – Associate (AI-102) certification