We are seeking a talented and experienced Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data solutions on the Azure platform. You will collaborate closely with cross-functional teams to understand business requirements and translate them into robust data pipelines and architectures.
Responsibilities:
- Design, develop, and maintain data pipelines and ETL processes on Azure using services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
- Implement data storage solutions using Azure SQL Database/Datawarehouse, and Azure Data Lake Storage.
- Optimize data solutions for performance, scalability, and cost-effectiveness.
- Collaborate with other data engineering teams to integrate data pipelines.
- Ensure data security, compliance, and governance standards are implemented throughout the data lifecycle.
- Troubleshoot and resolve data-related issues in a timely manner.
- Stay updated with the latest Azure data technologies and best practices.
Requirements:
- 4+ years of experience working as a Data Engineer, with a focus on Azure cloud platform.
- Good proficiency in SQL and experience with relational and non-relational databases.
- Hands-on experience with Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
- Good hands-on experience in PySpark or Scala with Spark.
- Experience with data modeling, data warehousing, and dimensional modeling concepts.
- Knowledge of Azure security and compliance standards.
- Excellent problem-solving skills and ability to work independently and in a team environment.
- Good knowledge and hands-on experience on Git and DevOps practices.
- Strong communication and collaboration skills.
Preferred:
- Azure certification such as Microsoft Certified: Azure Data Engineer Associate.
- Experience with other cloud platforms such as Google Cloud Platform.