Designation: Sr. Data Engineer / Lead Data Engineer
Experience: 4-8 Years
Job Location: Chennai
Work From Office: 5 Days work from office
Qualifications: B.Tech./M.Tech. or BCA/MCA degree from a reputed university
Primary Skills: Azure Cloud, Azure Data Factory, ADLS GEN2, Spark, PySpark, Scala, Hive, Databricks, Python
Secondary Skills: Azure Synapse, ETL, Shell Script, Unix, Azure functions, Git
Overall Technical skills requirements
The candidate must demonstrate proficiency in:
- Big data processing and extraction
- Ability to own and deliver on large, multi-faceted projects
- Fluency in complex SQL and experience with RDBMSs (Azure Cloud, Spark, PySpark, Scala, Python, Hive, NoSql DBs)
- Experience designing and building big data pipelines
- Experience working on large-scale, distributed systems
- Hands-on Experience working on Azure Cloud services like (Azure Data Factory, Databricks, ADLS, Azure HD Insights,Azure Synapse, Azure Data Warehouse)
- Strong hands-on experience in programming languages like PySpark, and Scala with Spark, Python, Shell Script
- Exposure to various ETL and Business Intelligence tools
- Solid grounding in Agile methodologies
- Experience with git and other source control systems
- Strong communication and presentation skills