Role : Senior Data Engineer
Years of Experience : 3-7 years
Location : Mumbai/Bangalore (Hybrid)
JOB ROLE - Senior Data Engineer - AWS
We are seeking an experienced and passionate Senior Data Engineer (AWS) to join our dynamic team. In this role, you will play a crucial part in designing and implementing scalable and efficient data solutions on the AWS platform. If you are a data enthusiast with a strong background in AWS services and a proven track record of solving complex data challenges, we invite you to be a part of our innovative journey.
Must have skills:
- Proficiency in SSIS, Sqoop, and creating data pipelines.
- Expertise in SQL writing and performance optimization.
- Knowledge of Data Ingestion and Engineering Platforms.
- Understanding and experience in Data Warehousing or Data Integration projects.
- Strong knowledge of MySQL/Amazon Aurora; familiarity with relational databases like ORACLE and SQL Server.
- Good understanding of UNIX/LINUX shell scripting.
- Minimum 2+ years of experience with AWS services (S3, DMS, Redshift, Glue, EMR, Lambda).
- Expertise in data modeling principles/methods (Conceptual, Logical & Physical Data Models).
- Familiarity with metadata management, data modeling, and related tools (Erwin, ER Studio, SQL Workbench).
- Strong problem-solving, multitasking, and organizational skills.
- Good written and verbal communication skills.
Good to have skills:
- Familiarity with machine learning concepts and application.
- Experience in big data technologies (Hadoop, Spark, Kafka).
- Knowledge of additional relational databases, especially ORACLE and SQL Server.
- Experience with other cloud platforms such as Azure.
- Understanding of data security, compliance, and governance principles.
- Exposure to DevOps practices and continuous integration/continuous deployment (CI/CD) pipelines for data solutions.
- Skills in advanced analytics, data mining, and statistical analysis.
Role & Responsibilities:
- Collaborate with business users and stakeholders to understand business processes.
- Design and implement Dimensional and Fact tables.
- Identify and implement data transformation/cleansing requirements.
- Develop highly scalable, reliable, and high-performance data processing pipelines.
- Create conceptual, logical, and physical data models with metadata, including data lineage.
- Design, develop, and maintain ETL workflows and mappings.
- Provide research, high-level design, and estimates for data transformation and integration.
- Support ETL processes for timely data availability.
- Analyze and resolve problems, providing technical assistance as necessary.
- Translate business information needs into well-defined data requirements.