Minimum Qualifications
· 5 years’ experience in Data Engineering – Data Processing using various tools
· Excellent understanding and hands on experience with T-SQL programming
· Excellent understanding and hands on experience with Microsoft SQL Server, other RDBMS, and No-SQL systems
· Excellent understanding and hands on experience with ETL, Data Warehouse and Data Lake Concepts
· Exposure to cloud database technologies
Skills/Knowledge
· Python, Spark, Jupyter, AWS Lambda, AWS S3, AWS EMR, AWS Glue, AWS Step Functions
· Good to have AWS QuickSight
· DocumentDB/DynamoDB/RDS/Athena/MSK/Amazone Redshift/ Apache Iceberg
· Big data experience (Pyspark/Hadoop/Bigdata)
· Technical expertise with data models, data mining and segmentation techniques and software architecture.
· Good in performance tuning, especially tuning complex queries, procedure, and indexing strategies
· Working experience with relational databases, queries optimization (DBA or database developer with proven hands on application and understanding) with high emphasis on postgres or SQL.
· Proficient with Database Normalization process.
· Must be proficient in MS-SQL programming and can handle complex logic.
· Expert in SQL Queries, Stored Procedures, Performance Measurement & Tuning.
· Designing and developing Database solutions, schemas for structured and unstructured data, stored procedures, and functions.
· Experience on various ETL tools and techniques to handle data for cleaning, formatting, extraction, transforming and loading into Database Data Warehouse/Data Lake
· Build data systems, pipelines, and workflows.
· Work with software engineering teams to develop and scale our data infrastructure.
· Develop and test stored procedures, views, triggers, and functions.
· Sound knowledge and practical experience covering end to end Data Science life cycle.
· Write well designed, testable, and efficient code.
· Design, develop and implement the complete life cycle of data warehouses, data lakes etc.
· Ensure compliance of standards and conventions in developing programs.
· Good to have .Net/Java