Job Position: Azure Cloud DB Engineer
Job Type: Full-Time
Location: Kolkata, IN
Experience: - 3 to 8+ Years
Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python
Responsibilities:
Data Pipeline Development:
- Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from various sources.
- Develop and manage ETL processes to ensure data quality and integrity across platforms.
Database Management:
- Deploy and maintain Azure SQL Databases and Azure Cosmos DB, ensuring optimal performance and reliability.
- Monitor and troubleshoot database performance issues, applying best practices for tuning and scaling.
Data Engineering:
- Utilize Azure Databricks for big data processing, leveraging PySpark to analyze and transform large datasets.
- Develop and maintain data models and architecture that support analytics and reporting needs.
Programming and Scripting:
- Write efficient Python scripts to automate data processing tasks and enhance data workflows.
- Create reusable code libraries and documentation to streamline data operations and facilitate collaboration.
Collaboration and Support:
- Work closely with data analysts, data scientists, and application developers to support data-driven projects.
- Provide technical support for database-related issues and assist in troubleshooting data pipeline failures.
Best Practices and Security:
- Implement data governance and security policies to ensure compliance with industry standards.
- Stay up-to-date with emerging technologies and best practices in cloud database management and data engineering.
Qualifications:
Bachelor’s degree in Computer Science, Information Technology, or a related field.