DataOps Engineer (AWS)
Andela
Location Requirement: India
About Andela
Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career opportunities with leading organizations, access to a global community of professionals, and educational opportunities with leading technology providers.
At Andela, we’re deeply passionate about creating long-lasting and transformative growth opportunities for all - and doing it in an E.P.I.C. way! We’re excited to continue building our remote-first team with incredible people like you. After applying for this role, you will join our Andela Community of brilliant technologists by passing a technical screening and live interview. As a community member, you’ll have access to many exclusive technologist roles. Join Andela today to access this opportunity and more in our global marketplace!
Our roles are typically filled at lightning speed, so if you’re considering applying, get your application in quickly!
Andela´s Benefits:
-- 100% payment in USD.
About the role
Key Responsibilities:
- Design, implement, and maintain the data pipeline infrastructure that ingests, stores, and processes large amounts of data.
- Develop and maintain data quality checks, error handling procedures and recovery processes.
- Ensure the reliability and performance of the data pipeline infrastructure and support its operation.
- Collaborate with cross-functional teams to identify, design, and implement data solutions to meet business requirements.
- Design and implement security and data access controls to ensure the privacy and protection of sensitive data.
- Troubleshoot and resolve technical issues with the data pipeline infrastructure.
- Document the data pipeline infrastructure, processes, and procedures for reference and training purposes.
- Stay up-to-date with emerging trends and technologies in the field of data engineering and data operations.
- Utilize DevOps tools such as Terraform to automate infrastructure deployment and management.
Qualifications
- Bachelor's degree in computer science, Information Systems, or a related field
- 5+ years of experience in DevOps or data engineering, data operations, or a related field
- Knowledge of data quality, error handling, and recovery processes
- Experience with AWS and its tools: Lambda, Redshift, Lake Formation, MSK, VPC (Endpoints, Gateway, Peering connections, Routing), Glue, SF, IAM
- Terraform for infrastructure deployment and management
- Github Actions as CI/CD
- Python & Shell (at least scripting level knowledge)
- Docker and containerization
- Excellent problem-solving and analytical skills
- Strong written and verbal communication skills
- Ability to work in a fast-paced, dynamic environment
Preferred Qualifications
Required skills
DevOps (4 - 6 yrs)
AWS (Amazon Web Services) (4 - 6 yrs)
Terraform (4 - 6 yrs)
Containerization (4 - 6 yrs)
Docker (4 - 6 yrs)
Shell Scripting (2 - 3 yrs)
Python (2 - 3 yrs)
Identity and Access Management (4 - 6 yrs)
Lambda (4 - 6 yrs)
Redshift (AWS) (4 - 6 yrs)
Optional skills
Kubernetes (4 - 6 yrs)
Must have: AWS and its tools: (Lambda, Redshift, Lake Formation, MSK, VPC (Endpoints, Gateway, Peering connections, Routing), Glue, SF, IAM), GitHub Actions, Python and Shell (scripting), Docker, DevOps, DataOps Nice to have: Kubernetes
Main job time zone: EST
Time zone overlap requirements: 5+ hours with EST (9 am - 2 pm)
Location Requirements: India
Working hours: Full-time dedication (8 hours/Day - 40 hours/week)
Important: this role requires in-person work once a quarter for a few days (approximately a week). Exact dates and location to be confirmed.
Device: Laptop to be provided by Andela (either shipped or stipend to purchase, in this case a receipt must be provided)
Offer
Estimated Duration: 12-month-term contractor position (Renewable)
Full-time dedication (40 hours/week)
At Andela, we know our strengths lie in our diverse community whose talents, perspectives, backgrounds, and orientations we take pride in. Andela is committed to nurturing a work environment where all individuals are treated with respect and dignity. Everyone has the right to work in a professional atmosphere that promotes equal employment opportunities and prohibits discriminatory practices. Andela provides equal employment opportunities to all employees and applicants without regard to factors including but not limited to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, pregnancy (including breastfeeding), genetic information, HIV/AIDS or any other medical status, family or parental status, marital status, amnesty or status as a covered veteran in accordance with applicable federal, state and local laws. This commitment applies to all terms and conditions of employment, including but not limited to hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. Our policies expressly prohibit any form of harassment and/or discrimination, as stated above.
Andela is home for all. Come as you are.