We are looking for a highly skilled Quality Engineer to join our team. The ideal candidate will have a strong background in both Big Data and SQL, with experience in automating data validation and quality assurance processes. You will be responsible for ensuring the accuracy, integrity, and performance of our data systems, working closely with data engineers, data scientists, and other stakeholders.
How will you make an impact in this role?
- Responsible for Designing, developing, and implementing automated testing frameworks and scripts for Big Data and SQL systems.
- Implementing automated validation of data pipelines and ETL processes to ensure data accuracy and consistency.
- Create and maintain test cases, test plans, and test scripts for Big Data and SQL environments.
- Perform data quality assessments and audits, identifying and resolving data quality issues.
- Collaborate with data engineers and developers to ensure data quality standards are met.
- Conduct performance testing and tuning for Big Data and SQL systems.
- Develop and implement continuous integration and continuous deployment (CI/CD) processes for data testing.
- Generate detailed test reports and provide insights on data quality and performance.
- Stay up-to-date with the latest industry trends and best practices in Big Data and SQL testing and automation.
Minimum Qualifications
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- 12 + years of experience in quality engineering with a focus on Big Data and SQL.
- Proficiency in SQL and experience with Big Data technologies (e.g., Hadoop, Spark, Hive).
- Experience with test automation tools and frameworks (e.g., Selenium, JUnit, TestNG, JMeter).
- Familiarity with data integration tools (e.g Informatica, Microsoft).
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork skills.
- Attention to detail and a commitment to quality.
Preferred Qualifications
- Experience with cloud-based Big Data platforms (GCP preferred).
- Knowledge of scripting languages (e.g., Python, Bash).
- Familiarity with data visualization tools (e.g., Tableau, Power BI).
- Certification in Big Data or SQL (e.g., Cloudera, Microsoft).