ETL DATA TESTING
peoples-growth-hr-solutions
Full-timesenior
Job description
Title: ETL Data Testing
Location: Remote
Notice Period: (Immediate Joiner - Preferred)
Experience: 5+ Years
What youll do:
Key Responsibilities:
• Select and integrate data tools and frameworks to provide requested capabilities.
• Provide technical guidance to software engineers in designing, coding, reviewing, and testing enterprise software.
• Collaborate with Data Scientists, Data Engineers, and Software Engineers to develop QA tests to validate data and models.
• Implement ETL processes. Monitor performance and recommend infrastructure changes as needed.
• Define data retention policies.
• Collaborate with the recruitment team for hiring.
Requirements:
• Experience creating detailed and comprehensive test suites using Python.
• Proficiency in writing complex SQL queries for data extraction or validation.
• Strong understanding of Big Data concepts and NoSQL databases (preferred).
• Expertise in writing Hive QL and Spark QL queries.
• Hands-on experience with data testing tools like DBT, iCEDQ, QuerySurge, Denodo, Informatica, etc.
• Good understanding of QE testing types for data quality.
• Experience in troubleshooting applications and managing the defect lifecycle.
• Ability to test software and complete UAT in an Agile environment.
• Expertise in continuous automation for increased test coverage and efficiency.
• Proactive and reactive support in deployments and production environments.
• Proficiency in Linux or Unix environments.
• Strong debugging skills.
• Ability to resolve cluster operating issues.
• Experience integrating data from multiple sources.
• Knowledge of BI tools like Power BI and Tableau (preferred).
• Experience with messaging systems like Kafka or RabbitMQ.
• Strong analytical and excellent communication skills.
Mandatory Skills:
• Python Advanced SQL queries Big Data concepts NoSQL databases Hive QL, Spark QL
• Data testing tools: DBT, iCEDQ, QuerySurge, Denodo, Informatica, etc.
• Linux or Unix
• Messaging systems: Kafka or RabbitMQ
Driving Results:
• Good single contributor & good team player.
• Flexible attitude towards work, as per the needs.
• Proactively identify & communicate issues and risks.
Other Personal Characteristics:
Dynamic, engaging, self-reliant developer Ability to deal with ambiguity Manage a collaborative and analytical approach Self-confident and humble Open to continuous learning Intelligent, rigorous thinker who can operate successfully amongst bright people