QA automation engineer to lead testing of the data ingestion pipelines and data quality. Performs different levels of automated testing for various system components, as well as integration testing. Ability to work with fluid and high-level requirements as input for test plan creation.Willingness to work independently, without close direct supervision.

Responsibilities

• Work with Data Engineers and Data Product Managers to develop functional and regression tests to ensure the quality of data
• Work in a focused and nimble team that collaborates on common problems across products and focus areas
• Involved in all phases of product development, starting from requirements to validation and deployment
• Own components, processes, and workflows that demand professionalism, excellent communication, teamwork, and documentation skills
• Create, maintain, and improve automation test suites and frameworks
• Monitor and maintain CI/CD pipelines
• Effectively communicate and report issues to project teams

Requirements

• Hands on experience with MapReduce or other Hadoop implementations including a deep understanding of Hive or Pig to query and process data in Hadoop
• Proficiency in Java or a similar Object-Oriented language along with strong scripting skills (Java/bash/Python)
• Expert level experience with SQL, TSQL or HQL to validate ETL jobs
• Experience with at least one mainstream Data Warehousing system (Snowflake, Vertica, Oracle) along with expert knowledge of Data Warehouse concepts
• Familiarity with high-volume low latency data platform and technology stacks such as Spark, Kafka, Druid and etc
• Experience in testing of the data ingestion pipelines and data quality
• Excellent troubleshooting skills to triage complex issues
• Experience working within a CI/CD environment along with familiarity of Jenkins
• Experience with automation tools such as TestNG, JUnit
• Passion for software test development and proven ability to test enterprise distributed systems
• Strong quality and automation mindset
• What we value as a team:
  • Scripts written for readability, performance, scale and maintainability
  • Proactive in communication
  • Colloborate with other members in agile eco-system
  • Mentoring junior members of the team
  • Out of the box thinking to resolve issues which are recurring in the system
  • Ability to suggest changes in the product with respect to user experience

Nice to have

• 2 to 4 years of SDET experience
• Experience with working in large, cross-functional teams
• Experience implementing test automation frameworks
• Experience working in a fast paced environment
• A background in utilizing cloud computing services such as Amazon Web Services or Google Cloud Platform
• Ability to learn and rapidly adapt to change
• Experience with Agile and strong collaboration skills with Business and Ops

Click here to apply: https://www.epam.com/careers/job-listings/job.53760