Big Data QA Engineer

We are seeking a highly skilled and motivated Big Data QA Engineer with expertise in automation testing using Java or Python programming languages. The ideal candidate should possess a strong background in data validation, data verication, PySpark, pipeline monitoring, software testing fundamentals, STLC (Software Testing Life Cycle), MongoDB, and database testing.

Key Responsibilities:

Automation Testing:

● Develop and maintain automated test scripts using Java or Python for Big Data applications.

● Implement test automation frameworks and tools to enhance the eciency and effectiveness of the testing process.

Data Validation and Verication:

● Design and execute test cases to validate and verify large datasets, ensuring data accuracy and integrity.

● Identify and report data discrepancies or anomalies.

Pipeline Monitoring:

● Monitor and evaluate data pipelines for performance, reliability, and scalability.

● Implement strategies for identifying and resolving issues in data processing pipelines.

Software Testing Fundamentals:

● Apply sound software testing principles and methodologies to ensure high-quality deliverables.

● Collaborate with development and product teams to understand requirements and design comprehensive test plans.

STLC (Software Testing Life Cycle):

● Manage and execute test cycles throughout the SDLC.

● Collaborate with cross-functional teams to ensure comprehensive test coverage.

MongoDB and Database Testing:

● Conduct testing of MongoDB databases and other data storage systems.

● Develop and execute SQL queries for database testing purposes