Data QA Engineer
1 view5+ years
Posted 8 days ago
- Llm
- Platform Engineering
- Python
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Data QA Engineer based in India (Remote).
As a Data QA Engineer, you will play a critical role in ensuring the quality, accuracy, and reliability of an AI-powered conversational data platform. You will design and execute test strategies covering data extraction, parsing, natural language generation, and reporting workflows. Working closely with data engineers, ML researchers, and software teams, you will validate complex data pipelines, test AI and LLM outputs, and build automated verification frameworks. You will also monitor data integrity across production and staging environments, analyze discrepancies, and implement preventive quality controls. Combining technical depth with strong problem-solving skills, you will help maintain high standards of data precision and customer trust.
Accountabilities
You will take ownership of testing processes and validation standards across data transformation, reporting, and AI-generated outputs. Your responsibilities will blend hands-on testing, automation, exploratory analysis, and cross-team collaboration.
- Design, develop, and maintain automated test suites and validation scripts for data pipelines and reporting systems.
- Validate natural language query outputs, AI responses, and LLM-generated summaries against ground truth datasets.
- Perform end-to-end data validation across ETL workflows, data warehouses, and user-facing dashboards.
- Write complex SQL queries and Python scripts to identify data inconsistencies, missing values, and calculation errors.
- Collaborate with data engineering and machine learning teams to investigate root causes of data anomalies and verify fixes.
- Establish benchmarks, quality metrics, and test coverage standards for AI and analytics components.
- Create and maintain detailed test documentation, defect reports, and validation summaries.
Requirements :
- At least 5 years of professional experience in software quality assurance, data testing, or analytics validation.
- Strong proficiency in SQL for data validation, complex queries, and dataset reconciliation.
- Hands-on experience with Python for test automation, data processing, and validation scripting.
- Experience testing AI/ML models, natural language processing (NLP) pipelines, or LLM-driven applications.
- Familiarity with data warehousing solutions such as Snowflake, BigQuery, or Redshift.
- Solid understanding of ETL processes, data models, and database architectures.
- Excellent analytical and troubleshooting abilities with strong attention to detail.
Benefits :
- Fully remote working arrangement in India.
- Flexible working hours supporting work-life balance.
- Comprehensive health, medical, and wellness coverage.
- Continuous learning opportunities and support for professional development.
- Collaborative and innovative team environment working on modern AI solutions.