Staff Software Development Test Engineer

About this role

Not quite right? These jobs in Bengaluru match the same skills — apply to a few to improve your chances.

Senior Machine learning Engineer

Bosch Group

In OfficeBengaluru

Apply

Senior Member of Technical Staff- Machine Learning

Athenahealth

In OfficeBengaluru

Apply

Senior Data Scientist - ML, Python

HCLTech

In OfficeBengaluru

Apply

Research Scientist - Machine Learning

GE Vernova

In OfficeBengaluru

Apply

Skills you'll use

What you'll do

• Build automated testing suites to detect hallucinations, bias, toxicity, and prompt injection vulnerabilities across LLM-powered products
• Implement automated evaluations for RAG systems measuring context relevance, groundedness, and answer faithfulness using frameworks like RAGAS or DeepEval
• Design test beds to validate multi-agent workflows — tool-calling accuracy, multi-step reasoning, memory, and autonomous decision loops
• Build and run automated conversation simulations — scripted and synthetic user journeys — to stress-test agent behaviour across intents, edge cases, and multi-turn dialog flows
• Create prompt regression frameworks to assess how changes in system prompts, temperature, and sampling parameters impact output consistency
• Statistically validate AI data outputs — distributions, precision/recall, error pattern analysis — to catch silent data quality failures before production
• Programmatically audit data ingestion, transformation, and feature store pipelines for schema drift and data corruption
• Validate vector DB indexing, embedding semantic similarity accuracy, and retrieval latency

Who can apply

• Verify quality, diversity, and privacy compliance of synthetic datasets used for model training and evaluation
• Maintain automated suites tracking ML metrics — Precision, Recall, F1, ROC-AUC — and deep learning loss curves across model versions
• Implement continuous monitoring scripts to detect data and concept drift on live inference endpoints
• Build and maintain scalable test automation frameworks for APIs, backend services, and model endpoints
• Embed AI evaluation and data QA suites into MLOps and CI/CD pipelines so quality failures block releases automatically
• Define and track AI quality KPIs and communicate release readiness to engineering and product teams
• Python — expert level; test automation, eval pipelines, data analysis (Pandas, NumPy, Pytest)
• SQL — data output validation, ground truth querying, pipeline data quality checks

About Tekion

Searching for “Tekion jobs” or “jobs at Tekion”? You’re in the right place.