Gen AI Contractor

About this role

Not quite right? These jobs in Bengaluru match the same skills — apply to a few to improve your chances.

Adobe Analytics Analyst

Citi

In OfficeBengaluru

Apply

Quality Engineering Manager - FlashArray

Everpure

In OfficeBengaluru

Apply

General Manager - Strategy & Investment

SWIGGY

In OfficeBengaluru

Apply

Manager - Frontline Capability Development

SWIGGY

In OfficeBengaluru

Apply

Skills you'll use

What you'll do

• Help build and run evaluations for our LLM-powered chatbot systems, contributing to our goal of making evals a standard practice across all teams at EarnIn
• Support the design and calibration of LLM-as-judge scorers, working closely with subject matter experts (SMEs) to align automated scoring with human ground truth
• Contribute to conversation simulation and replay infrastructure — a core building block of our automated research loop
• Assist with real-time observability tooling to detect chatbot performance degradation before customers feel it
• Help analyze production conversations and surface insights that drive chatbot improvements
• Work alongside ML engineers and analysts to iterate on prompt mutations, model changes, and evaluation pipelines
• WHAT WE'RE LOOKING FOR
• Currently pursuing a Bachelor's or Master's degree (B.E., B.Tech, M.Tech, or equivalent) in Computer Science, Software Engineering, or a related field from an Indian university
• Genuine curiosity about large language models, AI evaluation, and building reliable Gen AI systems
• Familiarity with Python and comfort working with APIs, data pipelines, or scripting

Who can apply

• Familiarity with Python and comfort working with APIs, data pipelines, or scripting
• Basic understanding of NLP concepts or hands-on experience with LLMs (even through personal projects or coursework) is a plus
• Strong understanding of probability theory and stochastic systems is a significant plus
• Strong analytical thinking — you ask "how do we know this works?" before shipping
• Clear written and verbal communication; you can translate findings for both technical and non-technical audiences
• Self-directed and thorough — you take ownership, follow through, and don't leave things half-done

About EarnIn

Searching for “EarnIn jobs” or “jobs at EarnIn”? You’re in the right place.