Senior Data Engineer - Spark / Kafka / NiFi

About this role

Not quite right? These jobs in Pune match the same skills — apply to a few to improve your chances.

Senior Engineer- QA Cloud Platform

Eaton

In OfficePune

Apply

Azure Site Reliability Engineer (SRE) - SaaS Operations

Zensar Technologies

In OfficePune

Apply

Senior DevOps Engineer

EXL

In OfficePune

Apply

Engineer - Firmware Linux Development

Eaton

In OfficePune

Apply

Skills you'll use

What you'll do

• Develop, test, validate and maintain, scalable batch and real-time data processing applications using Apache Spark, Kafka, and NiFi.
• Build validation suite for high-performance, fault-tolerant, and resilient distributed systems capable of handling large data volumes.
• Develop reusable frameworks, libraries, and shared platform components to accelerate engineering productivity.
• Translate business and technical requirements into scalable software solutions.
• Contribute to architecture discussions, technical designs, and engineering standards.
• Streaming & Data Platform Engineering
• Create and implement validation suite for Spark batch and streaming applications to process high-volume datasets efficiently.
• Validate and support Apache NiFi data ingestion, transformation, and routing workflows.
• Build reliable data pipelines supporting real-time and near-real-time processing requirements.
• Implement solutions for data replay, recovery, checkpoint management, and failure handling.

Who can apply

• Contribute to architecture discussions, technical designs, and engineering standards.
• Streaming & Data Platform Engineering
• Create and implement validation suite for Spark batch and streaming applications to process high-volume datasets efficiently.
• Validate and support Apache NiFi data ingestion, transformation, and routing workflows.
• Build reliable data pipelines supporting real-time and near-real-time processing requirements.
• Implement solutions for data replay, recovery, checkpoint management, and failure handling.
• Performance & Scalability
• Analyze system bottlenecks and optimize application performance, throughput, and resource utilization.
• Improve scalability, reliability, and availability of distributed applications.
• Develop and test solutions leveraging modern storage technologies including Apache Ozone, Ceph, and cloud-native storage platforms.

About Mastercard

Searching for “Mastercard jobs” or “jobs at Mastercard”? You’re in the right place.