Senior Big Data Engineer
Pune
- Pay
- Pay not listed
- Work setting
- Not stated
- Employment
Full-time — employment source
Employment type in the employer’s posting: Full time
From the employer’s posting
What you’ll work on
Full postingDesign, build, and maintain high-throughput data pipeline components with Spark and Kafka
Debug, tune, and optimize Spark jobs and Kafka pipelines as data volumes grow
Work with product, services, and sales engineering on architecture and technical trade-offs
Set technical standards, system documentation, and best practices for the team
Mentor junior and mid-level engineers on complex technical and pipeline performance issues
From the employer’s posting
Design, build, and maintain high-throughput data platform and pipeline components using Spark and Kafka.
Debug, tune, and optimize Spark jobs and Kafka pipelines to manage growing data volumes.
Collaborate with product, professional services, and sales engineering teams on architecture design and technical trade-offs.
Establish and refine technical standards, system documentation, and best practices across the engineering team.
Mentor junior and mid-level engineers on complex technical issues and pipeline performance.
What you’ll bring
All qualificationsCore experience
- Bachelor's degree in Computer Science, Computer Engineering, or a related technical field.
- Demonstrated experience designing, building, and optimizing distributed pipelines using Apache Spark and Apache Kafka.
- Hands-on experience scaling data platform infrastructure to process high-volume/high-throughput transaction workloads.
Preferred experience
- Experience working with high-volume, multi-tenant enterprise platform environments.
- Proficiency in Scala, Java, or Python for data processing applications.
- Proven experience mentoring junior or mid-level engineering team members.
Qualification wording
Bachelor's degree in Computer Science, Computer Engineering, or a related technical field.
Demonstrated experience designing, building, and optimizing distributed pipelines using Apache Spark and Apache Kafka.
Hands-on experience scaling data platform infrastructure to process high-volume/high-throughput transaction workloads.
Experience working with high-volume, multi-tenant enterprise platform environments.
Proficiency in Scala, Java, or Python for data processing applications.
Proven experience mentoring junior or mid-level engineering team members.
Tools in this posting
- Java
- Python
- Scala
- Kafka
- Spark
Source — Tool mentions in context
- Experience working with high-volume, multi-tenant enterprise platform environments. - Proficiency in Scala, Java, or Python for data processing applications. - Proven experience mentoring junior or mid-level engineering team members.
Responsibilities: - Design, build, and maintain high-throughput data platform and pipeline components using Spark and Kafka. - Debug, tune, and optimize Spark jobs and Kafka pipelines to manage growing data volumes.
- Design, build, and maintain high-throughput data platform and pipeline components using Spark and Kafka. - Debug, tune, and optimize Spark jobs and Kafka pipelines to manage growing data volumes. - Collaborate with product, professional services, and sales engineering teams on architecture design and technical trade-offs.
- Bachelor's degree in Computer Science, Computer Engineering, or a related technical field. - Demonstrated experience designing, building, and optimizing distributed pipelines using Apache Spark and Apache Kafka. - Hands-on experience scaling data platform infrastructure to process high-volume/high-throughput transaction workloads.
Posting record
Report an error- Status in our records
- Live
- First seen by us
- Aug 6, 2026 · 83 days ago
- Recorded sightings
- 164
- Last seen by us
- Oct 29, 2026
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Your next step
- Have your resume and examples of relevant work ready.
- Check the listed location, eligibility and core experience before starting.
- Ask the employer about the pay range before committing time to the process.
Complete your application on qualys.wd5.myworkdayjobs.com. The employer’s form will show what is required.
Already applied? Track this application
Job description
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!
Senior Big Data Engineer
Job Description: We are seeking a Senior Big Data Engineer to design, build, and operate core components of the data platform and pipeline architecture behind Qualys' Enterprise TruRisk Platform, processing billions of daily transactions.
Responsibilities:
- Design, build, and maintain high-throughput data platform and pipeline components using Spark and Kafka.
- Debug, tune, and optimize Spark jobs and Kafka pipelines to manage growing data volumes.
- Collaborate with product, professional services, and sales engineering teams on architecture design and technical trade-offs.
- Establish and refine technical standards, system documentation, and best practices across the engineering team.
- Mentor junior and mid-level engineers on complex technical issues and pipeline performance.
Required Qualifications:
- Minimum 5 years of experience in data engineering or big data platform development.
- Bachelor's degree in Computer Science, Computer Engineering, or a related technical field.
- Demonstrated experience designing, building, and optimizing distributed pipelines using Apache Spark and Apache Kafka.
- Hands-on experience scaling data platform infrastructure to process high-volume/high-throughput transaction workloads.
Preferred Qualifications:
- Experience working with high-volume, multi-tenant enterprise platform environments.
- Proficiency in Scala, Java, or Python for data processing applications.
- Proven experience mentoring junior or mid-level engineering team members.
Source details
Source notes
Source excerptsSelected passages from the saved posting. Check the full description for conditions and exceptions.
- Pay
No pay amount identified in the saved description.
- Location & working pattern
Pune
Working pattern and location restrictions need checking in the full posting.
- Work authorization
No clear work-authorization passage found. Eligibility is unconfirmed.
See how this role fits your experience
Add your resume to compare the role’s scope, tools and requirements with your experience.