Time since we first saw it
Day 172
Up longer than most. Similar jobs usually come down between day 9 and day 60.
From 40,906 similar postings that came down. Coming down is not always a hire.
Hyderabad, Telangana, India
Open 5 months, first seen by us 172 days agoWork setup in the employer’s posting: On-siteFrom the employer’s posting
Employment type in the employer’s posting: Full timeFrom the employer’s posting
Develop and maintain batch and streaming data pipelines in Scala and Java
Write shell scripts and YARN commands to manage Spark jobs
Manage and optimize Spark, EMR, Hadoop and YARN big data environments
Schedule and orchestrate batch workflows with Apache Airflow
Conduct root cause analysis and handle production incidents
Develop and maintain batch and streaming data pipelines using Scala and Java.
Write and execute shell scripts and Yarn commands for Spark job management.
Manage and optimize big data environments using Apache Spark, EMR, Hadoop, and YARN.
Schedule and orchestrate batch workflows using Apache Airflow.
Conduct root cause analysis and handle production incidents.
Experience with batch and streaming processing.
Proficiency in distributed systems management.
Knowledge of cloud platforms (AWS S3, EKS).
Security expertise (Vault, tokenization, encryption).
Strong analytical and troubleshooting skills for production investigation
Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 172
Up longer than most. Similar jobs usually come down between day 9 and day 60.
From 40,906 similar postings that came down. Coming down is not always a hire.
2 open jobs
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Job Description The successful candidate will work on batch and real-time data pipelines, leveraging technologies such as Scala, Java, and Apache Spark. They will manage distributed systems and cloud resources, ensure security compliance using HashiCorp Vault, orchestrate workflows with Apache Airflow, and investigate production issues by analyzing logs and monitoring metrics. Responsibilities - Develop and maintain batch and streaming data pipelines using Scala and Java. - Write and execute shell scripts and Yarn commands for Spark job management. - Manage and optimize big data environments using Apache Spark, EMR, Hadoop, and YARN. - Utilize cloud storage and container platforms such as Amazon S3 and EKS. - Implement and manage security features, including HashiCorp Vault and tokenization/encryption protocols. - Schedule and orchestrate batch workflows using Apache Airflow. - Conduct root cause analysis and handle production incidents. - Analyze application, Spark executor, and Dynatrace logs. - Monitor jobs and EMR clusters using Dynatrace metrics. - Validate data and set up production alerts. Requirements Experience with batch and streaming processing. - Proficiency in distributed systems management. - Knowledge of cloud platforms (AWS S3, EKS). - Security expertise (Vault, tokenization, encryption). - Workflow orchestration (Airflow). - Strong analytical and troubleshooting skills for production investigation
Complete your application on kmccorp.zohorecruit.in. The employer’s form will show what is required.
Already applied? Track this application
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Hyderabad, Telangana, India
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.