← back to jobs
> job detail
D
👽Other

Senior Data Engineer

DigiCert · India Remote
// classified as
Other (Adjacent or hard to classify.)
posted
1d ago
location
India Remote
languages
javascript, python, sql
tools
aws, azure, databricks
> stack
javascriptpythonsqltypescriptawsazuredatabricksdeltakafkasparkfastapiflaskpyspark
> description
<div class="content-intro"><p style="line-height: 1.4;"><span style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>Who we are</strong></span></p> <p style="line-height: 1.4;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">DigiCert is a global leader in intelligent trust. We protect the digital world by ensuring the security, privacy, and authenticity of every interaction. Our AI-powered DigiCert ONE platform unifies PKI, DNS, and certificate lifecycle management, to secure infrastructure, software, devices, messages, AI content and agents. Learn why more than 100,000 organizations, including 90% of the Fortune 500, choose DigiCert to stop today’s threats and prepare for a quantum-safe future at&nbsp;<a href="http://www.digicert.com/">www.digicert.com</a></span></p></div><p><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>Job summary</strong></span></p> <p><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">We are looking for a Sr. Data Engineer - Full Stack to design and deliver end-to-end data solutions on Databricks — from stakeholder discovery and data ingestion through modeling, APIs, applications, and production operations.This hands-on role combines deep data engineering expertise with strong stakeholder partnership, product thinking, and end-to-end solution ownership. You will work directly with business and technical teams to clarify ambiguous problems, rapidly prototype solutions, and turn validated concepts into secure, scalable, and reliable data products.You will bridge data engineering, analytics, software engineering, and business teams to make trusted data actionable.</span></p> <p>&nbsp;</p> <p><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>What you will do</strong></span></p> <ul> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Partner directly with business and technical stakeholders to understand workflows, define desired outcomes, and translate ambiguous needs into technical requirements and delivery plans.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Design, build, and maintain end-to-end data products on Databricks, spanning ingestion, Delta Lake storage, transformation, serving, APIs, and user-facing experiences.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Develop and operate reliable batch, incremental, and streaming pipelines using SQL, Python, PySpark, Kafka, and Databricks-native capabilities.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Design event-driven and near-real-time data solutions that integrate with operational systems and downstream consumers.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Build backend services, APIs, and integrations that make governed data available to applications and operational workflows.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Develop lightweight applications, dashboards, and interfaces in partnership with product, analytics, BI, and user-experience teams.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Rapidly prototype solutions, validate them through stakeholder feedback, and prepare successful concepts for production use.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Create scalable data models and curated datasets that support analytics, reporting, AI/ML, and operational decision-making.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Implement data-quality, security, lineage, and governance controls using Databricks and Unity Catalog.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Establish automated testing, CI/CD, monitoring, alerting, and documentation across the data-product lifecycle.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Optimize pipelines, streaming workloads, queries, services, and applications for reliability, performance, scalability, and cost.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Diagnose and resolve issues across source systems, streaming platforms, pipelines, data models, APIs, applications, and downstream consumers.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Collaborate with platform and product engineering teams to turn recurring stakeholder needs into reusable capabilities.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Lead technical design and code reviews, mentor engineers, and help elevate full-stack data-engineering practices.</span></li> </ul> <p>&nbsp;</p> <p><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>What you will have</strong></span></p> <ul> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">5+ years of experience in data engineering, software engineering, or a related role, including ownership of production data solutions.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Strong proficiency in SQL, Python, and PySpark, with experience building reliable, production-grade pipelines and data products.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Hands-on experience with Databricks, Apache Spark, Delta Lake, and Unity Catalog or comparable data-governance capabilities.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Experience designing and supporting streaming or near-real-time data pipelines using Kafka, Kinesis, Event Hubs, or similar event-streaming technologies.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Strong understanding of event-driven architecture, message processing, schema evolution, data consistency, and streaming reliability.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Experience delivering full-stack solutions that include data pipelines, backend services or APIs, and lightweight user-facing applications.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Experience building REST APIs, services, and integrations using Python frameworks such as FastAPI, Flask, or comparable technologies.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Experience with AWS, Azure, or GCP and cloud-native architecture patterns.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Strong understanding of data modeling, data warehousing, distributed processing, and analytics-friendly data design.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Experience with Git, automated testing, CI/CD, monitoring, and production-deployment practices.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Demonstrated ability to work directly with stakeholders, navigate ambiguity, and translate business problems into practical technical solutions.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Strong communication, technical leadership, problem-solving, and end-to-end ownership skills.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Ability to balance rapid delivery with maintainability, security, governance, and operational reliability.</span></li> </ul> <p>&nbsp;</p> <p><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>Nice to have</strong></span></p> <ul> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Experience building applications with React or another modern frontend framework.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Familiarity with infrastructure as code, containerization, and automated cloud deployment.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Experience supporting AI/ML pipelines, feature engineering, retrieval systems, or generative AI use cases.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Experience with data observability, platform engineering, or data-product management practices.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Working knowledge of JavaScript or TypeScript and a modern frontend framework such as React, or comparable data-application experience.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Background in forward-deployed engineering, solutions engineering, technical consulting, or another stakeholder-embedded delivery role.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Experience designing reusable data platforms, frameworks, or self-service capabilities.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Prior experience mentoring engineers and contributing to engineering standards.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Experience working in Agile or Scrum environments.</span></li> </ul> <p>&nbsp;</p> <p><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>Benefits</strong></span></p> <ul> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Generous time off policies</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Top shelf benefits</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Education, wellness and lifestyle support</span></li> </ul> <p>&nbsp;</p> <p><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">To protect candidate information and maintain a secure hiring process, all applications must be submitted through our careers portal. Resumes or CVs sent directly via email will not be reviewed or considered.</span></p> <p>&nbsp;</p> <p><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">#LI-SD1</span></p>