← back to jobs
> job detail
6
⚙️Data Engineer

Data Platform Engineer

6sense · Bengaluru, Karnataka, India
// classified as
Data Engineer (Pipelines, infra, ingestion, ETL.)
posted
215d ago
location
Bengaluru, Karnataka, India
languages
tools
kafka, spark
> stack
kafkaspark
> description
<div class="content-intro"><p><strong><span data-contrast="none">Our Mission:</span></strong><span data-ccp-props="{&quot;201341983&quot;:0,&quot;335559685&quot;:720,&quot;335559739&quot;:160,&quot;335559740&quot;:259}">&nbsp;</span></p> <p><span data-contrast="none">6sense is on a mission to revolutionize how B2B organizations create revenue by predicting customers most likely to buy and recommending the best course of action to engage anonymous buying teams. 6sense Revenue AI is the only sales and marketing platform to unlock the ability to create, manage and convert high-quality pipeline to revenue.</span><span data-ccp-props="{&quot;201341983&quot;:0,&quot;335559685&quot;:720,&quot;335559739&quot;:160,&quot;335559740&quot;:259}">&nbsp;</span></p> <p><strong><span data-contrast="auto">Our People:</span></strong><span data-ccp-props="{&quot;201341983&quot;:0,&quot;335559685&quot;:720,&quot;335559739&quot;:160,&quot;335559740&quot;:259}">&nbsp;</span></p> <p><span data-contrast="auto">People are the heart and soul of 6sense. We serve with passion and purpose. We live by our Being 6sense values of Accountability, Growth Mindset, Integrity, Fun and One Team. Every 6sensor plays a part in defining the future of our industry-leading technology.&nbsp; 6sense is a place where difference-makers roll up their sleeves, take risks, act with integrity, and measure success by the value we create for our customers.</span><span data-ccp-props="{&quot;201341983&quot;:0,&quot;335559685&quot;:720,&quot;335559739&quot;:160,&quot;335559740&quot;:259}">&nbsp;</span></p> <p><span data-contrast="auto">We want 6sense to be the best chapter of your career.</span><span data-ccp-props="{&quot;201341983&quot;:0,&quot;335559685&quot;:720,&quot;335559739&quot;:160,&quot;335559740&quot;:259}">&nbsp;</span></p></div><div class="p-rich_text_section">We are looking for a hands-on&nbsp;<strong data-stringify-type="bold">Data Platform Engineer</strong> to contribute to <strong>6sense</strong> for our large-scale distributed ingestion and processing framework built on <strong data-stringify-type="bold">Apache Storm</strong>,&nbsp;<strong data-stringify-type="bold">Kafka</strong>,&nbsp;<strong data-stringify-type="bold">Spark</strong>.&nbsp;The engineer will work on improving reliability, scalability, and observability across real-time and batch data pipelines.</div> <div class="p-rich_text_section">&nbsp;</div> <div class="p-rich_text_section"><strong data-stringify-type="bold">Key Responsibilities</strong></div> <ul class="p-rich_text_list p-rich_text_list__bullet p-rich_text_list--nested" data-stringify-type="unordered-list" data-list-tree="true" data-indent="0" data-border="0"> <li data-stringify-indent="0" data-stringify-border="0">Develop and maintain&nbsp;<strong data-stringify-type="bold">real-time ingestion topologies</strong>&nbsp;(Apache Storm / Kafka) and&nbsp;<strong data-stringify-type="bold">batch pipelines</strong>&nbsp;(Spark / Hive).</li> <li data-stringify-indent="0" data-stringify-border="0">Enhance&nbsp;<strong data-stringify-type="bold">S3-based ingestion, checkpointing, and recovery mechanisms</strong>&nbsp;for distributed data systems.</li> <li data-stringify-indent="0" data-stringify-border="0">Build and optimize&nbsp;<strong data-stringify-type="bold">ETL workflows</strong>&nbsp;for ingestion, crawling, and enrichment pipelines.</li> <li data-stringify-indent="0" data-stringify-border="0">Implement&nbsp;<strong data-stringify-type="bold">monitoring, alerting, and fault recovery</strong>&nbsp;across the ingestion platform.</li> <li data-stringify-indent="0" data-stringify-border="0">Collaborate with internal teams to integrate crawled and processed data into downstream systems.</li> </ul> <div class="p-rich_text_section"><strong data-stringify-type="bold">Required Skills</strong></div> <ul class="p-rich_text_list p-rich_text_list__bullet p-rich_text_list--nested" data-stringify-type="unordered-list" data-list-tree="true" data-indent="0" data-border="0"> <li data-stringify-indent="0" data-stringify-border="0">Strong understanding of&nbsp;<strong data-stringify-type="bold">Apache Storm</strong>,&nbsp;<strong data-stringify-type="bold">Kafka</strong>, and&nbsp;<strong data-stringify-type="bold">Spark</strong>&nbsp;for distributed data processing.</li> <li data-stringify-indent="0" data-stringify-border="0">Hands-on experience with&nbsp;<strong data-stringify-type="bold">Hive</strong>&nbsp;and&nbsp;<strong data-stringify-type="bold">partitioned table management</strong>&nbsp;on S3/HDFS.</li> <li data-stringify-indent="0" data-stringify-border="0">Proficiency in&nbsp;<strong data-stringify-type="bold">Java and Python</strong>&nbsp;for stream and batch pipeline development.</li> <li data-stringify-indent="0" data-stringify-border="0">Familiarity with&nbsp;<strong data-stringify-type="bold">AWS services</strong>&nbsp;(S3, EC2, IAM) and CI/CD pipelines.</li> <li data-stringify-indent="0" data-stringify-border="0">Strong debugging skills in&nbsp;<strong data-stringify-type="bold">multi-threaded or distributed environments</strong>.</li> </ul> <div class="p-rich_text_section"><strong data-stringify-type="bold">Preferred / Nice-to-Have</strong></div> <ul class="p-rich_text_list p-rich_text_list__bullet p-rich_text_list--nested" data-stringify-type="unordered-list" data-list-tree="true" data-indent="0" data-border="0"> <li data-stringify-indent="0" data-stringify-border="0">Prior experience tuning&nbsp;<strong data-stringify-type="bold">Storm topologies</strong>, Spark job parallelism, and&nbsp;<strong data-stringify-type="bold">S3A connector performance</strong>.</li> <li data-stringify-indent="0" data-stringify-border="0">Exposure to&nbsp;<strong data-stringify-type="bold">data lake architectures</strong>&nbsp;and schema evolution in Hive.</li> <li data-stringify-indent="0" data-stringify-border="0">Experience with&nbsp;<strong data-stringify-type="bold">fault-tolerant design patterns</strong>&nbsp;(checkpointing, retries, recovery).</li> <li data-stringify-indent="0" data-stringify-border="0">Familiarity with&nbsp;<strong data-stringify-type="bold">observability tools</strong>&nbsp;(Grafana, Prometheus, ELK).</li> <li data-stringify-indent="0" data-stringify-border="0">Good understanding of&nbsp;<strong data-stringify-type="bold">data lineage and metadata management</strong>.</li> </ul><div class="content-conclusion"><p><strong><span data-contrast="auto">Our Benefits:</span></strong><span data-ccp-props="{&quot;201341983&quot;:0,&quot;335559685&quot;:720,&quot;335559739&quot;:160,&quot;335559740&quot;:259}">&nbsp;</span></p> <p><span data-contrast="auto">Full-time employees can take advantage of health coverage, paid parental leave, generous paid time-off and holidays, quarterly self-care days off, and stock options. We’ll make sure you have the equipment and support you need to work and connect with your teams, at home or in one of our offices.&nbsp;</span></p> <p><span data-contrast="none">We have a growth mindset culture that is represented in all that we do, from onboarding through to numerous learning and development initiatives including access to our LinkedIn Learning platform. Employee well-being is also top of mind for us. We host quarterly wellness education sessions to encourage self care and personal growth. From wellness days to ERG-hosted events, we celebrate and energize all 6sense employees and their backgrounds.</span><span data-ccp-props="{&quot;134233117&quot;:false,&quot;134233118&quot;:false,&quot;201341983&quot;:0,&quot;335551550&quot;:1,&quot;335551620&quot;:1,&quot;335559685&quot;:720,&quot;335559737&quot;:0,&quot;335559738&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}">&nbsp;</span></p> <p><strong><span data-contrast="auto">Equal Opportunity Employer:</span></strong><span data-ccp-props="{&quot;201341983&quot;:0,&quot;335559685&quot;:720,&quot;335559739&quot;:160,&quot;335559740&quot;:259}">&nbsp;</span></p> <p><span data-contrast="auto">6sense is an Equal Employment Opportunity and Affirmative Action Employers. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. If you require reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please direct your inquiries to </span><span data-contrast="auto"><a href="mailto:jobs@6sense.com">jobs@6sense.com</a><a href="mailto:jobs@6sense.com">.</a></span><span data-ccp-props="{&quot;201341983&quot;:0,&quot;335559685&quot;:720,&quot;335559739&quot;:160,&quot;335559740&quot;:259}">&nbsp;</span></p> <p><em><span data-ccp-props="{&quot;201341983&quot;:0,&quot;335559685&quot;:720,&quot;335559739&quot;:160,&quot;335559740&quot;:259}"><span class="TextRun SCXW160271132 BCX0" lang="EN-US" data-contrast="auto"><span class="NormalTextRun SCXW160271132 BCX0">We are aware of recruiting impersonation&nbsp;</span><span class="NormalTextRun SCXW160271132 BCX0">attempts</span><span class="NormalTextRun SCXW160271132 BCX0"> that are not affiliated with 6sense in any way. </span><span class="NormalTextRun SCXW160271132 BCX0">A</span><span class="NormalTextRun SCXW160271132 BCX0">ll email communications from </span><span class="NormalTextRun SCXW160271132 BCX0">6sense</span><span class="NormalTextRun SCXW160271132 BCX0"> will originate from </span><span class="NormalTextRun SCXW160271132 BCX0">the @6sense.com domain</span><span class="NormalTextRun SCXW160271132 BCX0">. </span><span class="NormalTextRun SCXW160271132 BCX0">We will </span><span class="NormalTextRun SCXW160271132 BCX0">not initially contact you via text message and will </span><span class="NormalTextRun SCXW160271132 BCX0">never request payments</span><span class="NormalTextRun SCXW160271132 BCX0">. </span><span class="NormalTextRun SCXW160271132 BCX0">If you are uncertain whether you have been contacted by an official 6sense employee, reach out to </span></span><a class="Hyperlink SCXW160271132 BCX0" href="mailto:jobs@indeed.com" target="_blank"><span class="FieldRange SCXW160271132 BCX0"><span class="TextRun Underlined SCXW160271132 BCX0" lang="EN-US" data-contrast="none"><span class="NormalTextRun CommentStart SCXW160271132 BCX0" data-ccp-charstyle="Hyperlink">jobs@</span><span class="NormalTextRun SCXW160271132 BCX0" data-ccp-charstyle="Hyperlink">6sense.com</span></span></span></a><span class="EOP SCXW160271132 BCX0" data-ccp-props="{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:279}">&nbsp;</span></span></em></p></div>