Time since we first saw it
Day 172
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
Pune City, India
Open 5 months, first seen by us 172 days agoLocation: Remote in India. Work from wherever you please! Your home, the beach, our offices, etc. Compensation: USD 1300-2000 monthly Professional Growth: Amazing upward mobility in a rapidly expanding company.Read the full posting
Work setup in the employer’s posting: On-siteFrom the employer’s posting
Benefits Position Type: Full-time Location: Remote in India. Work from wherever you please! Your home, the beach, our offices, etc.
Employment type in the employer’s posting: Full timeFrom the employer’s posting
Design and operate large-scale crawling and discovery systems across surface, deep, and dark web
Build automated collectors for Tor, I2P, IPFS and similar anonymized networks
Continuously discover and archive newly released datasets, logs, and credentials
Develop automated scanning for unsecured databases and exposed cloud storage
Normalize and index data from non-traditional network protocols and formats
Architect and operate large-scale, distributed crawling and discovery systems across:
Build automated collectors and archivers for anonymized and decentralized networks including:
Continuously discover, archive, and download newly released datasets, logs, credentials, and artifacts the moment they appear
Develop automated scanning systems to identify:
Normalize and index data from non-traditional network protocols and formats
Strong Python expertise and experience with frameworks such as Scrapy, Playwright, Selenium, or custom async systems
Familiarity with Tor, I2P, underground forums, stealer logs, or credential ecosystems
Proven experience operating high-volume, automated data collection systems in production
Experience processing large breach datasets or stealer logs
Deep understanding of web protocols, HTTP, DOM parsing, and adversarial scraping environments
Experience with asynchronous, concurrent, and distributed architectures
Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 172
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
1 open job
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Minimum 4 years of hands-on experience in data engineering, intelligence collection, crawling, or distributed data pipelines - Strong Python expertise and experience with frameworks such as Scrapy, Playwright, Selenium, or custom async systems - Proven experience operating high-volume, automated data collection systems in production
- Familiarity with SQL and NoSQL databases (PostgreSQL, MongoDB, Elasticsearch, Cassandra) - Strong Linux/Unix, shell scripting, and Git-based workflows - Experience deploying and operating systems using Docker, Kubernetes, AWS, or GCP
- Experience with asynchronous, concurrent, and distributed architectures - Familiarity with SQL and NoSQL databases (PostgreSQL, MongoDB, Elasticsearch, Cassandra) - Strong Linux/Unix, shell scripting, and Git-based workflows
- Strong Linux/Unix, shell scripting, and Git-based workflows - Experience deploying and operating systems using Docker, Kubernetes, AWS, or GCP - Excellent analytical, debugging, and problem-solving skills
- Unsecured databases (Elasticsearch, MySQL, PostgreSQL, MongoDB, etc.) - Exposed cloud storage (S3, Azure, GCP, DigitalOcean Spaces) - Open FTP servers, backups, and misconfigured archives
- Implement advanced anti-bot, evasion, and resiliency techniques (proxy rotation, fingerprinting, CAPTCHA mitigation, session handling) - Automate deployment, scaling, and monitoring using Docker, Kubernetes, and cloud infrastructure - Continuously optimize performance, reliability, and cost efficiency of crawler clusters
- Develop automated scanning systems to identify: - Unsecured databases (Elasticsearch, MySQL, PostgreSQL, MongoDB, etc.) - Exposed cloud storage (S3, Azure, GCP, DigitalOcean Spaces)
Complete your application on heroic.zohorecruit.com. The employer’s form will show what is required.
Already applied? Track this application
Our Threat Research Team’s mission is aggressive: achieve near-total coverage of global breach and leak data with 99%+ automation. Your work directly enables HEROIC’s ability to identify exposures before they are weaponized.
Architect and operate large-scale, distributed crawling and discovery systems across:
Surface web, deep web, and dark web
Hacker forums, underground marketplaces, and breach communities
Chat platforms (Telegram, Discord, IRC, WhatsApp, etc.)
Paste sites, code repositories, and social platforms used for breach disclosure
Continuously discover, archive, and download newly released datasets, logs, credentials, and artifacts the moment they appear
Build automated collectors and archivers for anonymized and decentralized networks including:
Tor (.onion), I2P, ZeroNet, Freenet, IPFS, GNUnet, Lokinet, Yggdrasil, and similar systems
Design resilient workflows for unreliable, adversarial, or ephemeral data sources
Normalize and index data from non-traditional network protocols and formats
Develop automated scanning systems to identify:
Unsecured databases (Elasticsearch, MySQL, PostgreSQL, MongoDB, etc.)
Exposed cloud storage (S3, Azure, GCP, DigitalOcean Spaces)
Open FTP servers, backups, and misconfigured archives
Monitor and ingest data from file hosting and distribution platforms commonly used for breach dumps
Build ETL pipelines to clean, normalize, enrich, and index structured and unstructured data
Implement advanced anti-bot evasion strategies (proxy rotation, fingerprinting, CAPTCHA mitigation, session management)
Integrate collected intelligence into centralized databases and search systems
Design APIs and internal tooling to support downstream analysis and AI/ML workflows
Implement advanced anti-bot, evasion, and resiliency techniques (proxy rotation, fingerprinting, CAPTCHA mitigation, session handling)
Automate deployment, scaling, and monitoring using Docker, Kubernetes, and cloud infrastructure
Continuously optimize performance, reliability, and cost efficiency of crawler clusters
Minimum 4 years of hands-on experience in data engineering, intelligence collection, crawling, or distributed data pipelines
Strong Python expertise and experience with frameworks such as Scrapy, Playwright, Selenium, or custom async systems
Proven experience operating high-volume, automated data collection systems in production
Deep understanding of web protocols, HTTP, DOM parsing, and adversarial scraping environments
Experience with asynchronous, concurrent, and distributed architectures
Familiarity with SQL and NoSQL databases (PostgreSQL, MongoDB, Elasticsearch, Cassandra)
Strong Linux/Unix, shell scripting, and Git-based workflows
Experience deploying and operating systems using Docker, Kubernetes, AWS, or GCP
Excellent analytical, debugging, and problem-solving skills
Strong written and verbal communication skills.
Direct experience with dark web intelligence, breach data, OSINT, or threat research
Familiarity with Tor, I2P, underground forums, stealer logs, or credential ecosystems
Experience processing large breach datasets or stealer logs
Background working in adversarial data environments
Exposure to AI/ML-driven intelligence platforms
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Location: Remote in India. Work from wherever you please! Your home, the beach, our offices, etc. Compensation: USD 1300-2000 monthly Professional Growth: Amazing upward mobility in a rapidly expanding company.
Pune City, India
- Position Type: Full-time - Location: Remote in India. Work from wherever you please! Your home, the beach, our offices, etc. - Compensation: USD 1300-2000 monthly
No clear work-authorization passage found. Eligibility is unconfirmed.