Back to jobs

Data Engineer II

Pay
$104,000–135,000/year · BaseAnnual period assumed — pay source
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related STEM field. Base Salary Range: $104,000 – $135,000 The salary range reflects the expected base compensation for a fully qualified candidate at this level based on experience, qualifications, and market data at the time of posting.
Read the full posting
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Build, optimize and maintain real-time and batch data pipelines on AWS and Databricks

  • Prepare, transform and serve high-quality data to customers and downstream systems with Databricks and Spark

  • Improve cost and performance of data ingestion, transformation and storage workflows

  • Troubleshoot and fix data pipeline failures, including on-call outside business hours

  • Own complex data engineering initiatives from design through production support

From the employer’s posting
Build, optimize, and maintain real-time and batch data pipelines using AWS technologies
Use Databricks and Spark to prepare, transform, and serve high-quality data to customers and downstream systems.
Identify and implement improvements to the cost and performance of data ingestion, transformation, and storage workflows.
Be available for on-call support to troubleshoot and remediate data pipeline failures outside of standard business hours.
Independently own complex data engineering initiatives from design and development through deployment and production support.

Before you apply

Work authorization
Must already have the right to workSpyCloud is not sponsoring visas at this time

What you’ll bring

All qualifications

Core experience

  • 5+ years of professional experience in data engineering, software engineering, or a closely related discipline.
  • Familiarity with AI/ML tools and technologies such as SageMaker, LangChain, or vector databases.
  • 25 days annual accrued holiday plus 8 paid bank holidays and a paid company shutdown during winter holidays
  • Experience building and operating Lakehouse, Databricks, or large-scale distributed data architectures in AWS.
  • Understanding of data governance, privacy, and compliance considerations within AI and ML environments.
  • Strong understanding of distributed systems as they relate to data storage, processing, and computing.
Qualification wording
5+ years of professional experience in data engineering, software engineering, or a closely related discipline.
Familiarity with AI/ML tools and technologies such as SageMaker, LangChain, or vector databases.
25 days annual accrued holiday plus 8 paid bank holidays and a paid company shutdown during winter holidays
Experience building and operating Lakehouse, Databricks, or large-scale distributed data architectures in AWS.
Understanding of data governance, privacy, and compliance considerations within AI and ML environments.
Strong understanding of distributed systems as they relate to data storage, processing, and computing.
Education & alternatives
- Comfort working in fast-paced environments with evolving product and technical requirements. - Bachelor’s or Master’s degree in Computer Science, Engineering, or a related STEM field. Base Salary Range: $104,000 – $135,000

About SpyCloud

Our mission is to make the internet a safer place by disrupting the criminal underground.

In the employer’s words · Read in context

Apply at SpyCloud

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 16, 202636 days ago
Recorded sightings
33
Last seen by us
Nov 21, 2026
Employer says posted
Oct 13, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

Lower than most similar jobs

$104K–$135K against $127K–$189K, the middle half of what similar US postings state.

From 2,448 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 36

Similar jobs usually come down between day 6 and day 56.

From 14,771 similar postings that came down. Coming down is not always a hire.

SpyCloud is hiring

1 open job

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • C
  • Python
  • AWS
  • Databricks
  • DynamoDB
  • Elasticsearch
  • S3
  • SageMaker
  • Spark
  • Terraform
  • Go
Where the posting names them
- Experience with observability and monitoring tools for large-scale data platforms. - Experience with Go or C programming languages. - Experience working with cybersecurity or security-related datasets and technologies.
- Experience preparing and managing data for machine learning and LLM workflows. - Strong development skills in Python, particularly when building data-intensive systems. - Practical experience with DynamoDB and other AWS-native data services.
- Use Databricks and Spark to prepare, transform, and serve high-quality data to customers and downstream systems. - Build, optimize, and maintain real-time and batch data pipelines using AWS technologies such as Lambda, S3, DynamoDB, ECS, EKS, and Terraform, as well as develop and maintain pipelines within the Databricks ecosystem. - Identify and implement improvements to the cost and performance of data ingestion, transformation, and storage workflows.
- 5+ years of professional experience in data engineering, software engineering, or a closely related discipline. - Experience building and operating Lakehouse, Databricks, or large-scale distributed data architectures in AWS. - Strong understanding of distributed systems as they relate to data storage, processing, and computing.
- Strong development skills in Python, particularly when building data-intensive systems. - Practical experience with DynamoDB and other AWS-native data services. - Experience with infrastructure-as-code tools such as Terraform.
SpyCloud is on a mission to make the internet a safer place by disrupting the criminal underground. SpyCloud’s solutions thwart cyberattacks and protect more than 4 billion accounts worldwide. Cybersecurity is an exciting, evolving space, and being at the forefront of the fight to disrupt cybercrime makes SpyCloud a special place to work. If you’re driven to align your career with a fantastic mission, look no further! This Data Engineer II role sits on the Engineering team, reporting to the Senior Director of Data Engineering. Your focus will include evolving our data platform using technologies such as Databricks and Spark, building scalable data pipelines, and serving customers through purpose-built data stores including RDS, Elasticsearch, and DynamoDB. This is a hands-on individual contributor role with ownership of complex data engineering initiatives that support the scalability, reliability, and continued evolution of SpyCloud’s data platform. What You'll Do:
- Design, build, and improve scalable data systems with a focus on performance, and reliability. - Use Databricks and Spark to prepare, transform, and serve high-quality data to customers and downstream systems. - Build, optimize, and maintain real-time and batch data pipelines using AWS technologies such as Lambda, S3, DynamoDB, ECS, EKS, and Terraform, as well as develop and maintain pipelines within the Databricks ecosystem.
- Strong understanding of distributed systems as they relate to data storage, processing, and computing. - Experience building and managing Elasticsearch/OpenSearch data stores. - Hands-on experience designing, building, and maintaining ETL and data-processing pipelines.
Nice to Have: - Familiarity with AI/ML tools and technologies such as SageMaker, LangChain, or vector databases. - Understanding of data governance, privacy, and compliance considerations within AI and ML environments.
- Practical experience with DynamoDB and other AWS-native data services. - Experience with infrastructure-as-code tools such as Terraform. - Experience troubleshooting complex data pipeline, performance, and data quality issues in production environments.

Your next step

Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.

Applying through Greenhouse

  • No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
  • Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

Job description

View original posting ↗

SpyCloud is on a mission to make the internet a safer place by disrupting the criminal underground. SpyCloud’s solutions thwart cyberattacks and protect more than 4 billion accounts worldwide. Cybersecurity is an exciting, evolving space, and being at the forefront of the fight to disrupt cybercrime makes SpyCloud a special place to work. If you’re driven to align your career with a fantastic mission, look no further!

This Data Engineer II role sits on the Engineering team, reporting to the Senior Director of Data Engineering. Your focus will include evolving our data platform using technologies such as Databricks and Spark, building scalable data pipelines, and serving customers through purpose-built data stores including RDS, Elasticsearch, and DynamoDB. This is a hands-on individual contributor role with ownership of complex data engineering initiatives that support the scalability, reliability, and continued evolution of SpyCloud’s data platform.

 

What You'll Do:

  • Design, build, and improve scalable data systems with a focus on performance, and reliability.
  • Use Databricks and Spark to prepare, transform, and serve high-quality data to customers and downstream systems.
  • Build, optimize, and maintain real-time and batch data pipelines using AWS technologies such as Lambda, S3, DynamoDB, ECS, EKS, and Terraform, as well as develop and maintain pipelines within the Databricks ecosystem.
  • Identify and implement improvements to the cost and performance of data ingestion, transformation, and storage workflows.
  • Be available for on-call support to troubleshoot and remediate data pipeline failures outside of standard business hours.
  • Partner with Product Management, SpyCloud Labs, and Engineering teams to understand requirements and develop effective technical solutions.
  • Evaluate and implement modern tooling for data processing, ML/AI data workflows, and observability.
  • Contribute to architectural and technical design decisions and help implement scalable solutions aligned with engineering standards.
  • Promote engineering best practices through collaboration, code reviews, documentation, and knowledge sharing.
  • Identify and resolve complex data quality, performance, security, and reliability issues across production systems.
  • Independently own complex data engineering initiatives from design and development through deployment and production support.
  • Contribute to the continued evolution of SpyCloud’s data platform as product, customer, and AI requirements grow.

Requirements:

  • 5+ years of professional experience in data engineering, software engineering, or a closely related discipline.
  • Experience building and operating Lakehouse, Databricks, or large-scale distributed data architectures in AWS.
  • Strong understanding of distributed systems as they relate to data storage, processing, and computing.
  • Experience building and managing Elasticsearch/OpenSearch data stores.
  • Hands-on experience designing, building, and maintaining ETL and data-processing pipelines.
  • Experience preparing and managing data for machine learning and LLM workflows.
  • Strong development skills in Python, particularly when building data-intensive systems.
  • Practical experience with DynamoDB and other AWS-native data services.
  • Experience with infrastructure-as-code tools such as Terraform.
  • Experience troubleshooting complex data pipeline, performance, and data quality issues in production environments.
  • Ability to independently own complex technical projects from design and development through deployment and production support.
  • Ability to evaluate technical trade-offs and contribute effectively to architectural and design decisions.
  • Strong communication and collaboration skills across technical and non-technical stakeholders.

Nice to Have:

  • Familiarity with AI/ML tools and technologies such as SageMaker, LangChain, or vector databases.
  • Understanding of data governance, privacy, and compliance considerations within AI and ML environments.
  • Experience with observability and monitoring tools for large-scale data platforms.
  • Experience with Go or C programming languages.
  • Experience working with cybersecurity or security-related datasets and technologies.
  • Comfort working in fast-paced environments with evolving product and technical requirements.
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related STEM field.

Base Salary Range: $104,000 – $135,000

The salary range reflects the expected base compensation for a fully qualified candidate at this level based on experience, qualifications, and market data at the time of posting.

U.S.-Based Benefits + Perks (for Full Time Employees):

At SpyCloud, we are committed to working alongside individuals who are equally passionate about preventing cybercrime, regardless of their department or role. Guided by our core values in all business decisions, we prioritize unity in our mission and ensure all SpyCloud employees have the support and benefits they need to stay focused on our goals. In addition to our engaging workspace in South Austin, flexible and remote-friendly work options, and competitive salary package, we offer our employees a comprehensive benefits package that includes:

  • 401(k) with Employer Contribution
  • Health, Vision, and Dental Insurance
    • Health Savings Account (HSA) available with Employer Contribution
  • Employer Paid Life, Short-term, and Long-term Disability Insurance
  • Generous PTO Plan and 16 paid holidays per year

U.K.-Based Benefits + Perks (for Full Time Employees):

  • Retirement Savings Plan with Employer Contribution
  • Employer Provided Private Health Insurance and Healthcare Cashplan
  • Employer Paid Life Insurance, Income Replacement, and Critical Illness Protection
  • Employee Assistance Program
  • 25 days annual accrued holiday plus 8 paid bank holidays and a paid company shutdown during winter holidays

About SpyCloud:

SpyCloud transforms recaptured darknet data to disrupt cybercrime. Its automated identity threat protection solutions use advanced analytics and AI to accelerate investigations and  protect workforce, consumer, and supplier identities from the threats that matter most: authentication bypass, session hijacking, malicious insiders, account takeover, ransomware, and fraud. Its data from malware-infected devices, successful phishes, combolists, and third-party breaches also powers many popular dark web monitoring and identity theft protection offerings. Customers include 7 of the Fortune 10, along with hundreds of global enterprises, mid-sized companies, and government agencies worldwide. Headquartered in Austin, TX, SpyCloud is home to more than 250 cybersecurity experts whose mission is to protect businesses and consumers from the stolen identity data criminals are using to target them now.

To learn more and see insights on your company's exposed data, visit spycloud.com.

Our Mission:

Our mission is to make the internet a safer place by disrupting the criminal underground. Together with our customers and partners, we aim to end criminals’ ability to profit from stolen information.

Who We Are:

SpyCloud is a place for innovative, collaborative, and problem-solvers to thrive. Individually, we’re amazing, but together, we’re unstoppable. We celebrate diversity and various perspectives and aim to create an inclusive and supportive environment for all. We are proud to be an Equal Employment Opportunity and Affirmative Action employer of choice. All aspects of employment decisions will be based on merit, performance, and business needs. We do not discriminate on the basis of any status protected under federal, state, or local law. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. Women, minorities, individuals with disabilities, and protected veterans are encouraged to apply. SpyCloud complies with applicable state and local laws governing nondiscrimination in employment. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.

SpyCloud expressly prohibits any form of workplace harassment. Improper interference with the ability of SpyCloud's employees to perform their job duties may result in discipline up to and including discharge. SpyCloud shares the right to work and participates in the E-Verify program in all locations.

If you need assistance or accommodation due to a disability, you may contact us.

Our Culture:

Our culture is something really special. We’re all driven to disrupt the cybercriminal economy as we keep customer accounts safe from compromise. We support a truly worthy and serious mission, but we have fun doing it together. If you are driven, inventive, and collaborative, you’ll fit right in.

SpyCloud’s Recruitment Policy:

We will never ask an applicant for sensitive or personal financial information during the recruitment process. We advise all applicants seeking employment with SpyCloud to review available information on recruitment fraud. Anyone who suspects that they have been contacted by someone falsely representing SpyCloud should email careers@spycloud.com.

Compensation Transparency Policy: 

At SpyCloud, we believe in transparency and fairness in compensation. We strive to ensure that all employees are fairly compensated for their contributions, and we openly discuss our compensation philosophy and structure. We are committed to providing competitive salaries and benefits packages to attract and retain top talent, and we encourage open dialogue and feedback regarding compensation matters.

Learn more and apply: SpyCloud Careers

SpyCloud is not sponsoring visas at this time.

For applicants residing in California, please click here to read SpyCloud's CCPA Notice.

For applicants residing in the UK, please click here to read SpyCloud's Employee Privacy Notice.

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related STEM field. Base Salary Range: $104,000 – $135,000 The salary range reflects the expected base compensation for a fully qualified candidate at this level based on experience, qualifications, and market data at the time of posting.
Location & working pattern

Austin, Texas

U.S.-Based Benefits + Perks (for Full Time Employees): At SpyCloud, we are committed to working alongside individuals who are equally passionate about preventing cybercrime, regardless of their department or role. Guided by our core values in all business decisions, we prioritize unity in our mission and ensure all SpyCloud employees have the support and benefits they need to stay focused on our goals. In addition to our engaging workspace in South Austin, flexible and remote-friendly work options, and competitive salary package, we offer our employees a comprehensive benefits package that includes: - 401(k) with Employer Contribution
Work authorization

This passage needs a closer read in the full description.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.