> job detail
C
๐ฝOther
Associate Data Engineer
Cosm ยท Los Angeles, CA, USA
// classified as
Other (Adjacent or hard to classify.)
posted
2d ago
location
Los Angeles, CA, USA
languages
python, sql
tools
aws, databricks, spark
> stack
pythonsqlawsdatabricksspark
> description
Summary:
We are looking for an Associate Data Engineer to join our team at Cosm. The successful candidate will be responsible for building and managing data pipelines that power business operations for Cosm Venues. The candidate will use our data platform, built on Databricks and AWS, to implement incremental data flows and efficiently join and transform both internal and external data sources. The ideal candidate will have experience using industry-standard tools and a strong drive to learn new techniques. We expect all our engineers and managers to be versatile, display leadership qualities, and be enthusiastic when taking on new problems as we launch our venues and push technology to new heights.
Responsibilities:
Build and manage incremental, near real-time data pipelines
Work with data users, analysts, and other consumers to deliver accurate, timely datasets
Work on end to end integration with internal and external data sources and consumers
Ensure the data team is following best practices while building our data catalog, including code maintainability, data quality, and documentation
Learn and apply state of the art techniques for managing complex workflows, like incremental data flow
Foster a data driven culture by bringing your unique perspective to a dynamic work environment
Experience:
Bachelor's in Computer Science, Information Technology, or a related field, or relevant work experience.
0-2 years developing data systems
Experience with critical systems that have significant impact on business operations
Expertise in Apache Spark, specifically the DataFrame API. We use both the Python and SQL interfaces
Knowledge of incremental data flow or Medallion Architecture
Exposure to Databricks Platform, including its integration with AWS infrastructure
Past work with a Product Analytics tool (i.e., PostHog, Mixpanel, etc.) is a plus
Demonstrated drive to learn new concepts
The annualized base salary range for this position in California is $75,000- $90,000. The base salary offered will factor in internal equity and may also vary depending on the candidate's geographic region, job-related knowledge, skills, and relevant experience, among other factors.