Senior Data Engineer

Redlen’s Data Science team is responsible for unlocking insights from the gigabit-per-second image data generated by our photon-counting CT (PCCT) detectors. This team plays a pivotal role in understanding, characterizing, and reporting on detector performance and failure modes across reliability experiments, production testing, and in-gantry operations. By leveraging advanced data engineering, machine learning, and software development principles, the team transforms raw detector data into actionable intelligence that drives design optimization, reliability improvements, and image quality enhancements. Through close collaboration with cross-functional partners, the Data Science team ensures that Redlen’s detectors deliver world-class imaging outcomes and meet the rigorous demands of clinical and industrial applications. About the RoleThe Senior Data Engineer will design, build, and maintain scalable data pipelines and automation frameworks that enable the Data Science team to process and analyze detector data efficiently. This role is critical to modernizing workflows and supporting Redlen’s ambitious production scale-up, which targets a 20x increase in output. Working within a virtual Linux environment and leveraging containerized orchestration tools such as Apache Airflow, the Senior Data Engineer will automate scientific processes, streamline data ingestion from network drives, and ensure robust, reproducible workflows. By enabling high-throughput data processing and integration, this role empowers the team to deliver timely insights that improve detector reliability and optimize image quality.Key ResponsibilitiesData Pipeline Development & Automation Design and implement ETL pipelines to process PCCT detector data and metadata from network drives. Develop reusable Python-based automation frameworks for data ingestion, transformation, and integration. Automate JMP workflows using JSL (JMP Scripting Language) and integrate them with Python. Automate MATLAB scripts and incorporate them into centralized pipelines. Refine and scale existing automation tools to handle a 20x increase in production volume. Workflow Orchestration & Infrastructure

QualificationsRequired Skills Strong proficiency in Python for data engineering and automation. Expertise in Apache Airflow for workflow orchestration. Containerization experience (Docker) as a prerequisite for Airflow deployment. Fluency in JSL (JMP Scripting Language) and Python integration within JMP. Experience with MATLAB scripting for scientific workflows. Solid understanding of ETL design, data validation, and data quality frameworks. Knowledge of efficient file formats (e.g., Parquet) for performance optimization. Familiarity with Linux environments, version control (Git), and CI/CD pipelines. Strong problem-solving skills. Excellent oral and written communication skills in English. Outstanding interpersonal skills. Required Experience

Redlen’s Data Science team is responsible for unlocking insights from the gigabit-per-second image data generated by our photon-counting CT (PCCT) detectors. This team plays a pivotal role in understanding, characterizing, and reporting on detector performance and failure modes across reliability experiments, production testing, and in-gantry operations. By leveraging advanced data engineering, machine learning, and software development principles, the team transforms raw detector data into actionable intelligence that drives design optimization, reliability improvements, and image quality enhancements. Through close collaboration with cross-functional partners, the Data Science team ensures that Redlen’s detectors deliver world-class imaging outcomes and meet the rigorous demands of clinical and industrial applications. About the RoleThe Senior Data Engineer will design, build, and maintain scalable data pipelines and automation frameworks that enable the Data Science team to process and analyze detector data efficiently. This role is critical to modernizing workflows and supporting Redlen’s ambitious production scale-up, which targets a 20x increase in output. Working within a virtual Linux environment and leveraging containerized orchestration tools such as Apache Airflow, the Senior Data Engineer will automate scientific processes, streamline data ingestion from network drives, and ensure robust, reproducible workflows. By enabling high-throughput data processing and integration, this role empowers the team to deliver timely insights that improve detector reliability and optimize image quality.Key ResponsibilitiesData Pipeline Development & Automation Design and implement ETL pipelines to process PCCT detector data and metadata from network drives. Develop reusable Python-based automation frameworks for data ingestion, transformation, and integration. Automate JMP workflows using JSL (JMP Scripting Language) and integrate them with Python. Automate MATLAB scripts and incorporate them into centralized pipelines. Refine and scale existing automation tools to handle a 20x increase in production volume.

Workflow Orchestration & Infrastructure Build and maintain orchestration workflows using Apache Airflow on a virtual Linux server in a containerized environment. Maintain version control and CI/CD practices for all developed tools and pipelines. Data Quality, Storage & Performance