Location: Hybrid / Client Office

Senior Data Engineer – Cloud and ML Pipelines

Senior Data Engineer – Cloud and ML Pipelines

Job Type: Remote

Job Description

A leading organization is seeking a Senior Data Engineer to build, operate, and improve cloud-based data and machine learning pipelines that support healthcare analytics and care management initiatives. This position requires a self-directed engineer who can own outcomes, design reliable data workflows, and collaborate across technical and business teams.

The ideal candidate has strong SQL and Python skills, experience delivering production-grade analytical or machine learning pipelines, and the ability to think across systems, architecture, quality, reliability, and business impact.

Responsibilities

  • Design, build, and maintain scalable data pipelines using SQL and Python.
  • Develop cloud-based data workflows that support analytics, machine learning, and operational use cases.
  • Own pipeline reliability from development through production operation, including monitoring, testing, and issue resolution.
  • Identify potential failure points in data workflows and implement safeguards, alerts, and validation checks.
  • Support production-quality engineering practices, including QA, regression testing, data validation, and stability testing.
  • Contribute to CI/CD, orchestration, deployment, and operational processes for analytical and machine learning pipelines.
  • Collaborate with data scientists, data engineers, IT teams, and business stakeholders to deliver solutions aligned with business objectives.
  • Participate in architectural discussions involving end-to-end data flows, dependencies, system trade-offs, and operational design.
  • Troubleshoot data, workflow, and platform issues independently while communicating blockers, risks, and escalation needs clearly.
  • Support continuous improvement of data reliability, cost efficiency, maintainability, and operational performance.

Required Experience and Skills

  • Strong SQL experience, including query development, data manipulation, analytical processing, and data validation.
  • Strong Python experience for pipeline development, automation, and data processing.
  • Experience designing and operating data solutions in cloud environments, with Google Cloud Platform experience preferred.
  • Ability to consider cloud cost as part of technical design and implementation decisions.
  • Experience building or supporting production machine learning, analytical, or data pipelines.
  • Understanding of MLOps concepts, including CI/CD, orchestration, deployment, and production pipeline operations.
  • Experience with workflow orchestration or automation tools such as Airflow, Prefect, Dagster, Argo, Kubeflow, Composer, or GitHub Actions.
  • Ability to reason across systems, including dependencies, component interactions, data flow, and architecture trade-offs.
  • Strong production engineering discipline, including QA ownership, regression testing, data correctness validation, and operational reliability.
  • Proven ability to work independently, take ownership of outcomes, and drive work forward without constant direction.
  • Strong communication skills with the ability to collaborate across engineering, data science, IT, and business teams.
  • Ability to balance independent problem-solving with timely communication, escalation, and stakeholder alignment.
  • Dependable delivery mindset with high standards for production quality, reliability, and follow-through.

This job is no longer accepting applications.

Related Job Openings

Data Engineer/ Architect
Remote
Data Engineer/ Architect
Remote