Data engineer, pharmacy data warehouse

A large, regulated enterprise is hiring a data engineer to support a cloud-based pharmacy data warehouse used for ongoing reporting and analytics. This position focuses on maintaining and improving a mature data product with a broad user base and a large set of curated tables. The work blends hands-on development with investigation and stakeholder support, including data lineage questions, data quality troubleshooting, and enhancements to existing datasets.

Responsibilities

• Maintain and enhance a cloud-based pharmacy data warehouse supporting reporting and analytics use cases
• Build and improve ETL workflows, including automation of previously manual processes
• Integrate, transform, and model data from multiple upstream systems into warehouse-ready structures
• Investigate and resolve data issues by tracing field-level lineage and identifying root causes of discrepancies
• Implement enhancements such as adding new fields, adjusting table structures, and updating transformation logic
• Partner with business and analytics users to support reporting needs, including questions about definitions, refresh cadence, and transformation rules
• Improve and maintain documentation for datasets, changes, and operational processes to support consistent data usage
• Contribute to data reliability by strengthening validation approaches and reducing recurring defects

Required experience and skills

• Strong SQL skills, including complex querying, joins, transformations, and performance tuning
• Strong Python skills for ETL development and automation
• Experience working with cloud-based data platforms, including GCP
• Experience with ETL development and data pipeline automation in a production environment
• Solid understanding of data warehousing concepts, including dimensional modeling, table design, and downstream reporting considerations
• Proven ability to troubleshoot complex data issues, evaluate upstream and downstream impacts, and implement corrective actions
• Strong documentation habits and attention to detail
• Comfort working in an ongoing product environment that combines development, investigation, and stakeholder support
• Healthcare or pharmacy data experience is preferred (claims, benefits, members, drugs, formulary, pharmacies), including familiarity with concepts such as NDC and GPI

FAQ

1. What are the core responsibilities of a Data Engineer in a pharmacy data warehouse environment?
This role focuses on designing, building, and maintaining data pipelines that support pharmacy-related data workflows. It includes integrating data from claims systems, prescription records, and third-party sources into a centralized warehouse. The engineer ensures data reliability, scalability, and accessibility for analytics and reporting.

2. What types of data are typically handled in a pharmacy data warehouse?
Data includes prescription claims, drug utilization records, patient information (de-identified where required), and formulary data. It may also include provider data and transactional pharmacy operations data. Ensuring data accuracy and compliance is critical.

3. What tools and technologies are commonly used in this role?
Common tools include SQL, Python, and ETL/ELT frameworks for data integration. Cloud platforms such as AWS, Azure, or Google Cloud are often used for data storage and processing. Data warehouse technologies like Snowflake, Redshift, or BigQuery are also common.

4. How is data quality ensured in this role?
Data quality is maintained through validation checks, monitoring pipelines, and implementing data governance standards. The engineer ensures consistency, completeness, and accuracy of data. Automated testing and alerts help identify issues early.

5. What role does compliance play in this position?
Compliance is critical due to the sensitive nature of healthcare and pharmacy data. The engineer ensures adherence to data privacy regulations and internal policies. Proper handling of protected health information (PHI) is essential.