Principal Data Engineer

4w4 weeks ago

Vancouver Coastal Health

Vancouver, CA · Full-time · C$130,000 – C$160,000

About this role

Reporting to the Director of People Analytics, the Principal Data Engineer leads technical teams to architect, build, and deploy cloud solutions for assigned projects. This role is key to ensuring the department’s ability to deliver and promote cloud-based solutions within enterprise environments.

Initially responsible for leading the team in planning a large-scale data migration through the full project lifecycle. Regular duties include designing, developing, and maintaining data pipelines and ETL processes using Databricks, with experience in MS Azure and Databricks.

This role works closely with other VCH technical teams in support of initiatives with a primary focus on cloud solutions. The work is framed within VCH’s commitments to Indigenous Cultural Safety, Anti-Racism, Equity, Diversity and Inclusion, and Planetary Health.

As a key member of the People Analytics team, the Principal Data Engineer will drive cloud transformation and modernize data infrastructure. This position offers the opportunity to shape the organization’s data strategy through large-scale migration and ongoing pipeline development.

Requirements

Master’s degree in computer science, Information Systems Management, or a data-intensive related field plus at least seven years of experience as a data engineer (or equivalent combination).
Demonstrated project leadership experience required.
Proven ability to develop, deploy, and maintain multi-tiered infrastructure, database, and web applications.
Ability to lead Azure and/or Databricks specific Cloud Migrations, Application Modernization, and Cloud Transformation initiatives.
Expert-level understanding of software development, deployment and release processes within a DevOps practice and DevOps toolset.
Deep understanding of coding best practices and modern architectural patterns using SQL and Python.
Demonstrated strength in data modeling, ETL development, and data warehousing architecture.
Demonstrated technical leader with skills in teaching, coaching, and mentoring others.

Responsibilities

Lead and support technical teams to architect, build, and deploy cloud solutions for assigned projects.
Plan and execute a large-scale data migration through the full project lifecycle.
Design, develop, and maintain data pipelines and ETL processes using Databricks.
Work closely with other VCH technical teams to support cloud-based initiatives and promote solutions.
Apply strong design, migration, administration, and support experience in MS Azure and Databricks environments.
Lead Azure and Databricks-specific cloud migrations, application modernization, and cloud transformation initiatives.
Perform analysis of current practices and implement best practices in the CICD landscape.
Build sophisticated and highly automated infrastructure using modern architectural patterns and coding best practices.