Jobs → Data & Analytics → Advanced Data Engineer

About the Role We are seeking an Advanced Data Engineer to join our team in Canada. This role involves working with various data technologies and platforms to develop and maintain data pipelines. Key Responsibilities • Develop and maintain data pipelines using Python, PySpark, and PyTest • Work with Azure Databricks and Delta Live Tables • Implement solutions using Spark SQL, DataFrames, and real-time data streaming • Manage data storage and processing with Azure Data Lake, ADF, Event Hub, and Kafka • Ensure data quality and performance through SQL and data pipeline development • Utilize GitHub, CI/CD, Jira, and Agile methodologies for project management Requirements • 5–8 years of experience in data engineering • Strong Python, PyTest, and PySpark skills • Hands-on experience with Azure Databricks and Delta Live Tables • Knowledge of Spark SQL, DataFrames, and real-time data streaming • Experience with Azure Data Lake, ADF, Event Hub, and Kafka • Strong SQL and data pipeline development skills • Familiarity with GitHub, CI/CD, Jira, and Agile methodologies