IT Cloud Data Engineer
Ritik SinghalCanadaSENIORPosted 14d ago
PythonSQL ServerDatabricksPySparkETLDelta LakeAzure SynapseBigQueryRedshiftSnowflakeApache Airflow
About the Role
We are looking for an experienced Cloud Data Engineer with strong hands-on expertise in Python, SQL Server, Databricks, PySpark, and cloud data platforms. The ideal candidate will have experience building scalable ETL pipelines, optimizing big data workloads, designing enterprise data warehouses, and supporting cloud data platform migrations.
Key Responsibilities
• Design, develop, and optimize scalable ETL/ELT data pipelines.
• Build and deploy Spark applications using Databricks and PySpark.
• Work with Delta Lake, data integration, and cloud data platforms.
• Develop Python programs, complex SQL queries, and stored procedures.
• Design dimensional data models, including facts, dimensions, OLTP, and OLAP.
• Process structured, semi-structured, and unstructured data.
• Implement event-driven and streaming data ingestion solutions.
• Optimize Databricks jobs for performance, scalability, and reliability.
• Ensure data quality, security, governance, and integrity.
• Lead or support enterprise-wide cloud data platform migrations.
• Conduct code reviews and troubleshoot data processing issues.
Requirements
• 5+ years of Python development experience.
• 5+ years of SQL Server development involving large datasets.
• 5+ years of experience developing and deploying ETL pipelines using Databricks and PySpark.
• Strong knowledge of Delta Lake, data warehousing, and data modeling.
• Experience with cloud data warehouses such as Azure Synapse, BigQuery, Redshift, or Snowflake.
• Understanding of OLTP, OLAP, facts, dimensions, and enterprise data warehouse architecture.
• Experience with cloud data architectures, messaging, and analytics.
• Bachelor’s degree in Engineering, Computer Science, or a related discipline required.