Cloud Data Engineer
Tejasvi ParuchuriCanadaMIDPosted 13d ago
PythonSQL ServerETL pipelinesDatabricksPysparkCloud data warehouseSynapseBig QueryRedshiftSnowflakeData warehousingOLTPOLAPData modelingCloud data architecturesMessagingAnalyticsAirflow
About the Role
We are seeking a Cloud Data Engineer to join our team. This role involves developing and deploying ETL pipelines using Databricks and Pyspark, with experience in cloud data warehouses and data warehousing.
Key Responsibilities
• Develop and deploy ETL pipelines using Databricks and Pyspark
• Work with cloud data warehouses like Synapse, Big Query, Redshift, and Snowflake
• Implement data warehousing solutions including OLTP, OLAP, Dimensions, Facts, and Data modeling
• Lead enterprise-wide Cloud Data Platform migrations with strong architectural and design skills
• Utilize Cloud based data architectures, messaging, and analytics
Requirements
• 5+ years of Python coding experience
• 5+ years of SQL Server based development of large datasets
• 5+ years of experience with developing and deploying ETL pipelines using Databricks
• Experience with Pyspark
• Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake
• Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling
• Previous experience leading an enterprise-wide Cloud Data Platform migration
• Strong architectural and design skills
• Cloud certification(s)
• Experience with Airflow is a Plus