Data Engineer
samu sheeba baskaranAustraliaMIDPosted 4d ago
Azure Data Lake Gen2SynapsePySparkSpark SQLDatabricksComplex SQLDevOpsGitHub ActionsData EngineeringData GovernanceMetadata ManagementAdvanced Python Engineering PracticesAnalyticsBI AwarenessCloud Cost OptimizationFinOps
About the Role
We are hiring for a Data Engineer to join our team in Sydney. This role involves working with cloud-based data solutions and engineering practices.
Key Responsibilities
• Work with Azure Data Lake Gen2 and Synapse
• Develop solutions using PySpark, Spark SQL, and Databricks
• Implement complex SQL queries and optimize performance
• Utilize DevOps practices with GitHub Actions
• Apply data engineering principles to manage and process data
Requirements
• 6-10+ years of work experience
• Strong skills in Azure Data Lake Gen2, Synapse, PySpark, Spark SQL, and Databricks
• Proficiency in complex SQL including window functions, CTEs, and execution plans
• Experience with DevOps and GitHub Actions
• Knowledge of data engineering principles