Data Engineer w/DevOps
Maria Gabriela A.ColombiaMIDPosted 1h ago
PythonSQLPySparkDatabricksDeltaLakeJenkinsGitHub ActionsAzure DevOpsTerraformAWSAzureGoogle Cloud PlatformETLELTJira
About the Role
We are looking for a Data Engineer w/DevOps to join a growing team and build scalable, production-ready services and APIs.
Key Responsibilities
• Design, build and operate production data pipelines using Python, SQL and PySpark on Databricks
• Own services end to end and support less experienced engineers
• Implement CI/CD processes with tools such as Jenkins, GitHub Actions or Azure DevOps
• Manage infrastructure as code using Terraform
Requirements
• Proven experience designing, building and operating production data pipelines
• Production experience with Databricks and DeltaLake, including jobs, workflows and notebooks
• Hands-on CI/CD experience with tools such as Jenkins, GitHub Actions or Azure DevOps
• Strong Git practices
• Experience with infrastructure as code, specifically Terraform
• Experience on at least one major cloud platform (AWS, Azure or Google Cloud Platform)
• Solid understanding of data modeling, data warehousing and ETL/ELT patterns
• Experience working in Scrum teams and tracking work in Jira