Data Engineer
Teja ARemoteMIDPosted 45m ago
AzureDatabricksPySparkPythonSQLSparkDelta LakeUnity CatalogETLELTLakehouse architectureData governanceCI/CDGitLakeflow ConnectSpark Declarative Pipelines
About the Role
We are looking for a Data Engineer to join our team for a 6-month contract with possible extension. This role requires strong experience in data engineering and hands-on skills with Azure and Databricks.
Key Responsibilities
• Develop and maintain ETL/ELT pipelines
• Implement lakehouse architecture and data modeling
• Ensure data governance, quality, and security
• Work with CI/CD and Git for version control
• Utilize Lakeflow Connect and Spark Declarative Pipelines
Requirements
• Strong Data Engineering experience
• Expertise in Python, PySpark, SQL, and Apache Spark
• Experience with Delta Lake and Unity Catalog
• Knowledge of Azure and Databricks
• Experience with ETL/ELT pipeline development
• Understanding of Lakehouse architecture and data modeling
• Familiarity with data governance, quality, and security
• Experience with CI/CD and Git
• Exposure to Lakeflow Connect and Spark Declarative Pipelines