Senior Data Engineer
Manoj PRemoteSENIORPosted 46m ago
Databricks LakehouseAWS GluePostgreSQLPySparkSpark SQLDelta LakeDelta Live TablesUnity CatalogETLELT Pipeline DevelopmentDatabricks WorkflowsSQL WarehousesAWS S3IAMTerraformInfrastructure as CodeCI/CD AutomationData GovernanceRBACABAC
About the Role
We are looking for an experienced Senior Data Engineer to join our team for a long-term contract opportunity. This role focuses on modernizing data pipelines and implementing enterprise data governance standards.
Key Responsibilities
• Lead end-to-end migration from AWS Glue and PostgreSQL Aurora to Databricks Lakehouse
• Modernize data pipelines and implement enterprise data governance standards
• Build scalable ETL/ELT solutions and automate infrastructure deployments
Requirements
• 10–15 years of experience in data engineering
• Strong experience with Databricks Lakehouse, AWS Glue, and PostgreSQL (Aurora)
• Proficiency in PySpark, Spark SQL, Delta Lake, and Delta Live Tables
• Experience with Unity Catalog, ETL/ELT Pipeline Development, and Databricks Workflows
• Knowledge of AWS S3, IAM, Glue, Terraform, and Infrastructure as Code
• Experience with CI/CD Automation, Data Governance, RBAC, and ABAC