Senior Data Engineer
Gireesh Kumar CRemoteSENIORPosted 1h ago
Databricks LakehouseAWS GluePostgreSQLPySparkSpark SQLDelta LakeDelta Live TablesUnity CatalogETLELT Pipeline DevelopmentDatabricks WorkflowsSQL WarehousesAWS S3IAMTerraformInfrastructure as CodeCI/CD AutomationData GovernanceRBACABAC
About the Role
We are looking for an experienced Senior Data Engineer to join our team for a long-term contract opportunity. This role focuses on modernizing data pipelines and implementing enterprise data governance standards.
Key Responsibilities
• Lead end-to-end migration from AWS Glue and PostgreSQL Aurora to Databricks Lakehouse
• Modernize data pipelines and implement enterprise data governance standards
• Build scalable ETL/ELT solutions and automate infrastructure deployments
Requirements
• 10–15 years of experience in data engineering
• Strong knowledge of Databricks Lakehouse, AWS Glue, and PostgreSQL
• Proficiency in PySpark, Spark SQL, Delta Lake, and Delta Live Tables
• Experience with Unity Catalog, ETL/ELT Pipeline Development, and Databricks Workflows
• Familiarity with AWS S3, IAM, Glue, Terraform, and CI/CD Automation
• Understanding of Data Governance, RBAC, and ABAC