Data Lake Tech Lead
Sajida BegumRemoteLEADPosted 2h ago
Apache KafkaDatabricks platformDataHubCollibraAlationApache AtlasRDBMSModern Data lakeKubernetesData Streaming & ProcessingData Governance & CatalogingRelational Database SystemsSQL ServerPostgreSQLMySQLCloud & InfrastructureAzureAWSTerraform
About the Role
We are seeking a Data Lake Tech Lead for a 12-month contract position. This role requires extensive technical expertise in data streaming, processing, and governance, with a focus on modern data lake architecture and cloud platforms.
Key Responsibilities
• Lead technical strategy for data lake implementation and optimization
• Design and implement scalable data streaming solutions using Apache Kafka
• Develop and manage data governance frameworks and metadata management systems
• Ensure data quality and compliance across enterprise data systems
• Provide technical guidance on cloud infrastructure and database systems
Requirements
• 12-15 years of technical expertise in data systems
• 5+ years with Apache Kafka (streaming architecture, Kafka Connect, Schema Registry)
• 3+ years with Databricks (Delta Lake, Apache Spark optimization)
• Deep understanding of data lake architecture patterns (Bronze/Silver/Gold, medallion architecture)
• 3+ years with DataHub or similar metadata management platforms
• 5+ years with enterprise RDBMS platforms (SQL Server, PostgreSQL, MySQL)
• 5+ years with Azure or AWS Cloud services
• 3+ years with Kubernetes and Terraform
Benefits
• Opportunity to work on complex data infrastructure projects
• Collaborative technical environment
• Flexible remote work arrangement