Lead Data Engineer
Harshad M.United StatesSENIORPosted 31m ago
DatabricksSparkApacheSparkPySparkScalaPythonSQLETLELTDataPipelineDataWarehousingDataWarehouseDataLakeLakehouseDeltaLakeUnityCatalogDataModelingDimensionalModelingDataGovernanceDataQualityDataIntegrationDataMigrationAzureDatabricksAWSDatabricksGCPAzureAWSGoogleCloudADFAzureDataFactorySynapseSnowflakeRedshiftBigQueryKafkaAirflowApacheAirflowDBTDataBuildToolPowerBITableauLookerSSISSSRSInformaticaTalendAlteryxDataEngineeringBigDataHadoopHiveDataArchitectureEnterpriseDataCloudDataDataPlatformDataStrategyMedallionArchitectureBronzeSilverGoldStreamingRealTimeDataBatchProcessingCICDDevOpsGitGitHubJIRAAgileScrumDataOpsMLOpsMachineLearningAIGenAI
About the Role
We are looking for a Lead Data Engineer Architect with strong hands-on experience in Databricks. This role involves designing and building scalable data architectures, data pipelines, and leading data engineering teams in enterprise environments.
Key Responsibilities
• Design and implement scalable data architectures
• Build and maintain data pipelines, ETL/ELT processes
• Develop and manage data lakes, lakehouse, and data warehousing solutions
• Perform data modeling and ensure data quality
• Lead data engineering teams in enterprise environments
Requirements
• 8+ years of experience in data engineering
• Strong hands-on experience with Databricks
• Experience in designing and building scalable data architectures
• Proficiency in data pipelines, ETL/ELT, data lakes, lakehouse, and data warehousing
• Knowledge of data modeling and dimensional modeling
• Experience with cloud platforms (Azure, AWS, GCP)
• Familiarity with big data technologies (Hadoop, Hive, Kafka)
• Experience with data governance and data quality
• Strong problem-solving and leadership skills