Data Engineer Lead
Suresh KKDUnited StatesLEADPosted 4h ago
AWSAzureGCPPythonPySparkSQLSparkDatabricksSageMakerAWS GlueDBTKafkaGitHubJenkinsTerraformDockerKubernetesYAMLPower BITableauNoSQLGraph DatabasesParquetRedshift SpectrumData GovernanceData SecurityMachine LearningAI Data PipelinesDataHub
About the Role
We are looking for a Data Engineer Lead to join our team. This role focuses on building and maintaining cloud data lake pipelines and data products using modern architectures.
Key Responsibilities
• Design and implement cloud data lake pipelines using AWS, Azure, or GCP
• Extract, transform, and load data from various sources including relational, semi-structured, and unstructured data
• Develop data products using cloud data lake and lakehouse architectures
• Implement data sharing policies and access controls for data products
• Design star schema-based operational data stores
Requirements
• Bachelor's Degree in Computer Science, Data Science, or Information Systems
• 4+ years of experience building cloud data lake pipelines
• 4+ years of data transformation experience
• 2+ years of experience with data sharing policies and access controls
• Strong hands-on experience with Python, PySpark, SQL, and Spark
• Experience with data modeling, lakehouse, and medallion architecture
• Excellent written and verbal communication skills