Data Engineering & Analytics Lead
samuel JUnited StatesSENIORPosted 11d ago
SQLPySparkDatabricksDelta LakeLakehouse ArchitecturePythonETLELTPower BIAzure Data FactoryMedallion ArchitectureData modelingSchema designPerformance optimizationAILLMADLS Gen2Data qualityGitCI/CDData governanceMetadata management
About the Role
We are looking for a hands-on Data Engineering & Analytics Lead with strong expertise in building scalable data pipelines, data modeling, and BI solutions.
Key Responsibilities
• Build scalable data pipelines
• Develop data models and BI solutions
• Implement and manage data architecture
• Analyze data using AI and LLM technologies
Requirements
• Advanced SQL and PySpark (minimum proficiency: 7/10 in each)
• Experience with Databricks, Delta Lake, and Lakehouse Architecture
• Python and ETL/ELT pipeline development
• Power BI dashboards, data modeling, and analytics
• Azure Data Factory (ADF)
• Medallion Architecture (Bronze, Silver, Gold)
• Data modeling, schema design, and performance optimization
• AI/LLM-assisted data analysis and analytics development
Preferred Skills
• ADLS Gen2, data quality, and validation
• Git, CI/CD, data governance, and metadata management
• Process or operational analytics experience