Data Engineering & Analytics
R P.RemoteSENIORPosted 11d ago
SQLDatabricksPySparkPythonETLELTData ModelingPower BIAzure Data FactoryData LakeLakehouse ArchitectureMedallion ArchitectureAILLMData QualityADLS Gen2GitCI/CDData GovernanceMetadataData Cataloguing
About the Role
We are seeking an experienced Data Engineering & Analytics professional to support CI/CD and version control practices for data engineering solutions.
Key Responsibilities
• Support CI/CD and version control practices for data engineering solutions
• Develop and maintain ETL/ELT pipelines
• Design data models and schema
• Create data visualizations and dashboards using Power BI
• Implement data lake and lakehouse architectures
• Leverage AI and LLMs for data analysis and insight generation
Requirements
• Advanced SQL skills including performance tuning and data transformation
• Experience with Databricks, Delta Lake, and Lakehouse architecture
• Proficiency in PySpark for data transformations and optimizations
• Strong Python programming skills
• Experience with Azure Data Factory and ADLS Gen2
• Knowledge of Git and CI/CD fundamentals
• Understanding of data governance, metadata, and data cataloguing
Benefits