BI Data Engineer
Ranjeet ThakurUnited StatesSENIORPosted 6d ago
Data ModellingDatabricksData ArchitectureReal-time AnalyticsData PipelinesAzure Data FactoryApache SparkScalaPythonDelta LakeAdaptive Query ExecutionDynamic Data MaskingAzure SQL DBPower BI
About the Role
We are seeking a skilled BI Data Engineer to join our team for a 12-month contract. This role focuses on designing and implementing data architecture solutions for data-centric projects.
Key Responsibilities
• Design and implement data architecture solutions for data-centric projects
• Lead the development of enterprise data strategies, standards, processes, and tools
• Create real-time analytics models using Data Bricks for actionable insights
• Manage and schedule data pipelines in Azure Data Factory for seamless data ingestion
• Optimize data processing and perform transformations using Apache Spark, Scala, and Python
• Implement Delta Lake and Adaptive Query Execution frameworks for efficient data handling
• Ensure data security by implementing dynamic data masking in Azure SQL DB
• Generate insightful reports using Power BI for data visualization
• Maintain pipeline schedules, triggers, and logs for effective data management
• Collaborate with cross-functional teams to integrate data communication across platforms
Requirements
• 12+ years’ experience in data engineering and data modelling
• Strong skills in Data Bricks and data architecture
• Experience with real-time analytics and data pipelines
• Proficiency in Azure Data Factory, Apache Spark, Scala, and Python
• Knowledge of Delta Lake, Adaptive Query Execution, and dynamic data masking
• Experience with Power BI for data visualization
• Ability to work in a hybrid environment