Data Engineer Architect
Ranjeet ThakurUnited StatesSENIORPosted 1h ago
Data ModelingDatabricksSnowflakePysparkPower BIData ArchitectureReal-time AnalyticsData PipelinesApache SparkScalaPythonDelta LakeAdaptive Query ExecutionDynamic Data MaskingAzure Data FactoryAzure SQL DB
About the Role
We are seeking a Data Engineer (Architect) with Databricks for a 12-month contract position in Dallas, TX with a hybrid work arrangement. This role requires 12+ years of experience and involves designing and implementing data architecture solutions for data-centric projects.
Key Responsibilities
• Design and implement data architecture solutions for data-centric projects
• Lead the development of enterprise data strategies, standards, processes, and tools
• Create real-time analytics models using Data Bricks for actionable insights
• Manage and schedule data pipelines in Azure Data Factory for seamless data ingestion
• Optimize data processing and perform transformations using Apache Spark, Scala, and Python
• Implement Delta Lake and Adaptive Query Execution frameworks for efficient data handling
• Ensure data security by implementing dynamic data masking in Azure SQL DB
• Generate insightful reports using Power BI for data visualization
• Maintain pipeline schedules, triggers, and logs for effective data management
• Collaborate with cross-functional teams to integrate data communication across platforms for enhanced data insights and decision-making
Requirements
• 12+ years’ experience in data engineering and architecture
• Strong skills in Data Modeling, Databricks, Snowflake, Pyspark, and Power BI
• Experience with real-time analytics and data pipelines
• Proficiency in Apache Spark, Scala, and Python
• Knowledge of Delta Lake, Adaptive Query Execution, and dynamic data masking
• Familiarity with Azure Data Factory and Azure SQL DB