Azure Data Engineer
Premanshu Shekhar RaiUnited StatesSENIORPosted 1h ago
Azure Data EngineeringPythonSparkSQLAzure Data Factory (ADF)ADLSAzure DatabricksAzure FunctionsEvent HubsStream AnalyticsAzure Data Explorer (ADX)SnowflakeMongoDBCassandraPower BI/TableauInformatica/DataStageData ingestionData transformationData migrationData modelingCI/CDGitHubJenkinsAzure DevOpsTerraform
About the Role
We are looking for an experienced Azure Data Engineer to design and develop scalable batch and real-time data pipelines.
Key Responsibilities
• Design and develop scalable batch and real-time data pipelines
• Utilize Azure Data Engineering, Python, Spark, and SQL
• Work with Azure Data Factory (ADF), ADLS, Azure Databricks, and Azure Functions
• Implement Event Hubs, Stream Analytics, and Azure Data Explorer (ADX)
• Manage data ingestion, transformation, migration, and data modeling
• Utilize CI/CD, GitHub, Jenkins, Azure DevOps, and Terraform
Requirements
• Strong expertise in Azure Data Engineering, Python, Spark, and SQL
• Experience with Snowflake, MongoDB, and Cassandra
• Proficiency with Power BI/Tableau, Informatica/DataStage
• 10+ years of experience in the field
Preferred
• Azure Development or Spark certification