Azure Data Engineer
BEEDAM CHETHAN KUMARUnited StatesSENIORPosted 25m ago
Microsoft AzureAzure Data FactoryAzure DatabricksPySparkApache SparkPythonSQLAzure Data Lake Storage Gen2Azure Synapse AnalyticsMicrosoft FabricData LakesData WarehousesLakehouse ArchitecturesAzure Key VaultAzure MonitorManaged IdentitiesCI/CD PipelinesGitInfrastructure Automation
About the Role
We are looking for an Azure Data Engineer to join our direct client's team. This role involves working with Microsoft Azure data services to build and maintain data solutions.
Key Responsibilities
• Design and implement ETL/ELT pipelines using Azure Data Factory
• Work with Azure Databricks, PySpark, and Apache Spark for data processing
• Develop solutions using Python and advanced SQL
• Manage data storage in Azure Data Lake Storage Gen2
• Design data lakes, data warehouses, and lakehouse architectures
• Utilize Azure Key Vault, Azure Monitor, and managed identities for security
• Implement CI/CD pipelines and infrastructure automation
Requirements
• Strong hands-on experience with Microsoft Azure data services
• Expertise in Azure Data Factory for building ETL/ELT pipelines
• Experience with Azure Databricks, PySpark, and Apache Spark
• Strong proficiency in Python and advanced SQL
• Hands-on experience with Azure Data Lake Storage Gen2
• Knowledge of Azure Synapse Analytics and Microsoft Fabric
• Experience designing data lakes, data warehouses, and lakehouse architectures
• Familiarity with Azure Key Vault, Azure Monitor, and managed identities
• Experience with CI/CD pipelines, Git, and infrastructure automation