Data Engineer
Srikanth YadavRemoteSENIORPosted 1h ago
Azure DatabricksPySparkApache SparkPythonScalaSQLKafkaAzure Data Lake StorageAzure SQL DatabaseETLData ModelingData Warehousing
About the Role
We are looking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, and modern data engineering technologies.
Key Responsibilities
• Design and implement scalable data processing solutions
• Develop and optimize data pipelines using Azure Databricks
• Collaborate with cross-functional teams and business stakeholders
• Perform code reviews and maintain coding standards
• Lead technical delivery and manage project priorities
• Identify and resolve technical challenges
Requirements
• Strong hands-on experience with Azure Databricks
• Expertise in Apache Spark and PySpark
• Experience developing and managing scalable data pipelines
• Strong programming skills in Python, Scala, SQL, and Kafka
• Hands-on experience with Azure Data Lake Storage (ADLS)
• Experience with Azure SQL Database
• Strong knowledge of ETL processes, data modeling, and data warehousing
• Experience with cloud-based data storage solutions
• Ability to lead technical teams and drive project delivery