AWS + Databricks Engineer
Dheeraj GuptaRemoteSENIORPosted 13d ago
AWSDatabricksApache SparkPySparkPythonSQLETLELTData LakeData Pipeline
About the Role
We are looking for an experienced AWS + Databricks Engineer to join our team. This role focuses on designing, developing, and maintaining scalable data pipelines using AWS cloud services and Databricks.
Key Responsibilities
• Design, develop, and maintain scalable data pipelines using AWS and Databricks
• Build and optimize data processing workflows using PySpark and SQL
• Implement efficient ETL/ELT processes for large-scale data integration
• Work with cross-functional teams to deliver reliable data solutions
• Ensure data quality, performance, scalability, and security
Requirements
• 7+ years of experience with AWS cloud services
• Expertise in Databricks and Apache Spark
• Proficiency in PySpark, Python, and SQL
• Experience in designing and developing scalable data pipelines
• Knowledge of data lake architecture, ETL/ELT processes, and data transformation
• Experience with AWS data services and cloud-based data engineering solutions
• Ability to optimize data processing workflows and performance