Jobs → Data & Analytics → Python, AWS and Databricks Engineer

About the Role We are seeking an experienced Python, AWS, and Databricks Engineer to design, develop, and maintain scalable data engineering solutions. The ideal candidate will have strong Python programming skills, hands-on experience with AWS cloud services, and expertise in Databricks for data processing, transformation, and analytics. Key Responsibilities • Develop, test, and maintain Python applications and data processing pipelines • Build and optimize scalable data engineering solutions using Databricks and Apache Spark • Design, implement, and maintain data pipelines on AWS • Work with AWS services such as S3, Glue, Lambda, IAM, and CloudWatch • Develop ETL/ELT workflows for data ingestion, transformation, and integration • Use PySpark and SQL for large-scale data processing and performance optimization • Implement data quality checks, validation, monitoring, and error handling • Collaborate with data engineers, architects, analysts, and business stakeholders • Troubleshoot pipeline failures and optimize performance, reliability, and cost • Follow best practices for data security, governance, version control, and deployment Requirements • Strong hands-on experience with Python programming • Experience with AWS cloud services and data engineering solutions • Proficiency in Databricks, Apache Spark, and PySpark • Strong SQL skills and experience with data transformation • Experience building and maintaining ETL/ELT data pipelines • Knowledge of data lake architecture and cloud-based data platforms • Experience with Git, CI/CD, and production support