AWS Databricks Engineer
Ruma KumariUnited StatesSENIORPosted 27m ago
DatabricksAWS CloudPythonPySparkApache SparkSpark SQLAWS S3AWS IAMAWS GlueAWS LambdaAWS RedshiftDelta LakeLakehouse ArchitectureETLELTSQLData ModelingGitCI/CD
About the Role
We are looking for an AWS Databricks Engineer with banking experience to join our team. This role focuses on developing and maintaining data solutions using Databricks and AWS Cloud services.
Key Responsibilities
• Design and implement data solutions using Databricks and AWS Cloud services
• Develop ETL/ELT pipelines and data models
• Utilize Python, PySpark, and Spark SQL for data processing
• Manage AWS services including S3, IAM, Glue, Lambda, and Redshift
• Implement Delta Lake and Lakehouse Architecture
• Ensure data quality and performance
Requirements
• Strong hands-on experience with Databricks and AWS Cloud
• Excellent programming skills in Python and PySpark
• Expertise in Apache Spark and Spark SQL
• Hands-on experience with AWS services: S3, IAM, Glue, Lambda, and Redshift
• Knowledge of Delta Lake and Lakehouse Architecture
• Experience in ETL/ELT pipeline development, SQL, and data modeling
• Familiarity with Git, CI/CD, and deployment processes
• Prior Banking domain experience is required