AWS Data Engineer
Nitish SethiUnited StatesSENIORPosted 13h ago
AWSDatabricksDBTSQLPySparkDelta LakeDelta Live TablesETLELTSQL ServerStonebranchCI/CDGitAgileJIRATableauLinuxAWS MWAAApache AirflowKafkaKinesisMedallion Architecture
About the Role
We are seeking an experienced AWS Data Engineer to join our team. This role involves designing, building, and optimizing scalable ETL/ELT pipelines and developing data models using DBT.
Key Responsibilities
• Design, build, and optimize scalable ETL/ELT pipelines
• Develop data models using DBT and implement data quality checks
• Optimize Spark jobs and Delta Lake performance
• Manage workflow orchestration, CI/CD, and production deployments
• Ensure data governance, reliability, and performance
Requirements
• Strong proficiency in SQL and DBT Core / DBT Cloud
• Hands-on experience with AWS services, especially AWS Redshift, S3, Glue, and Lambda
• Strong experience with Databricks on AWS, Spark, PySpark, Delta Lake, and Delta Live Tables (DLT)
• Experience designing and developing ETL/ELT data pipelines
• Strong knowledge of SQL Server databases and data modeling
• Experience with Stonebranch scheduling tool
• Understanding of CI/CD pipelines, Git, and version control
• Experience working in Agile environments and using JIRA