AWS Data Engineer
Bhupendra BilloreUnited StatesSENIORPosted 13h ago
Data EngineeringAmazon RedshiftDatabricksPythonApache AirflowdbtFivetranAirbyteAWS DMSKafkaKinesisApache IcebergDelta LakeHudiApache SparkPySparkSpark SQLSQLGreat ExpectationsMonte CarloElementaryS3GlueLambdaIAMEMRTerraformDockerGitHub Actions
About the Role
We are looking for an experienced AWS Data Engineer to join our team in Beverly Hills, CA. This role requires extensive experience in data engineering and AWS services.
Key Responsibilities
• Develop and maintain data pipelines using AWS services
• Implement data models and ensure data quality
• Optimize database performance and query efficiency
• Monitor and improve data pipeline reliability
Requirements
• Strong Data Engineering experience
• Experience with Amazon Redshift, Databricks, and Python
• Proficiency in Apache Airflow for DAG development and operations
• Knowledge of dbt for data modeling, testing, and CI/CD
• Familiarity with Fivetran, Airbyte, AWS DMS, Kafka, and Kinesis
• Experience with Apache Iceberg, Delta Lake, and Hudi
• Advanced SQL and query optimization skills
• Experience with data quality and observability tools
Nice to Have
• Experience with AWS Services: S3, Glue, Lambda, IAM, EMR
• Experience with streaming and near real-time data pipelines
• Knowledge of Terraform, Docker, GitHub Actions, and CI/CD