Data Engineer
Prachi GaurUnited StatesSENIORPosted 44m ago
PythonSQLPySparkScalaUnixAirflowSnap LogicDBTKafkaAWS Event BridgeSNS/SQSKinesisAWSEC2EMRS3AthenaGlueDatabricksSnowflakeDelta LakeRedshiftBigQueryGitJenkinsGitHub ActionsDockerAPIsAgileScrum
About the Role
We are looking for a Data Engineer to join our team. This role focuses on building and maintaining data infrastructure and pipelines.
Key Responsibilities
• Develop and maintain data pipelines using Python, PySpark, or Scala
• Implement data orchestration using tools like Airflow, Snap Logic, or DBT
• Manage event bus and streaming systems with Kafka, AWS Event Bridge, or similar technologies
• Utilize AWS cloud services including EC2, EMR, S3, Athena, and Glue
• Work with data lake and warehouse technologies such as Snowflake, Delta Lake, Redshift, and BigQuery
• Implement CI/CD tooling using Git, Jenkins, GitHub Actions, and Docker
• Integrate systems using APIs for data exchange
• Participate in Agile/Scrum development processes
Requirements
• Strong Python, Advanced SQL, PySpark or Scala, Unix scripting
• Experience with data orchestration tools: Airflow, Snap Logic, DBT, or equivalent
• Experience with event bus & streaming: Kafka, AWS Event Bridge, SNS/SQS, Kinesis, or similar
• AWS cloud experience: EC2, EMR, S3, Athena, Glue; Databricks
• Data lake & warehouse experience: Snowflake, Delta Lake, Redshift, BigQuery
• CI/CD tooling experience: Git, Jenkins / GitHub Actions, Docker
• Experience with APIs for data exchange and integration
• Agile/Scrum development experience