Data Engineer
Sarah JamesUnited StatesMIDPosted 1h ago
PythonPySparkAWSJenkinsETLSQLGitLinuxAgileAWS: S3, EMR, Lambda, Glue, ECS, EKS, CloudWatch, IAMBig Data: PySpark, Apache SparkCI/CD: Jenkins, GitHubProgramming: Python, SQLDevOps: Docker, Kubernetes, Terraform / CloudFormation
About the Role
We are looking for an experienced Data Engineer for an enterprise-level cloud and data engineering project.
Key Responsibilities
• Build and optimize scalable Python/PySpark data pipelines
• Develop cloud-native solutions using AWS services
• Create and support Jenkins CI/CD pipelines
• Monitor application performance and troubleshoot production issues
• Collaborate with data, platform, product, and DevOps teams
• Follow enterprise security, governance, and Agile practices
Requirements
• 5–10 Years of experience
• Strong hands-on experience with Python
• Experience developing distributed data processing solutions using PySpark
• Hands-on experience with AWS Cloud Services
• Experience building and maintaining Jenkins CI/CD pipelines
• Strong ETL/ELT pipeline development experience
• Proficiency in SQL, Git, Linux, and Agile methodologies
• Glider Assessment Required
Preferred Qualifications
• Experience with Docker and Kubernetes
• Knowledge of Infrastructure as Code
• Financial services or regulated industry experience
• AWS certifications are a plus