Data Engineer
Kiran AmireddyRemoteSENIORPosted 3h ago
AWSETLdata warehousingdatabase engineeringAWS GluePySparkPythonAWS RedshiftS3LambdaStep FunctionsAurora PostgreSQLAWS RDSSQLDB2IBM DataStageInformaticaUnix/LinuxKorn ShellPerlApache AirflowREST APIsSOAP APIsGitBitbucketJenkins
About the Role
We are looking for an experienced Data Engineer with strong expertise in AWS cloud technologies, ETL development, data warehousing, and database engineering.
Key Responsibilities
• Analyze and modernize existing DataStage, Informatica, DB2, and legacy scripts
• Design and develop scalable AWS-based ETL/ELT pipelines
• Build data integration solutions using AWS Glue, PySpark, Python, and Airflow
• Optimize data processing and storage in Redshift and Aurora PostgreSQL
• Develop APIs and integrate CI/CD pipelines
• Perform data validation, quality checks, and production support
• Ensure data security, compliance, monitoring, and documentation
Requirements
• 8+ years of experience in data engineering
• Strong expertise in AWS cloud technologies
• Experience with ETL development and data warehousing
• Hands-on experience modernizing legacy ETL systems
• Experience with database engineering
• Knowledge of SQL, DB2, and IBM DataStage
• Familiarity with Unix/Linux, Korn Shell, and Perl
• Experience with Apache Airflow
• Understanding of REST/SOAP APIs
• Experience with Git, Bitbucket, and Jenkins (CI/CD)
Preferred Qualifications
• AWS Certifications
• Exposure to AI/ML
• Automotive industry experience
• Bachelor's degree in Computer Science, IT, or related field