AWS Big Data Engineer
Raghavendra R.United StatesSENIORPosted 1h ago
AWSS3EC2GlueEMRRDSRedshiftAthenaLambdaDynamoDBPythonRJavaC++ScalaSQLNoSQLOracleMS SQL ServerPostgresCassandraGitCI/CDData modelingDimensional modelingData vaultStar schemaSnowflake schemaAWS Glue Data CatalogData governanceData lineageData qualityREST APIHadoopSparkKafkaAzkabanLuigiAirflowInformaticaMuleSoftTalendTIBCOStormSpark-Streaming
About the Role
We are looking for an AWS Big Data Engineer to join our team. This role focuses on working with cloud-based data services and big data tools.
Key Responsibilities
• Work with cloud-based data services such as AWS (S3, EC2, Glue, EMR, RDS, Redshift, Athena, Lambda, DynamoDB)
• Develop and maintain data pipelines and workflows
• Implement data modeling techniques and ensure data quality
• Integrate various data sources and systems
• Work with big data tools like Hadoop, Spark, and Kafka
Requirements
• Hands-on experience with AWS data services
• Proficiency in scripting languages (Python, R, Java, C++, Scala)
• Experience with relational and NoSQL databases
• Knowledge of version control systems and CI/CD pipelines
• Understanding of data governance and data quality frameworks
• Experience with data integration services and stream-processing systems