Data Engineer
Yogeshwari RUnited StatesMIDPosted 16m ago
AWS Cloud ServicesSQLPythonRelational DatabasesNoSQL DatabasesBig Data TechnologiesETL DevelopmentData Pipeline ArchitectureApache AirflowGitCI/CD PipelinesData ModelingAWS Glue Data CatalogData GovernanceREST API DesignData Integration ToolsStream Processing
About the Role
We are looking for a Data Engineer to join our team. This role focuses on building and maintaining data pipelines and infrastructure.
Key Responsibilities
• Design and implement data pipelines using AWS Cloud Services
• Develop ETL processes and data integration solutions
• Work with Big Data technologies like Hadoop, Spark, and Kafka
• Create and maintain data models using Star Schema and Snowflake Schema
• Implement data governance and quality standards
• Design and integrate REST APIs
Requirements
• 5+ years of experience with AWS Cloud Services (S3, Glue, EMR, Redshift, Athena, Lambda, etc.)
• Strong SQL and Python programming skills
• Experience with Relational & NoSQL Databases (Oracle, SQL Server, PostgreSQL, Cassandra)
• Big Data Technologies – Hadoop, Spark, Kafka
• ETL Development and Data Pipeline Architecture
• Apache Airflow / Luigi / Azkaban
• Git and CI/CD Pipelines
• Data Modeling – Star Schema, Snowflake Schema, Data Vault
• AWS Glue Data Catalog and Metadata Management
• Data Governance, Data Lineage, and Data Quality
• REST API Design and Integration
• Data Integration Tools – Informatica, MuleSoft, Talend, TIBCO
• Stream Processing – Storm / Spark Streaming