Data Engineer
Renu SwamiUnited StatesMIDPosted 11d ago
SQLPythonETLELTHadoopClouderaCloud ComputingData WarehouseGenerative AI
About the Role
We are looking for an experienced Data Engineer to design, develop, optimize, and maintain scalable cloud-based data pipelines, data platforms, and storage solutions. The ideal candidate will have strong SQL and Python skills, hands-on experience with ETL/ELT workflows, and knowledge of big data technologies.
Key Responsibilities
• Design, develop, and maintain scalable ETL/ELT pipelines.
• Ingest, transform, and process structured and unstructured data from multiple sources.
• Build and optimize data warehouses, data lakes, and lakehouse architectures.
• Perform SQL and NoSQL testing, data validation, and post-deployment checks.
• Develop Python scripts and automation for data processing and transformation.
• Troubleshoot data ingestion, schema, and data quality issues.
• Collaborate with cross-functional teams to translate business requirements into technical solutions.
• Monitor and optimize cloud-based data platforms for scalability, reliability, and performance.
Requirements
• 3+ years of experience in Data Warehouse development.
• 3+ years of experience analyzing aggregated data from multiple sources in cloud-based environments.
• 2+ years of experience developing and maintaining scalable data stores for business analytics.
• Strong proficiency in SQL and Python for data retrieval, parsing, and processing.
• Hands-on experience developing scalable ETL/ELT workflows for reporting and analytics.
• Experience with Cloudera or Hadoop technologies for data ingestion, transformation, and processing.
• Experience leveraging Generative AI coding tools to assist with development.
Preferred Qualifications
• Public Health domain experience.