Data Engineer
Shailaja VejendlaRemoteMIDPosted 8d ago
SQLPythonScalaSparkHadoopETLELTAzureAWSGCPData LakeDatabricksSynapseRedshiftBigQueryADFdbtInformaticaTalend
About the Role
We are seeking a Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data platforms. This technical role requires expertise in SQL, Python/Scala, Spark, Hadoop, and ETL/ELT tools, along with hands-on experience in Azure, AWS, or GCP data ecosystems.
Key Responsibilities
• Design, develop, and optimize data pipelines for batch and real-time processing
• Integrate structured and unstructured data from multiple sources into cloud-based data platforms
• Ensure data quality, reliability, and governance across the data lifecycle
• Collaborate with data scientists, analysts, and business stakeholders to deliver analysis-ready datasets
• Implement best practices for data security, scalability, and performance optimization
• Monitor, troubleshoot, and maintain data workflows to ensure system stability
• Document data processes, architecture, and lineage for transparency and compliance
Requirements
• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
• Proven experience as a Data Engineer or in a related data engineering role
• Strong expertise in SQL, Python/Scala, and big data frameworks (Spark, Hadoop)
• Hands-on experience with cloud data platforms (Azure Data Lake, Databricks, Synapse, AWS Redshift, GCP BigQuery)
• Proficiency in ETL/ELT tools (ADF, dbt, Informatica, Talend)
• Familiarity with data governance, security, and performance optimization
• Strong problem-solving skills and experience with data quality, lineage, and governance frameworks