Jobs → Data & Analytics → Big Data Engineer

About the Role We are looking for a Big Data Engineer to develop and optimize scalable data pipelines. This role involves building rule-based data validation engines and ensuring data quality, consistency, and performance. Key Responsibilities • Develop and optimize scalable data pipelines • Build rule-based data validation engines • Ensure data quality, consistency, and performance • Collaborate with teams to deliver efficient data engineering solutions Requirements • Strong hands-on experience with Scala, PySpark, and AWS Glue • 4+ years of experience building and maintaining big data pipelines • Experience with Parquet, data profiling, and data validation frameworks • Knowledge of data quality checks, performance tuning, and scalable data processing • Experience using AI coding assistants such as GitHub Copilot or Codex