GCP Big Data Engineer
Girish VanukuriUnited StatesSENIORPosted 22m ago
GCPPySparkSQLBigQueryGCSScalaSparkETLJenkinsGitMavenLinuxUnixPower BIDAX
About the Role
We are looking for an experienced GCP Big Data Engineer to join our team at LUMI. This role involves working with Big Data platforms and technologies to process and analyze data.
Key Responsibilities
• Develop and implement ETL processes using PySpark and SQL
• Work with BigQuery, GCS, and other GCP services
• Design and implement data processing workflows on LUMI
• Utilize Scala/Spark for Big Data processing
• Implement CI/CD pipelines using Jenkins, Git, and Maven
• Work with Linux/Unix environments
• Create data models and reports using Power BI and DAX
Requirements
• 8+ years of software/data engineering experience
• Strong experience with GCP and Big Data/Lake technologies
• Hands-on experience with PySpark/SQL ETL development
• Experience with LUMI-based data processing and workflows
• Knowledge of CI/CD, Jenkins, Git, Maven, Linux/Unix
• Experience with Power BI, DAX, and data modeling is a plus
• Excellent communication and leadership skills