GCP Big Data Engineer
Dhananjay H KUnited StatesMIDPosted 4h ago
GCPPySparkSQLBigQueryGCSScalaSparkETLJenkinsGitMavenLinuxUnixPower BIDAX
About the Role
We are looking for an experienced GCP Big Data Engineer to join our team at LUMI. This role involves working with Big Data platforms and technologies.
Key Responsibilities
• Develop and implement ETL processes using PySpark and SQL
• Work with LUMI-based data processing and workflows
• Utilize GCP services including BigQuery and GCS
• Implement CI/CD pipelines using Jenkins, Git, and Maven
• Maintain and optimize Big Data platforms
Requirements
• 8+ years of software/data engineering experience
• Strong experience with GCP and Big Data/Lake technologies
• Hands-on experience with PySpark/SQL ETL development
• Experience with LUMI-based data processing
• Proficiency in CI/CD tools like Jenkins, Git, and Maven
• Knowledge of Linux/Unix environments
• Experience with Power BI, DAX, and data modeling is a plus
• Excellent communication and leadership skills