GCP / Python Developer
Varun PothrapallyUnited StatesSENIORPosted 5d ago
PythonBigQuery SQLApache AirflowCloud ComposerGCP servicespytestGitCI/CD pipelinesLumiERIRP FrameworkJSON-driven pipelines
About the Role
We are looking for a GCP / Python Developer to join our team at Infosys / AMEX. This role focuses on developing and maintaining cloud-based solutions using Google Cloud Platform and Python.
Key Responsibilities
• Develop and maintain Python applications on Google Cloud Platform
• Work with BigQuery SQL for data analysis and processing
• Implement and manage Apache Airflow for workflow orchestration
• Ensure data quality, deduplication, and reliable financial data processing
• Develop and maintain CI/CD pipelines
Requirements
• Strong Python development experience with modular coding, debugging, and logging
• Advanced BigQuery SQL skills, including complex joins, CTEs, window functions, MERGE, and query optimization
• Experience with Apache Airflow / Cloud Composer, DAG development, orchestration, retries, and backfills
• Knowledge of GCP services: BigQuery, Cloud Storage, IAM, Service Accounts, and Pub/Sub
• Experience with pytest, unit/integration testing, Git, and CI/CD pipelines
• Familiarity with data quality, deduplication, reconciliation, and reliable financial data processing
• Willingness to learn and develop skills in Lumi / ERIRP Framework, JSON-driven pipelines, runtime configuration, validation controls, and operational notifications