Loading...
Mid LevelFull-timePythonJavaKubernetesDockerDevOps
Salary Range
$20,400 - $27,600 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a dedicated and experienced Software Developer to join our team in Mumbai. This role focuses on building and maintaining our Big Data environment and data processing pipelines.
Key Responsibilities
- →Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.)
- →Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink)
- →Collaborate with development teams on data modeling, data ingestion, and capacity planning
- →Work with users to ensure data integrity and availability
- →Act as a Big Data SME and consult on a variety of data-related questions from users and developers
Requirements
- ✓5+ years' experience working in a mature data engineering environment
- ✓3+ years of experience building Kafka streaming applications and/or maintaining Kafka clusters
- ✓2+ years of experience building applications/pipelines with Big Data backends (S3, HDFS, Databricks, Iceberg, etc)
- ✓Experience with Apache Spark, Apache Flink or similar tools
- ✓Strong Java, Python, and SQL development skills
- ✓Experience with common data-science toolkits, especially python-based
- ✓Hands-on experience with Kubernetes and Docker
- ✓Experience with monitoring tools such as Prometheus/Grafana, Alert Manager, Alerta and OpsGenie
- ✓Strong statistical analysis skills
- ✓Demonstrated ability to troubleshoot and conduct root-cause analysis
- ✓Unix scripting experience (bash, python, etc.)
