Senior Data Engineer at paytm

About Us: Paytm is India's leading mobile payments and financial services distribution company. Pioneer of the mobile QR payments revolution in India, Paytm builds technologies that help small businesses with payments and commerce. Paytm’s mission is to serve half a billion Indians and bring them to the mainstream economy with the help of technology. About the Role: We are looking for a highly skilled Data Engineer to design, build, and optimize scalable data systems that power our products and insights. You will work closely with cross-functional teams to develop robust data infrastructure, ensure data quality, and enable data-driven decision-making across the organization. Key Responsibilities: ● Design, develop, and maintain scalable data pipelines for ingestion, processing, and storage ● Build and manage ETL workflows using tools such as Apache Spark, Apache NiFi, or similar technologies ● Integrate data from multiple sources into centralized data warehouses or data lakes ● Collaborate with data scientists, analysts, and engineers to translate business needs into technical solutions ● Ensure data quality, integrity, and reliability through validation and monitoring processes ● Optimize data pipelines for performance, scalability, and efficiency ● Monitor, troubleshoot, and resolve production issues with minimal downtime ● Implement best practices in data governance, security, and compliances ● Contribute to continuous improvement, automation, and system reliability ● Document workflows, systems, and technical specification ● Stay updated with emerging trends and technologies in data engineering What You’ll Do ● Build systems to collect and transform complex datasets for production use ● Develop and maintain backend services and data infrastructure ● Implement scalable data schemas and improve data management practices ● Provide insights into product performance and customer behavior ● Act as a subject matter expert in data infrastructure, privacy, and security ● Collaborate with stakeholders to understand and deliver on requirements ● Participate in on-call rotations to support live systems Minimum Qualifications ● Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience) ● 3+ years of experience in data engineering or backend engineering ● Strong understanding of data structures and algorithms ● Proficiency in Java, Python, or Scala ● Strong SQL skills with the ability to write complex queries ● Experience with workflow orchestration tools such as Airflow ● Hands-on experience with big data technologies like Apache Spark, Kafka, or Flink ● Experience with databases such as Cassandra, MongoDB, Oracle, or PostgreSQL ● Familiarity with cloud platforms (AWS or GCP) ● Experience with containerization tools like Docker and Kubernetes ● Experience building scalable microservices using REST, Spring Boot, or gRPC ● Strong problem-solving, communication, and collaboration skills Preferred Qualifications ● Experience with large-scale distributed systems ● Knowledge of data security and compliance standards ● Experience in building and scaling data platforms ● Passion for experimentation, rapid prototyping, and innovation Why join us   ● Because you get an opportunity to make a difference, and have a great time doing that .  ● You are challenged and encouraged here to do stuff that is meaningful for you and for those  we serve.   ● You should work with us if you think seriously about what technology can do for people .  ● We are successful, and our successes are rooted in our people's collective energy and  unwavering focus on the customer, and that's how it will always be.  Compensation:  If you are the right fit, we believe in creating wealth for you with enviable 500 mn+ registered users, 25 mn+ merchants and depth of data in our ecosystem, we are in a unique position to democratize credit for deserving consumers & merchants – and we are committed to it. India’s largest digital lending story is brewing here. It’s your opportunity to be a part of the story!