Jobs → Data & Analytics → Big Data Engineer

About the Role We are seeking an experienced Big Data Engineer to join our team. This role involves designing and implementing scalable data solutions and optimizing complex big data systems. Key Responsibilities • Design and lead end-to-end data integration • Perform performance tuning and resolve complex big data and streaming technical issues • Design and implement scalable solutions across the technology stack • Perform integration testing and provide support to QA teams • Contribute to requirements analysis, project estimation, system design, coding, and testing • Evaluate and implement appropriate third-party libraries and software • Stay current with emerging techniques and trends in big data and AI/ML Requirements • 12+ years of hands-on experience designing and implementing data applications in production using Java, Python, or Scala on big data platforms • 5+ years of hands-on experience with streaming technologies, specifically with Kafka and various open-source software platforms • Proven ability to optimize data flow and design efficient, scalable data pipelines • Strong understanding of distributed data architecture concepts • Solid knowledge of data security, governance, and compliance • Proficiency in programming languages: Java, Python, Scala, and SQL • Strong analytical capabilities, creativity, and critical thinking skills • Effective written and verbal communication, with the ability to facilitate team collaboration