Lead Kafka Integration Engineer
Nisha PathakMexicoLEADPosted 1h ago
Apache KafkaAzure DatabricksPySparkDelta LakeSQL ServerMDMInformaticaAzure Data FactoryCI/CDTerraform
About the Role
We are looking for a Lead Kafka Integration Engineer to join our team at E-Solutions Inc. This role involves working with Apache Kafka and Azure Databricks to build scalable data solutions.
Key Responsibilities
• Design and implement Kafka integration solutions
• Work with Azure Databricks and PySpark for data processing
• Utilize Delta Lake for data lake management
• Manage SQL Server databases and MDM systems
• Implement Informatica for data integration
• Configure Azure Data Factory for data pipelines
• Set up CI/CD pipelines with Terraform
Requirements
• 8–10 years of experience in data engineering
• Strong knowledge of Apache Kafka
• Experience with Azure Databricks and PySpark
• Familiarity with Delta Lake, SQL Server, MDM, and Informatica
• Experience with Azure Data Factory, CI/CD, and Terraform