Data Scientist at Antasglobal
🚀 Hiring: Junior Data Engineer – 12-Month Contract 💼 Experience: 3–5 Years 🔑 Key Skills: Informatica/IDMC | Databricks | Python | Tableau/OAS 🎓 Certifications Preferred: AWS Cloud Practitioner / Databricks / IDMC
Data Engineer 🔍 Position Overview We are looking for a passionate Junior Data Engineer to support cloud migration projects, primarily using Informatica/IDMC, Python, and Databricks. This role involves designing data pipelines, building ETL processes, optimizing cloud-based environments, and collaborating with cross-functional teams to deliver high-quality data solutions. 🛠️ Roles and Responsibilities Data Architecture & Design Design data engineering solutions across AWS, Databricks (Delta Lake), and Informatica/IDMC for metadata and cataloging. Pipeline Development Build and optimize data pipelines for ingestion, transformation, and processing using AWS Glue, Lambda, Databricks, and IDMC. Data Integration Integrate data from multiple sources, ensuring quality, consistency, and governance using Informatica IDMC. ETL Development Develop scalable ETL workflows using Databricks (Spark) and IDMC for advanced data transformation and quality checks. Performance Optimization Monitor and tune data pipelines and queries across AWS and Databricks to meet performance and scalability needs. Security & Compliance Implement data encryption, access controls, and governance frameworks using AWS and Informatica IDMC. Automation Automate data processes using AWS Step Functions, Lambda, Databricks Jobs, and IDMC workflow automation. Documentation Maintain clear documentation of pipelines, configurations, and metadata across all environments. Cross-Functional Collaboration Work with data scientists, analysts, and engineering teams to understand requirements and deliver solutions. Issue Resolution Troubleshoot and resolve data-related issues across AWS, Databricks, and IDMC environments. Cost Optimization Optimize cloud resources while maintaining performance and scalability. Continuous Learning Stay updated with AWS, Databricks, and Informatica IDMC enhancements and integrate best practices.
🎓 Requirements / Qualifications Bachelor’s or Master’s in Computer Science, Data Engineering,or related field Strong expertise in AWS, Databricks, and/or Informatica IDMC Proficiency in Python, Java, or Scala Solid understanding of SQL & NoSQL databases Experience evaluating technical solutions and improving performance Knowledge of data modeling and schema design Strong problem-solving and analytical abilities Excellent communication & teamwork skills
✨ Preferred Skills Hands-on experience with Python & Databricks Familiarity with data governance and cataloging tools (Informatica IDMC) Exposure to Tableau or similar visualization tools Understanding of Docker, Kubernetes, and DevOps concepts Experience with Git and CI/CD pipelines
📩 Interested candidates can share their resume with: gagina@antasglobal.com
#DataEngineer #JuniorDataEngineer