Jobs → Data & Analytics → Big Data Engineer

About the Role We are looking for a Big Data Engineer to join our team at Vegaintellisoft. This role involves working with large-scale data processing systems and cloud platforms. Key Responsibilities • Design and implement data processing solutions using big data technologies • Develop and maintain ETL processes and data pipelines • Optimize data workflows and ensure data quality • Collaborate with cross-functional teams to understand data requirements Requirements • 10+ years of experience in big data engineering • Strong proficiency in Python, Scala, or Java • Hands-on experience with Apache Spark, Hadoop, Hive, or PySpark • Advanced SQL skills and experience with data warehouses • Experience with streaming frameworks like Apache Kafka or AWS Kinesis • Familiarity with cloud platforms (AWS, Azure, GCP) • Knowledge of orchestration tools like Apache Airflow, Prefect, or Dagster • Experience with DevOps practices and tools (Git, CI/CD, Docker, Kubernetes)