Big Data Engineer
Ritu GuptaUnited StatesMIDPosted 12d ago
JavaApache SparkSQLDataFramesAWSGCPMSKKafkaAmazon S3Apache IcebergData warehousingETLDataPipelinesCloudComputing
About the Role
We are looking for a Big Data Engineer with a Java background to join our team in Austin, TX. This role focuses on backend development and data engineering.
Key Responsibilities
• Design and implement data engineering solutions
• Work with large-scale data processing using Apache Spark
• Develop and maintain ETL processes and data pipelines
• Utilize cloud technologies like AWS or GCP
• Collaborate with team members on technical requirements
Requirements
• 5+ years of backend development experience, focused on data engineering
• Strong proficiency in Java and Apache Spark
• Expertise in SQL and relational databases
• Hands-on experience with DataFrames and large-scale data processing
• Experience with AWS or GCP cloud technologies
• Knowledge of MSK/Kafka, Amazon S3, and Apache Iceberg
• Strong understanding of data warehousing concepts
• Excellent communication and collaboration skills
• Bachelor's degree in Computer Science or a related field, or equivalent experience