Databricks Engineer
srikanth reddy rUnited StatesMIDPosted 2h ago
PythonDatabricksPySparkAWSS3GlueLambdaEMRRedshiftCloudWatchIAMAirflowdbtJenkinsGitHub ActionsCode Pipeline
About the Role
We are seeking a Databricks Engineer to join our team for a contract role focused on Terradata to Databricks migration.
Key Responsibilities
• Migrate data from Terradata to Databricks
• Work with Python, Databricks, and PySpark
• Utilize AWS cloud services including S3, Glue, Lambda, EMR, Redshift, CloudWatch, and IAM
• Implement Airflow, dbt, and CI/CD tools like Jenkins, GitHub Actions, or Code Pipeline
Requirements
• 5–6 years of experience in data engineering or big data development
• 2–3 years of experience with Databricks and Apache Spark
• Solid understanding of data lakes, lakehouses, and Delta Lake concepts
• SQL development and performance tuning skills
• Experience with PySpark, Python, and optionally Scala