π₯ Direct to Recruiter Β· No MiddlemenPosted 1h ago
Sumalatha Panem
livemindz at Livemindz
Data Engineer
π United StatesπΌ Freelance Project
π₯ UrgentMidPySparkSpark SQLDelta Live TablesTerraformAWS DevOps
Original Post
Role: Data Engineer with Data bricksΒ
Location: Marlborough, NH
Duration: 6 months
Experience Required
5+ years of handsβon data engineering experience
3+ years focused on the Databricks / Spark ecosystem
Key Responsibilities
Data Pipeline Development
Design, develop, and deploy robust, scalable batch and streaming data pipelines using:
PySpark
Spark SQL
Delta Live Tables
Use Infrastructure as Code (IaC) tools such as:
Terraform
AWS DevOps
GitHub Actions
Champion CI/CD best practices for data pipelines.
Work closely with:
Functional Consultants
Data Scientists
Analytics Engineers
Translate data requirements into wellβstructured, consumptionβready datasets.
Required Skills & Qualifications
Databricks & Spark Expertise
Deep handsβon experience with the Databricks Lakehouse Platform, including:
Delta Lake
Structured Streaming
Delta Live Tables
Cluster configuration and optimization
Programming & Data Engineering
Expertβlevel proficiency in Python and PySpark.
Advanced SQL skills for transformation, validation, and analysis.
Strong understanding of ETL / ELT design patterns.
Data Warehousing Concepts
Strong knowledge of data modeling principles, including:
Dimensional modeling (Kimball)
Data warehousing fundamentals
Strong familiarity with cloud storage (e.g., S3 or equivalent).
Handsβon experience with:
Git version control
Code reviews
Testing
CI/CD pipelines
Preferred Qualifications (Nice to Have)
Databricks Certified Data Engineer β Professional certification.
Experience with Terraform or other IaC tools.
Experience delivering data solutions in retail or eβcommerce environments.
Familiarity with orchestration tools such as Airflow.
Experience with modern data stack tools, including:
Send me your resume to [Upgrade to PRO to see contact]
Contact details hidden
β‘ Apply Now β Be First
Client's email and LinkedIn are on this page. Upgrade to see them and apply before others.
π Contact info is hidden on FREE plan. PRO members apply directly and get hired faster.