π₯ Direct to Recruiter Β· No MiddlemenPosted 1h ago
Pallabi Pal
Senior Technical US IT Recruiter - Team Lead at Pacer Group
Databricks Architect / Developer
π United StatesπΌ Freelance Project
π₯ UrgentMidApache SparkDatabricksPythonScalaJava
π HIRING β DATABRICKS ARCHITECT / DEVELOPER (AZURE / BIG DATA)
π° Bill Rate: $60-65/hour
π Location: Louisville, KY
π
Duration:Long-term
πΉ Role Overview:
Seeking a highly skilled Databricks Architect / Developer with strong hands-on experience in Apache Spark, cloud data platforms, and big data architectures. The role involves designing scalable data pipelines, optimizing performance, and driving data engineering best practices.
πΉ Key Responsibilities:
β’ Architect and develop scalable data pipelines using Databricks & Apache Spark
β’ Collaborate with data scientists, analysts & business stakeholders
β’ Optimize ETL workflows for performance, reliability & cost efficiency
β’ Implement data governance, security & compliance standards
β’ Troubleshoot complex issues related to data ingestion, transformation & storage
β’ Mentor junior engineers and contribute to code reviews & architecture decisions
β’ Develop and maintain technical documentation & operational procedures
β’ Drive automation strategies and platform enhancements
πΉ Required Skills:
β 8β10 years of experience in Data Engineering / Big Data
β Strong expertise in Databricks & Apache Spark (PySpark / Scala / SQL)
β Proficiency in Python / Scala / Java
β Strong knowledge of cloud platforms (Azure, AWS, or GCP)
β Experience with Delta Lake & data warehousing concepts
β Strong understanding of distributed computing & performance tuning
β Experience with CI/CD tools & DevOps practices
β Excellent analytical, problem-solving & communication skills
πΉ Preferred Skills:
β Experience with Iceberg table implementation
β Knowledge of Databricks Automation Bundles & DQX framework
β Exposure to GenAI use cases in data engineering
β Experience designing enterprise-scale data architectures
π© Interested candidates or vendors, please share resumes at [Upgrade to PRO to see contact]
Please mention the job title, location, and visa status while applying.
Contact details hidden