Databricks Architect
Pardha Sai Subrahmanyam JakkaUnited StatesMIDPosted 2h ago
DatabricksAWSPySparkSpark SQLDelta LakeLakehouse ArchitectureUnity CatalogETL/ELTPerformance OptimizationCI/CDTerraform
About the Role
We are looking for a Databricks Architect to work on AWS platforms. This role involves designing and implementing data solutions using Databricks and related technologies.
Key Responsibilities
• Design and implement data architectures using Databricks
• Work with AWS services to build scalable data solutions
• Utilize PySpark, Spark SQL, and Delta Lake for data processing
• Implement Lakehouse Architecture and Unity Catalog
• Develop ETL/ELT processes and optimize performance
• Set up CI/CD pipelines and use Terraform for infrastructure
Requirements
• 15+ years of experience in data architecture
• Strong expertise in Databricks and AWS
• Proficiency in PySpark, Spark SQL, and Delta Lake
• Experience with Lakehouse Architecture and Unity Catalog
• Knowledge of ETL/ELT processes and performance optimization
• Familiarity with CI/CD and Terraform
Benefits