Data Engineer / Databricks Engineer
Rajeev ZUnited StatesMIDPosted 7d ago
Databricks Platform AdministrationGovernanceApache SparkPySparkDelta LakeData Pipeline ArchitectureETL/ELTPlatform Cost OptimizationCloud SecurityNetworkingPrivate ConnectivityAWSAzureGCPUnity CatalogCI/CDInfrastructure as Code
About the Role
We are looking for a Data Engineer / Databricks Engineer to join our team. This role focuses on managing and optimizing data platforms and pipelines.
Key Responsibilities
• Administer and govern the Databricks platform
• Develop and maintain data pipelines using Apache Spark, PySpark, and Delta Lake
• Design and implement ETL/ELT processes
• Optimize platform costs and ensure cloud security
• Work with AWS, Azure, and GCP cloud services
Requirements
• Experience with Databricks Platform Administration & Governance
• Strong skills in Apache Spark, PySpark, and Delta Lake
• Knowledge of Data Pipeline Architecture and ETL/ELT processes
• Understanding of Platform Cost Optimization
• Familiarity with Cloud Security, Networking, and Private Connectivity
• Experience with AWS, Azure, or GCP
• Unity Catalog, CI/CD, and Infrastructure as Code experience preferred