Loading...
Mid LevelFull-timeTerraformData ScienceAgileCI/CD
Salary Range
$66,300 - $89,700 /year
This salary is estimated based on similar roles. The actual salary may vary.
Synopsis
This individual will work with cross‑functional product teams to design, implement, and support modern data platforms leveraging Databricks and related technologies. The role requires expertise in Delta Lake, Unity Catalog, Delta Live Tables (DLT), and Lakeflow, combined with strong skills in PySpark, Structured Streaming, Autoloader, and DQX. A solid background in CI/CD, Terraform, DevOps, and DataOps practices is essential. The engineer will drive platform reliability, scalability, and automation across cloud environments, ensuring robust analytics and data science capabilities.
Accountabilities
• Treat the data platform as a core product, ensuring scalability, reliability, and innovation.
• Collaborate with Architecture on the development and prioritization of the Databricks‑based platform roadmap.
• Integrate new services such as Delta Lake, Unity Catalog, and DLT into the platform ecosystem.
• Prepare and maintain documentation for Databricks workflows, CI/CD pipelines, and infrastructure automation.
• Partner with stakeholders to resolve platform‑related technical issues and identify areas for improvement.
• Implement internal process improvements: automate ingestion with Autoloader, optimize streaming with Structured Streaming, and enforce data quality with DQX.
• Adopt Agile and DevOps practices, ensuring CI/CD pipelines and Terraform‑based infrastructure are production‑ready.
• Provide operational support for Databricks clusters, jobs, and pipelines.
• Perform fallout & impact analysis, ensure recovery of impacted transactions, and provide business impact reports for production incidents.
• Propose new ideas and technologies to foster continuous improvement and enhance user experience.
• Define, share, and drive adoption of best practices for DataOps and cloud‑native data engineering.
Free to sign up. Takes 30 seconds.
About EtihadAirways5
Etihad Airways 5 operates within the aviation industry, specializing in providing comprehensive air travel services. The name suggests a strong connection to Etihad Airways, the national airline of the United Arab Emirates, potentially indicating a subsidiary, division, or specialized service arm. While the exact founding date and location are not explicitly stated, the association with Etihad Airways points to origins in the Middle East, likely Abu Dhabi, where the parent company is headquartered. The company leverages the reputation and global reach of Etihad Airways to offer reliable and high-quality travel experiences to passengers worldwide. The main products and services offered by Etihad Airways 5 likely include passenger transportation, cargo services, and potentially specialized travel solutions such as corporate travel or luxury travel packages. Key features may include a modern fleet, extensive route network, state-of-the-art in-flight amenities, and a customer-centric approach focused on safety and comfort. The target audience is likely diverse, encompassing both leisure and business travelers who value efficiency, connectivity, and premium service. The company aims to cater to discerning customers seeking seamless travel experiences across international destinations. Notably, as part of the Etihad Airways group, it benefits from the parent company's extensive industry expertise, robust infrastructure, and commitment to innovation, positioning it as a reliable choice for global air travel.
