Data Engineer
Rahul kharatiUnited StatesMIDPosted 1h ago
Azure DatabricksUnity CatalogPySparkPythonCI/CDGitHubDevOpsData GovernanceSecurityData ObservabilityDatadog
About the Role
We are looking for a Data Engineer to join our team. This role focuses on working with Azure Databricks and managing data governance.
Key Responsibilities
• Work with Azure Databricks and Unity Catalog
• Develop using PySpark and Python
• Implement CI/CD processes with GitHub and DevOps
• Manage data governance and security
• Ensure data observability using Datadog
Requirements
• Strong hands-on experience with Azure Databricks
• Experience managing data governance and access
• Strong proficiency in Python and PySpark for distributed systems