Databricks Architect
Pramod KumarUnited StatesMIDPosted 15h ago
DatabricksSQLPythonAzure data servicesSAP ECCAWSAWS S3PySparkETLData modellingData pipelinePandasNumPyBeautiful SoupData managementOrchestrationAccess controlReal-time data processingData ingestionData storage solutions
About the Role
We are looking for a Databricks Architect to join our team. This role focuses on developing and deploying data solutions using Databricks and cloud platforms.
Key Responsibilities
• Work with business stakeholders and users to assist in designing, developing, and delivering their data models or self-service models
• Work with global data standards, structures, and processes to maintain global guidelines
• Experience with AWS ecosystem and AWS S3
• Ability to work on multiple areas like data pipeline ETL, data modelling and design, writing complex SQL queries
• Hands-on expertise with real-time data processing and analytics, data ingestion (batched and streamed), and data storage solutions
• Hands-on knowledge of Python along with its main data libraries like Pandas, NumPy, Beautiful Soup
• Demonstrated strength in data management, orchestration, access control
Requirements
• Overall 10+ years of experience and 3+ years of experience developing and deploying data solutions using AWS/Azure Data Bricks in PySpark
• Basic knowledge of SAP ECC is required
• Demonstrated strength in writing optimized SQL to deal with large data volumes
• Experience with AWS ecosystem and AWS S3
• Ability to work on multiple areas like data pipeline ETL, data modelling and design, writing complex SQL queries
• Hands-on expertise with real-time data processing and analytics, data ingestion (batched and streamed), and data storage solutions
• Hands-on knowledge of Python along with its main data libraries like Pandas, NumPy, Beautiful Soup
• Demonstrated strength in data management, orchestration, access control