Data Engineer
Mohd HameedUnited StatesSENIORPosted 7h ago
Azure DatabricksPySparkDatabricks GenieSQLLLMLangChainLangGraph
About the Role
We are looking for an experienced Data Engineer to join Comcast Corporation. The role involves developing and optimizing scalable ETL/ELT pipelines and handling large volumes of structured and unstructured data.
Key Responsibilities
• Develop and optimize scalable ETL/ELT pipelines
• Handle large volumes of structured and unstructured data
• Write complex SQL queries
• Build dashboards and reporting solutions
Requirements
• Strong hands-on experience with Azure Databricks
• Expertise in PySpark and ETL/ELT pipeline development
• Hands-on knowledge of Databricks Genie
• Strong experience writing complex SQL queries
• Experience with Databricks SQL Dashboards and data visualization
• Knowledge of LLM, LangChain, and LangGraph
• Experience designing and maintaining scalable data management systems