Data Engineer
Jyoshi Consulting LLCUnited StatesSENIORPosted 43m ago
SQLT-SQLSpark SQLAzure Data FactoryAzure DatabricksPySparkDelta LakeVBAExcelAccessAzure Data Lake StorageAzure SQL DatabaseKey VaultRBAC
About the Role
We are seeking an experienced Data Engineer with 15+ years of expertise in Data Engineering, ETL development, and database administration. This role focuses on building scalable data pipelines and modernizing business-critical automation solutions.
Key Responsibilities
• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory
• Implement data transformation using Azure Databricks, PySpark, and Spark SQL
• Ensure data quality and governance across the data pipeline
• Migrate legacy VBA processes to cloud-based workflows
• Develop and maintain business-critical automation and reporting solutions
Requirements
• 15+ years of experience in Data Engineering, ETL development, and database administration
• Strong expertise in SQL (T-SQL/Spark SQL), including complex queries and performance tuning
• Hands-on experience with Azure Data Factory for designing and monitoring ETL/ELT pipelines
• Proven experience with Azure Databricks, PySpark, Spark SQL, and Delta Lake
• Strong VBA (Excel/Access) skills for developing automation solutions
• Experience with Azure Data Lake Storage, Azure SQL Database, Key Vault, and RBAC security