Data Engineer
Dileep KumarUnited StatesSENIORPosted 6d ago
Azure CloudAzure Data FactoryAzure DatabricksStorage AccountsSnowflakeSQLDBT/DLTMedallion ArchitectureData Pipeline DevelopmentData MigrationData OptimizationCI/CD PipelinesAzure DevOpsReposProduction DeploymentsUnity CatalogDelta Live TablesData SecurityPII MaskingEncryptionTerraformARM TemplatesProduction MonitoringIncident ManagementAgile Methodologies
About the Role
We are seeking a Data Engineer for a 6-month contract position in Seattle, WA with a hybrid work schedule. This role involves working with various cloud and data technologies to develop, migrate, and optimize data pipelines.
Key Responsibilities
• Develop and maintain data pipelines using Azure Cloud, Azure Data Factory, and Azure Databricks
• Work with Snowflake, SQL, and DBT/DLT to implement Medallion Architecture
• Design and implement CI/CD pipelines using Azure DevOps
• Ensure data security, PII masking, and encryption
• Utilize Terraform and ARM Templates for infrastructure management
• Monitor production environments and manage incidents
Requirements
• Experience with Azure Cloud, Azure Data Factory, Azure Databricks, and Storage Accounts
• Proficiency in Snowflake, SQL, DBT/DLT, and Medallion Architecture
• Strong background in Data Pipeline Development, Migration, and Optimization
• Knowledge of CI/CD Pipelines, Azure DevOps, and Production Deployments
• Familiarity with Unity Catalog, Delta Live Tables, Data Security, PII Masking, and Encryption
• Experience with Terraform, ARM Templates, Production Monitoring, Incident Management, and Agile Methodologies