Data Engineer
Aditya UUnited StatesSENIORPosted 6d ago
PythonSQLPySparkApache SparkDatabricksDelta LakeETLELTAWSAzureGCPData ModelingData QualityGitCI/CDdbtAirflow
About the Role
We are looking for an experienced Data Engineer to build scalable data platforms, optimize data pipelines, and support enterprise AI/analytics initiatives.
Key Responsibilities
• Build scalable data platforms
• Optimize data pipelines
• Support enterprise AI/analytics initiatives
Requirements
• 10+ years of Data Engineering experience
• Strong expertise in Python, SQL, PySpark, and Apache Spark
• Hands-on experience with Databricks and Delta Lake
• ETL/ELT pipeline development (Batch & Streaming)
• Medallion Architecture (Bronze/Silver/Gold)
• AWS, Azure, or GCP data services
• Spark job optimization and SQL performance tuning
• Data Modeling, Data Quality, and Validation
• Git, CI/CD, and production data pipelines
• Databricks Certification, Unity Catalog, dbt, and Airflow
• Strong problem-solving and client communication skills