Loading...
SeniorFull-timeAzureAgileCI/CDGit
Salary Range
$26,520 - $35,880 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are seeking a Data Engineer to design, build, and optimize scalable ETL/ELT pipelines using PySpark and Databricks. This role involves developing data ingestion frameworks and implementing solutions on Azure Cloud.
Key Responsibilities
- →Design, build, and optimize scalable ETL/ELT pipelines using PySpark and Databricks
- →Develop and maintain data ingestion frameworks for batch and streaming data processing
- →Write efficient and optimized SQL queries for data transformation and performance tuning
- →Implement data solutions on Azure Cloud (Azure Data Lake, Azure Data Factory, Azure Synapse, etc.)
- →Collaborate with data architects, analysts, and business teams to understand data requirements
- →Ensure data quality, governance, and security best practices are followed
- →Monitor pipeline performance and troubleshoot data workflow issues
- →Work with CI/CD and version control processes for data engineering deployments
- →Participate in design discussions and recommend improvements in data architecture
Requirements
- ✓Strong hands-on experience with PySpark and distributed data processing
- ✓Advanced SQL development and query optimization skills
- ✓Experience working with Databricks (notebooks, jobs, workflows, Delta Lake)
- ✓Good understanding of Azure cloud services related to data engineering
- ✓Experience in building scalable data pipelines and data lakes
- ✓Strong understanding of data modeling and ETL concepts
- ✓Familiarity with Git and Agile development methodologies
Free to sign up. Takes 30 seconds.
About weekdayworks
Weekdayworks is a digital solutions provider specializing in web development, design, and online marketing services. Operating in the technology and digital services industry, the company focuses on creating efficient, user-friendly online experiences for businesses. While the exact founding date and location are not specified, the name suggests a commitment to delivering consistent, weekday-based support and solutions, likely catering to clients who require reliable digital services during standard business hours. The company offers a range of products and services, including custom website development, responsive design, SEO optimization, and content marketing. Key features of their offerings include tailored solutions to meet specific business needs, a focus on performance and scalability, and integration with modern technologies. Weekdayworks targets small to medium-sized enterprises, startups, and professionals seeking to establish or enhance their online presence with practical, results-driven digital strategies. Their approach emphasizes clarity, efficiency, and alignment with client objectives. Weekdayworks distinguishes itself through a client-centric methodology, prioritizing transparency and measurable outcomes. The company has built a reputation for delivering projects on time and within scope, leveraging agile practices to adapt to evolving client requirements. By combining technical expertise with creative design, Weekdayworks positions itself as a trusted partner for businesses aiming to grow their digital footprint in a competitive online landscape.
