Senior Data Engineer at CityOfNewYork

Authorization to work in the United States is required for this position. The NYC Department of City Planning does not offer sponsorship, of any kind, for any type of employment opportunity. Applicants are responsible for ensuring that they meet all minimum qualifying requirements for this position at the time of application. THE AGENCY The Department of City Planning (DCP) plans for the future of New York City, working to create thriving and dynamic neighborhoods with access to housing and jobs, resilient infrastructure, and a vibrant public realm. The Department engages communities to develop inclusive plans, expands housing access and economic opportunity, and plans for long-term sustainability. DCP supports the City Planning Commission in its annual review of hundreds of land use applications. The Department also advises on citywide strategic and capital planning, analyzes data, conducts policy analysis, and creates open data and civic engagement tools. The Department of City Planning offers staff meaningful opportunities to help shape the future of New York City and address some of its most pressing challenges. The Department values public service, collaboration, and creativity, and supports professional development. Learn more about DCP and view current job openings at www.nyc.gov/planning. THE DIVISION Information Technology Division’s (ITD) vision is to become a dynamic and vibrant technology delivery organization of the New York City government that leads business transformations and technology innovations to enable citizen-centric smart urban planning, while promoting a culture of collaboration, talent development, and equity. ITD is responsible for developing technology solutions to support agency needs and citywide requests, including City Charter mandates, grant funding requirements, and citywide geospatial services, and maintaining systems infrastructure and endpoint assets, to optimize operational efficiency, promote innovation, and collaborate with other city agencies to enhance service accessibility to citizens. The division provides necessary computing infrastructure and productivity-enhancing technology tools in a hybrid mode (on premise and in the cloud), to support DCP’s interdisciplinary staff across five boroughs, including planners, urban designers, project managers, and executive management. The division is comprised of experienced and talented software engineers, geographic specialists, service engineers, and technology leaders who specialize in managing system infrastructure, cyber security, geospatial data engineering, application services, and portfolio management. Within ITD, the Geographic Data and Engineering (GDE) unit consists of application engineering, data engineering, geographic information systems, and geographic research teams, responsible for creating and implementing the agency’s data strategy and data governance policy, updating and maintaining core citywide datasets in support of 911 dispatch and critical city operations, improving the creation, use, and availability of geospatial datasets within the agency, and providing data products and map-based visualization systems for the agency, other agencies, and the public. THE ROLE GDE is seeking a Senior Data Engineer to join the Data Engineering team, whose mission is to create and publish high quality public datasets, build transparent and automated data pipelines using open-source technologies, develop a data ecosystem by offering comprehensive documentation and analytics resources, and bring people together across teams and agencies to share data and learn from each other. The Data Engineering team is continually evolving, and this new hire will have the ability and support to improve existing infrastructure and processes and drive forward new projects and initiatives. The ideal candidate will be excited about advancing the adoption of new technologies in DCP and City government and passionate about data production, quality, and accessibility. Under limited supervision and general direction, with considerable latitude for the exercise of independent judgment, the Senior Data Engineer’s responsibilities include, but may not be limited to: - Designing, deploying, and scaling of current infrastructure to ensure that Data Engineering maintains and improves existing processes, and expands its abilities and offerings. - Understanding the technologies used by the team and recommending new technologies. Ideating, designing, and implementing improvements to products and processes to ensure that the team is using the best tools for the job. Being a technical leader on the team and taking ownership over parts of the team’s infrastructure. - Building Data Engineering data products, which involves: + operating data ingestion pipelines and managing data storage, + running scripts that transform input data by standardizing text fields, geocoding, merging, aggregating, and performing basic spatial manipulations, + reviewing outputs by writing custom scripts and/or using established QAQC tools to identify errors, inconsistencies, and edge cases in datasets, and + having comprehensive understanding of the data and transformations that constitute each. - Designing new data products from concept to completion, working on specifications with product owners, creating technical designs with team members, helping to plan sprints, contributing to documentation, and delivering a finished product. - Collaborating with other data engineers in planning, design, code review, and pair programming. - Managing the execution of significant projects. - Learning and wrangling complex legacy data systems and bringing the infrastructure into a modern development stack. - Sharing accomplishments and lessons learned with NYC Planning, other city agencies, and the world via talks, presentations, blogs, or other mediums. Please visit: [Upgrade to PRO to see link] and follow the steps below: 1. Search for job ID number: 774498 2. Click on the job business title: Senior Data Engineer 3. Click on “Apply Now” at the bottom of the posting Note: All interested candidates must submit their applications via [Upgrade to PRO to see link] Applications via regular mail, fax or e-mail will not be accepted. PLEASE NOTE: Authorization to work in the United States is required for this position. The NYC Department of City Planning does not offer sponsorship, of any kind, for any type of employment opportunity. Applicants are responsible for ensuring that they meet all minimum qualifying requirements for this position at the time of application. Only applicants under consideration will be contacted. Appointments are subject to Office of Management and Budget (OMB) approval. The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy. This position may be eligible for remote work up to 2 days per week, pursuant to the Remote Work Pilot Program agreed to between the City and Labor Unions. NOTE: If you would like to request a reasonable accommodation during your visit or have questions regarding the accessibility of our facilities, please reach out to [Upgrade to PRO to see contact] or call 212-720-3508 at least three business days prior to your arrival. IT AUTOMATION AND MONITORING E - 95712