Are you passionate about economic fairness and social justice? Do you want to improve the lives of working people and strengthen the labor movement? If you answered, "Yes!" then the AFL-CIO may be the right place for you. We are the largest federation of labor unions in the United States, and our team of dynamic professionals is dedicated to growing worker power and ensuring every working person has a voice on the job. When you work at the AFL-CIO, you're more than just an individual employee' you're helping to lead a movement with a proud history and a bright future ahead.
OVERVIEW OF RESPONSIBILITIES:
The Lead Data Engineer will oversee the department's data integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis. This role will work closely and collaboratively with members of the
Data, Analytics, and Development teams to define requirements, mine and analyze data, integrate data from a variety of sources, and deploy high-quality data pipelines in support of the analytics needs of the AFL-CIO and its affiliates. They will also create and oversee an automated reporting system and manage other proprietary systems.
The Data, Analytics & Infrastructure Resource's (DAIR) goal is to generate lasting power for the labor movement by building the Federation's programmatic tools, web development, data systems, and analytics capacity. This team serves a broad range of clients across the labor movement - from other AFL-CIO departments to AFL-CIO affiliates to state and local labor bodies. Through investment in central infrastructure, training, and direct service work, the department aims to empower its partners to run stronger and more cost effective political and legislative mobilization, digital, and organizing campaigns.
This position reports to the Associate Director of Infrastructure in the Data, Analytics & Infrastructure Resource.
DESCRIPTION OF DUTIES:
● Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our central data warehouse and moving data out to applications and affiliates.
● Help maintain and build on our data warehouse and connected components, the home for almost all of the AFL-CIO's political and organizing data.
● Build reports and data visualizations using data from the data warehouse and other sources.
● Produce scalable, replicable code and engineering solutions that help automate repetitive data management tasks.
● Perform one-off data manipulation/munging and analysis on a wide variety of political and organizing data.
● Implement and monitor best-in-class security measures in our data warehouse and analytics environment, with an eye toward the evolving threat landscape.
● Help other DAIR staff troubleshoot their SQL, Python, or R code.
● Train other DAIR staff on these skills.
● Other duties as assigned.
QUALIFICATIONS:
● Bachelor’s degree in data engineering or similar field, or equivalent work experience.
● At least three years of work in a related field.
● Strong command of relational databases and SQL. Extract, Transform, and Load (ETL) data into a relational database.
● Proficiency with Python or R, especially for data manipulation and analysis, and ability to build, maintain and deploy sequences of automated processes with these tools.
● General data manipulation skills: read in data, process and clean it, transform and recode it, merge different data sets together, reformat data between wide and long, etc.
● Ability to learn new techniques and troubleshoot code without support, ex. find answers to common programming challenges on Google. In other words, be able to learn on the job.
● Write clear code that is well-documented and stored in a version control system (we use Git).
● Use APIs to push and pull data from various data systems and platforms.
● Experience working with cloud infrastructure services like Amazon Web Services and Google Cloud is preferred but not required.
● Experience with VoteBuilder, the LAN or VAN and digital organizing tools, like Action Network, ActionKit, or Blue State Digital, is a plus but not required.
● Experience with advanced data visualization and mapping are helpful, but not required.
● Ability to work long and extended hours as needed.
