Director of Data Engineering (Senior Public Service Administrator, Option 1)

Essential Functions

• Subject to management approval, serves as the Director of Data Engineering for the Department of Innovation & Technology (DoIT) supporting the Department of Early Childhood (IDEC), verifying that clean, organized, and timely data is available to downstream users, including designing, developing, evaluating, and maintaining scalable data pipelines and infrastructure to support analytics, reporting, and business intelligence needs.
• Directs, plans, and manages DoIT/IDEC Data Engineering Section databases and infrastructure management programs, including collaborating with DoIT and other stakeholders on various projects, using existing cloud-based data platforms (e.g., Amazon Web Services (AWS), Azure, IBM, CloudPad, Google Cloud).
• Directs, plans, and manages agency Data Engineering integration functions, including collaborating with agency executive leadership and DoIT data scientists, analysts, and software engineers to create trusted, high-quality, and scalable data systems. 
• Serves as a full-line supervisor.
• Performs other duties as required or assigned which are reasonably within the scope of the duties enumerated above.

Minimum Qualifications

• Requires knowledge, skill, and mental development equivalent to completion of four (4) years of college with coursework in business or public administration, data science, data engineering, analytics, or a directly related field.
• Requires prior experience equivalent to four (4) years of progressively responsible administrative experience in public or business organization in data science, data engineering, education policy, statistics, or economics.
• Requires three (3) years of professional supervisory experience in a large organization.

Preferred Qualifications (In Order of Significance)

• Five (5) years of professional experience designing and developing complex structured and unstructured data architectures and ETL/ELT pipelines using Python, Structured Query Language (SQL), Databricks, and Data Build Tool (DBT), including managing cloud-based platforms (e.g., Amazon Web Services [AWS], Azure, or Google Cloud) and implementing scalable storage and computing solutions that support analytics and downstream users. 
• Five (5) years of professional experience overseeing and maintaining enterprise ETL/ELT transformation models, modular DAG workflows, incremental processing strategies, and semantic layer configurations.
• Five (5) years of professional experience applying data modeling, governance, quality assurance, cataloging, and lineage practices, including supporting Batch, Near Time, or Real Time Streaming data processes, including those that leverage built-in Artificial Intelligence (AI)/Machine Learning (ML) models, to maintain data accuracy, consistency, integrity, and compliance with applicable privacy and security requirements.
• Five (5) years of professional experience designing and maintaining data lakes/warehouses (e.g., SQL Server. Databricks, Snowflake, Startburst, BigQuery or Azure Fabric/Synapse).
• Four (4) years of professional experience building normalization and aggregation views in a medallion architecture for consumption in GIS systems, Agency portals, Reports, and interactive dashboards (Including Tableau and PowerBI), that contribute to improving decision-making, transparency, and verifying timely mandated report submissions.
• Four (4) years of professional experience modernizing data infrastructure to automate and improve performance, reliability, efficiency, and cost-effectiveness, including data quality profiling, error handling and alerting, performance monitoring, troubleshooting, and optimizing data workflows and distributed processing. 
• Four (4) years of professional experience developing electronic step-by-step procedures for pipelines, architectures, or workflows, including onboarding staff, supporting audits and quality control, and collaborating on privacy training and awareness programs. 
• Two (2) years of professional experience leading teams in delivering CI/CD frameworks, including schema design, managing branching strategies, managing incremental strategies, workflow triggers, automated testing, deployment gates, and production change management to support reliable and reproducible data engineering operations. 
• Two (2) years of professional experience maintaining compliance in firms with regulatory oversight, with requirements under Family Educational Rights and Privacy Act (FERPA), Health Insurance Portability and Accountability Act (HIPAA), General Data Protection Regulation (GDPR), Children’s Online Privacy Protection Act (COPPA), or similar state or federal policies, including implementing encryption, role-based access controls, and breach notification procedures.
• Master’s Degree with coursework in one or more of the following: Information Management, Data Science, Data Analytics, Computer Science, Data Engineering, Information Systems, or similar directly related degrees. 

Conditions of Employment

NOTE: Applicants must possess the ability to meet ALL of the following conditions of employment, with or without reasonable accommodation, to be considered for this position. 

• Requires the ability to verify identity.
• Requires employment authorization to accept permanent full-time position with the State of Illinois.
• Requires the ability to pass a position specific, agency required background check and requires self-disclosure of criminal history. 
• Requires a valid driver’s license and the ability to travel, including occasional overnight stays.
• Requires the ability to use agency supplied equipment such as laptop, personal computer, work cell phone, etc. 
• Requires the ability to work outside of normal hours to meet deadlines. 
• Requires the ability to work overtime including scheduled, unscheduled, short notice, evening, weekends, and holidays. 
• Requires adherence to the revolving door restrictions outlined in 5 ILCS 430/5-45. Consequently, employees should be aware that in the event of receiving a non-State employment offer during state employment or within one year immediately following the termination of State employment, they are required to inform the Office of the Executive Inspector General for the Agencies (OEIG) of the Illinois Governor before accepting such non-State employment. Failure to notify the OEIG may result in the imposition of a fine. 
• Requires compliance with the provisions outlined in section 4A-101 of the Illinois Governmental Ethics Act, necessitating the occupant of this position to file of a Statement of Economic Interest. Pursuant to the Illinois Governmental Ethics Act (5 ILCS 420/4A et seq.), specific state officials and employees are required to annually submit Statements of Economic Interest to the Office of the Secretary of State, which will be accessible to the public for examination and copying. Employees subject to this requirement must also file a Supplemental Statement of Economic Interest with the Executive Ethics Commission, as specified in Executive Order 15-09. Failure to submit these statements in a timely manner may result in fines and penalties. 
• The conditions of employment listed are incorporated and/or related to any duties included in the position description.