Job Class Search

Job Details

Data Engineer

The Data Engineer plays a crucial role in managing, optimizing, and integrating data systems that support a department's data infrastructure. The Data Engineer will work collaboratively with data architects, business analysts, and other stakeholders to design, implement, and maintain data pipelines and databases that ensure the efficient processing and management of state data. The role requires a strong technical background in database management, data integration, and data quality, as well as an understanding of data governance and security protocols in a government environment. This position demands a combination of technical skills, attention to detail, and the ability to work effectively in a team-based environment.

Class Code:

IDA02C

Job Grade:

IST12

Special Job Requirements:

Typical Functions:

Design, build, and maintain scalable data pipelines to ingest, transform, and load (ETL/ELT) data from various sources into data warehouses or other storage solutions. Optimize data processing workflows to ensure the efficient, timely, and accurate movement of data across systems. Work with cross-functional teams to integrate new data sources into the existing data architecture, ensuring data quality and consistency. Develop and manage relational and non-relational databases, ensuring their scalability and performance. Collaborate with data architects to design database structures that support data modeling and reporting needs. Monitor and manage database performance, troubleshoot issues, and optimize queries for improved performance. Implement data quality standards and validation processes to ensure the accuracy, consistency, and completeness of data across all systems. Perform data cleansing and transformation tasks to prepare raw data for analytics and reporting. Collaborate with data analysts and other teams to ensure data meets reporting and analytical requirements. Work closely with business units, IT teams, and data architects to understand data requirements and ensure data systems meet business and technical needs. Assist in the creation of data models and schemas that support various reporting and analytical requirements. Implement and maintain data security measures, ensuring data is protected in compliance with state and federal regulations. Participate in the creation of data governance policies and ensure that data access and usage adhere to regulatory and organizational standards. Monitor and enforce data governance procedures to ensure data privacy, integrity, and security. Work with cloud platforms (e.g., AWS, Azure, Google Cloud) to manage and optimize cloud-based data solutions and services. Implement cloud-based data storage solutions and ensure their efficiency, scalability, and security. Automate repetitive data processing tasks and workflows to increase efficiency and reduce errors. Optimize existing data systems and workflows to improve processing speed and scalability.

Knowledge, Abilities, and Skills:

Proficiency in SQL and NoSQL database technologies (e.g., MySQL, PostgreSQL, MongoDB). Strong knowledge of ETL/ELT processes, including experience with data integration tools (e.g., Apache Kafka, Talend, Informatica). Experience with cloud-based data platforms such as AWS, Microsoft Azure, or Google Cloud. Strong programming skills in languages such as Python, Java, or Scala for data engineering tasks. Knowledge of big data technologies such as Hadoop, Spark, and distributed data processing frameworks. Familiarity with data warehousing concepts and technologies. Experience with data pipeline orchestration tools (e.g., Apache Airflow, AWS Glue).

Minimum Qualifications:

A Bachelor’s degree in Computer Science, Information Technology, Data Science, or a related field is required, plus at least five (5) years of experience in data engineering, data management, or a related field.

Required Certificates:

N/A OTHER JOB RELATED EDUCATION AND/OR EXPERIENCE MAY BE SUBSTITUTED FOR ALL OR PART OF THESE BASIC REQUIREMENTS, EXCEPT FOR CERTIFICATION OR LICENSURE REQUIREMENTS, UPON APPROVAL OF THE QUALIFICATIONS REVIEW COMMITTEE.

Exempt:

E
Scroll to Top