Evaluation and Certification Specialist (Research Professional 5-Program Evaluation, 9791PV)

Position Overview

The Evaluation and Certification Specialist (Research Professional 5-Program Evaluation, 9791PV) is a 100% FTE University employee positioned in the Center for Advanced Studies in Child Welfare (CASCW) at the School of Social Work. CASCW has joined the Minnesota Department of Children, Youth, and Family (DCYF) in a joint project to co-create and operate the Minnesota Child Welfare Training Academy (MNCWTA). The Evaluation and Certification Specialist serves as a critical member of the integrated teams of DCYF and the University. This position will conduct evaluation of curriculum delivery/activities, learner knowledge/skill acquisition, and trainers. This position also contributes expertise to the development, implementation, and evaluation of the statewide certification program. There may be opportunities to publish research/evaluation findings to advance knowledge within the field of child welfare. 

A key component of the work will include evaluation of the MN African American Family Preservation and Child Welfare Disproportionality Act (MAAFPCWDA), which was passed in 2024 and seeks to promote family stability by establishing minimum standards to prevent the arbitrary removal of children from their families and improve permanency outcomes, including family reunification. In addition to New Worker Foundations training, as mandated for all new hires to county child protection agencies, MNCWTA also provides training for workers at all levels of experience to further their knowledge and skill in topics of relevance to their practice. This position will also be responsible for reviewing and refining competency measures to include MAAFPCWDA and will need to ensure that certification includes competency in MAAFPCWDA. 

This position will be located off-campus at the Minnesota Child Welfare Training Academy, which is two miles north of the St. Paul Campus.

The University of Minnesota encourages a healthy work life balance for employees. CEHD is committed to an excellent employee experience, offering a flexible work environment that meets the needs of students, staff, faculty, and the communities we serve. Flexible work arrangements may include flexibility in schedule and/or work location. 

Job Responsibilities
Conduct Academy Evaluation (Design, Implementation, and Reporting) and Certification (60%)

• Design and conduct evaluation relating to all aspects of the Academy, and specifically MAAFPCWDA: curriculum delivery/activities, learner knowledge/skill acquisition, trainers, the certification system, and the Academy
• Develop qualitative and quantitative data collection instruments including interview protocols, focus group protocols, surveys, rating scales, observations, and knowledge assessments to answer the relevant research/evaluation questions 
• Conduct qualitative and quantitative analyses of data collected for research/evaluation projects
  Interpret results and prepare written and oral reports, publications, and presentations of research and evaluation results to the Academy team, investigation partners, community stakeholders, state agency personnel, and/or the academic community (e.g., conference presentations, community presentations, etc.) as appropriate
• Contribute to the design(s) and maintenance of a certification system and gather ongoing feedback about the design(s), implementation, and management of the certification system, particularly related to the addition of MAAFPCWDA in the trainings offered, competencies required, and overall implementation and maintenance of certification
• Contribute to developing high-quality research-related deliverables including but not limited to research briefs, how-to guides on understanding scholarly research, on topics including but not limited to the child welfare workforce, professional well-being, child welfare training, and professional development

Database Management (30%)

• Oversee and lead the development and maintenance of relevant databases
• Maintain accurate and complete records/data
• Maintain data security and confidentiality
   

Administration and Supervision (10%)

• Act as project lead for multiple projects within the Academy
• Serve as point person for communication with Evaluation and Certification Supervisor when project lead
• As project lead, oversee and coordinate project staff and graduate students in the completion of projects
• Ensure the implementation of evaluation plans by following timelines and producing products and deliverables as agreed upon
• Maintain a safe, positive, productive, and collegial work environment respectful of culture and differences
• Participate in administrative activities and relevant meetings, as a part of the team within the Evaluation and Certification Unit, the Academy, or elsewhere as needed

Required Qualifications

• Advanced degree in social work, public health, evaluation, education, or related social science discipline with one or more years of research/evaluation training with related experience (e.g., experience in developing an evaluation design, conducting data collection and analysis, and reporting the findings)
• Demonstrated experience with coordinating activities and producing deliverables involving multiple large and small-scale projects implemented simultaneously 
• Strong professional writing skills as evidenced in technical reports, journal articles, or other print or electronic products 
• Demonstrated skill in qualitative and quantitative analysis 
• Demonstrated ability to translate findings into reports and presentations accessible by frontline practitioners and educators
• Knowledge of database management (entry, queries, etc.)
• Demonstrated organizational skills, including managing project deadlines, analyzing data and reports to check for errors and inaccuracies
• Established commitment to diversity and cross-cultural evaluation and communication
• Evidence of attention to diverse identities in professional experience, and the commitment to support the University’s work in diversity, equity, and inclusion.

Preferred Qualifications

• Three or more years of research/evaluation education with related experience
• Experience using methodologies specific to training evaluation measures in an educational, higher education, or social service agency
• Experience working with professional credentialing or certification program(s)
• Advanced knowledge of and experience working with statistical computing (e.g., SPSS or R) and data visualization software (e.g., Tableau)
• Child Welfare related experience, including an understanding of state/tribal social services
• Ability to build others’ capacity related to best practices in research/evaluation design, data analysis, and interpretation and to facilitate data-based decision-making
• Ability to work independently, as well as serve on a team, to make decisions to keep processes moving forward