February 2013 Assessment

Recent Curriculum Changes

The committee on assessment data reviews results at each data collection point. Significant findings are raised at the curriculum committee and faculty meeting level when needed. Otherwise results are distributed among faculty and discussed at faculty meeting on an annual basis. Depending upon findings and suggestions, assignments are made for follow up within subcommittees.

Most recently after reviewing data regarding students’ learning as it applies to working with families and groups it became evident through the exit survey, field evaluation, course evaluation and focus groups that students did not feel they received an in depth enough learning experience with groups or families. In response, the curriculum committee in tandem with the faculty devised a solution by devising two courses, one dealing specifically with groups and another dealing specifically with families and couples. The field education department interceded by dialoguing with placements regarding the need to strengthen students’ opportunities in these two areas.

Additionally, based on feedback from the Graduate Student Review Committee, the Field Education Department, field liaisons, and Field Evaluations, a second year advanced integrative seminar course was developed to enhance, support, and supplement professional development and add an extra layer of monitoring to make certain student reach professional development goals.

Another initiative underway is the offering of courses in a blended format to both enhance teaching and learning and offer students the opportunity to take classes in a format that may be more suitable for the complexity of their lives.

Our Assessment Plan, Currently Underway

Method of Measurement	Type of Measure	Frequency	Status of Measurement Development	Core Competencies Addressed
1. Embedded Measure: Practice I Standardized Test	Direct	Biannually	Currently being developed.	1, 2, 3, 4, 7, 8, 9, 10
2. Embedded Measure: Practice III Standardized Test	Direct	Annually	Currently being developed.	1, 2, 3, 4, 7, 8, 9, 10
3. Embedded Measure: HBSE III midterm/rubric	Direct	Annually	Piloted across all sections, fall 2012.	1, 3, 6, 7, 10
4. Embedded Measure: Policy I test	Direct	Biannually	Piloted in 2 sections, fall 2012.	1, 5, 8, 9
5. Course Evaluations	Indirect	Triannually	Developed and being utilized each term.	All
6. Field Evaluations	Direct	Biannually	Items in foundation and advanced year field evaluations linked to practice behaviors. Some refinement underway.	All
7. Embedded Measure: Foundation HBSE Standardized Test	Direct	Annually	In development, to be piloted spring 2013 (end of HBSE II) across all sections.	2, 3, 4, 5, 6, 7, 9, 10
8. Embedded Measure: Standardized Policy Test	Direct	Annually	In development, to be piloted spring 2013 (end of Policy II) across all sections.	3, 4, 5, 6, 8, 9
9. Embedded Measure(s): Research	Direct	To be decided	Assignments that may lend themselves to being used/developed as an embedded measure are currently being considered.	To be decided
10. MSW Exit Survey	Indirect	Annually	Revisions underway.	All
11. Alumni Survey	Indirect	Triennially	Revisions underway.	All
12. Focus Groups	Indirect	Annually	Revisions underway.	All

Student Learning Outcomes, Early Results

COMPETENCY	COMPETENCY BENCHMARK	PERCENT OF STUDENTS ACHIEVING BENCHMARK
	80% students achieve competence as measured by:   a) Course Evaluations (student self-report) b) Policy I Embedded Measure c) HBSE III Embedded Measure (Brief descriptions of these measures can be found below.)	Clinical Social Work CONCENTRATION	Please note: We did not list an overall, composite score for each competency as the data represented here are only part of the overall assessment plan. A critical direct measure of student learning, the field evaluation, is not yet available. (Earlier field evaluations were analyzed according to EPAS 2001 standards.) Additionally, both of the embedded measures were piloted for the first time this term and are in the process of being refined.
Identify as a Professional Social Worker		a. 90% b. 82% c. 89%
Apply Ethical Principles		a. 89%
Apply Critical Thinking		a. 90% c. 75%
Engage Diversity in Practice		a. 90%
Advance Human Rights/ Social and Economic Justice		a. 90% b. 33%
Engage Research Informed Practice/Practice Informed Research		a. 91% c. 68%
Human Behavior Knowledge		a. 92% c. 90%
Engage Policy Practice to Advance Well-Being and Deliver Services		a. 91% b. 33%
Respond to Practice Contexts		a. 90% b. 80%
Practice Engagement		a. 92%
Practice Assessment		a. 92% c. 90%
Practice Intervention		a. 91%
Practice Evaluation		a. 93%

 

Measures Represented in Assessment of A Student Learning Outcomes Table

The Social Welfare Policy I Embedded Measure piloted in the fall of 2012 is a test with 3 subsets of questions used to measure Competencies 1,5, 8, & 9. The subsets are a) questions focused on the history of social work and the development of the social work identity, b) questions on political ideology, history of social welfare policy development, economic ideas that frame social welfare policy development, policy analysis data, and c) questions about the impact of policy on specific populations, and myths in popular perceptions about policy and the poor.

The HBSE III: Issues and Perspectives in Psychopathology Embedded Measure piloted in the fall of 2012 is a case paper assignment, components of which are used to measure Competencies 1, 3, 6, 7, and 10b. This assignment engages the students in a) generating a 5-axis diagnosis and documenting the process, b) identifying and discussing examples of specific criteria involved in the diagnoses considered that require an evaluative judgment to be made, based on such things as varied understandings of normative behavior, language that is open to interpretation, and a clinical threshold that is represented in non-specific terms, and c) identifying effective treatment approaches in the literature that address prominent symptoms displayed by the client presented or a specific disorder the student has ruled in based on DSM-IV TR criteria.

We are examining methodological issues that have arisen for both measures and are in the process of refining them.
All Course Evaluations have a section that asks students to extent to which they have achieved competence for each course objective on a 5-point Likert scale, “To a great extent” and 1 representing “Not at all.” We have deemed scores of 4 or 5 to reflect competence for that course objective.

Competencies and Practice Behaviors as Measured by Course Evaluations, Fall 2013

2.1.1 Identify as a professional social worker and conduct oneself accordingly.
Average score for competency across practice behaviors: 91%

Competency #	Practice Behavior	Course and Objective #’s	Average per course	Average across courses
2.1.1 a	Advocate for client access to the services of social work.	SW670: 3	89%	89%
2.1.1b	Practice personal reflection and self-correction to assure continual professional development.	SW650: 5 SW660: 7 SW750: 5, 7 SW760: 3 SW761: 3	92% 83% 94% 87% 100%	91%
2.1.1c	Attend to professional roles and boundaries.	SW650: 4 SW750: 8	95% 88%	92%
2.1.1d	Demonstrate professional demeanor in behavior, appearance, and communication	SW750: 8 SW760: 8	88% 93%	91%
2.1.1e	Engage in career-long learning.	SW 680: 8 SW750: 7	93% 93%	93%
2.1.1f	Use supervision and consultation
2.1.1g	Develop, manage and maintain with increasing sophistication the therapeutic relationship with clients within the person-in-environment and strengths-based perspectives. *	SW750: 1, 2, 8	91%	91%
2.1.1h	Demonstrate understanding of the social work role in organizational settings. *	SW750: 3, 9	92%	92%

 

2.1.2 Apply social work ethical principles to guide professional practice.
Average score for competency across practice behaviors: 89%

Competency #	Practice Behavior	Course and Objective #’s	Average per course	Average across courses
2.1.2a	Recognize and manage personal values, including personal biases, in a way that allows professional values to guide practice.	SW650: 4, 5 SW660: 7 SW750: 4, 5, 8 SW760: 1, 3 SW761: 3	94% 83% 91% 88% 100%	91%
2.1.2b	Tolerate ambiguity in resolving ethical conflicts	SW750: 8 SW760: 1, 2	88% 88%	88%
2.1.2c	Apply strategies of ethical reasoning to arrive at principled decisions.	SW 680, #3,4	83%	83%
2.1.2d	Make ethical decisions by applying standards of the National Association of Social Workers Code of Ethics and, as applicable, of the International Federation of Social Workers/International Association of Schools of Social Work, Statement of Principles.	SW650: 4 SW670: 8 SW 680, #3,4	95% 92% 83%	90%
2.1.2e	Identify and use knowledge of relationship dynamics, including an awareness of potential misuses of power in the therapeutic relationship. *	SW750: 1, 4, 8, 9 SW761: 2, 6	90% 94%	92%

 

2.1.3 Apply critical thinking to inform and communicate professional judgments.
Average score for competency across practice behaviors: 90%

Competency #	Practice Behavior	Course and Objective #’s	Average per course	Average across courses
2.1.3a	Distinguish, appraise, and integrate multiple sources of knowledge, including research-based knowledge, and practice wisdom.	SW650: 1, 9, 10 SW660: 1, 6 SW 680: 1,6,8 SW750: 2, 3, 5, 6, 7 SW760: 2, 4, 7, 9 SW761: 7, 10	90% 82% 87% 93% 91% 91%	89%
2.1.3b	Analyze models of assessment, prevention, intervention, and evaluation.	SW650: 2, 6, 9,10 SW 680: 1,5,6 SW750: 2, 3, SW760: 5	92% 86% 92% 87%	89%
2.1.3c	Demonstrate effective oral and written communication in working with individuals, families, groups, organizations, communities, and colleagues.	SW760: 8	93%	93%
2.1.3d	Differentially apply models of assessment, prevention, intervention, and evaluation to client situations. *	SW750: 2, 3, 5, 8	92%	92%

 

2.1.4 Engage diversity and difference in practice.
Average score for competency across practice behaviors: 90%

Competency #	Practice Behavior	Course and Objective #’s	Average per course	Average across courses
2.1.4a	Recognize the extent to which a culture’s structures and values may oppress, marginalize, alienate, or create or enhance privilege and power.	SW650: 8 SW660: 5 SW670: 1,2,3 SW680: 3,4 SW750: 4, 6 SW760: 1, 2, 6 SW761: 1, 4	95% 81% 90% 83% 91% 89% 97%	89%
2.1.4b	Gain sufficient self-awareness to eliminate the influence of personal biases and values in working with diverse groups.	SW650: 5 SW660: 7 SW750: 4 SW760: 3 SW761: 3	92% 83% 88% 87% 100%	90%
2.1.4c	Critically analyze the differential impact of the social environment as it relates to variables associated with populations at risk, including age, class, race, culture, ability, gender, gender identity and expression, immigration status, mental health status, political ideology, religion, sexual orientation and other differences as they arise.	SW650: 8 SW660: 3 SW670: 5 SW680: 7 SW750: 4, 6 SW760: 6 SW 761: 4, 5	95% 78% 81% 89% 91% 90% 100%	89%
2.1.4d	Recognize the unique needs, interests, strengths and challenges among diverse groups in society.	SW650: 8 SW660: 4 SW680: 7 SW750: 2, 3, 4, 6 SW760: 6 SW761: 4, 5	95% 86% 89% 92% 90% 100%	92%
2.1.4e	Recognize oneself as a learner and engage those with whom one works as informants.	SW650: 5 SW750: 1, 2, 3, 5, 7, 9 SW761: 2	92% 93% 88%	91%
2.1.4f	Research and apply knowledge of diverse populations to provide culturally competent practice. *	SW750: 4, 6 SW761: 10	91% 94%
2.1.4g	Identify and use practitioner/client differences in service of the therapeutic alliance. *	SW750: 1, 4	89%

2.1.5 Advance human rights and social and economic justice.
Average score for competency across practice behaviors: 90%

Competency #	Practice Behavior	Course and Objective #’s	Average per course	Average across courses
2.1.5a	Understand the forms and mechanism of oppression and discrimination.	SW650: 7 SW660: 2, 5 SW670: 1,3,4 SW680: 3,4 SW760: 2, 6 SW761: 4,6,7	92% 82% 88% 83% 89% 96%	90%
2.1.5b	Advocate for human rights and social and economic justice.	SW670: 7	84%	84%
2.1.5c	Engage in practices that advance social and economic justice.	SW650: 7 SW670: 3	92% 89%	91%
2.1.5d	Integrate a human rights and social justice perspective into advanced clinical practice approach. *	SW750: 4, 6 SW761: 8	91% 100%	96%

 

2.1.6  Engage in research-informed practice and practice informed research.
Average score for competency across practice behaviors: 91%

Competency #	Practice Behavior	Course and Objective #’s	Average per course	Average across courses
2.1.6a	Use practice experience to inform scientific inquiry.	SW680: 2,5 SW750: 5	89% 94%	92%
2.1.6b	Use research findings to inform practice.	SW650: 10 SW660: 6 SW670: 2,4 SW680: 1,2,5,6 SW750: 2, 3, 5 SW760: 7 SW761: 10	90% 78% 89% 87% 93% 92% 94%	89%
2.1.6c	Use research methodology to evaluate clinical practice effectiveness and/or outcomes. *	SW680: 5,6,8, SW750: 5, 7	89% 94%	92%

 

2.1.7 Apply knowledge of human behavior and the social environment.
Average score for competency across practice behaviors: 92%

Competency #	Practice Behavior	Course and Objective #’s	Average per course	Average across courses
2.1.7a	Utilize conceptual frameworks to guide the process of assessment, intervention, and evaluation.	SW650: 1 SW660: 1 SW 680, #5 SW750: 2, 3, 5 SW760: 5 SW761: 6	88% 86% 91% 93% 87% 100%	91%
2.1.7b	Critique and utilize bio-psycho-social-spiritual theories in formulation of comprehensive assessments.	SW650: 9 SW660: 6 SW750: 2, 3, 4, 6 SW760: 2, 6 SW761: 5	93% 78% 92% 89% 100%	90%
2.1.7c	Critique and differentially apply theories of human behavior and the social environment to guide clinical practice. *	SW761: 2	88%	88%
2.1.7d	Utilize knowledge of multi-axial diagnostic classifications, neuroscience and medications (psychotropic and other) in clinical practice appropriate to the context. *	SW760: 9	97%	97%

2.1.8  Engage in policy practice to advance social and economic well being and to deliver social services.
Average score for competency across practice behaviors: 91%

Competency #	Practice Behavior	Course and Objective #’s	Average per course	Average across courses
2.1.8a	Analyze, formulate, and advocate for policies that advance social well being.	SW670: 4,7,8,9	89%	89%
2.1.8b	Collaborate with colleagues and clients for effective policy action.	SW750: 9	94%	94%
2.1.8c	Facilitate client self-advocacy.	SW650: 9 SW750: 2, 3, 4	93% 91%	92%
2.1.8d	Recognize the ways in which policies shape clinical practice and the opportunities to impact and measure this process. *	SW660: 2 SW750: 3, 6 SW760: 2 SW761: 7	82% 92% 88% 88%	88%

 

2.1.9  Respond to contexts that shape practice.
Average score for competency across practice behaviors: 90%

Competency #	Practice Behavior	Course and Objective #’s	Average per course	Average across courses
2.1.9a	Demonstrate awareness of changing locales and populations and of emerging social trends, in order to provide relevant services.	SW650: 7, 8 SW670: 2,4, 5 SW 680, #8 SW750: 3, 4, 6 SW761: 1	94% 87% 93% 90% 94%	92%
2.1.9b	Demonstrate awareness of scientific and technological advances in order to provide relevant services.	SW650: 1, 7, 10 SW670: 6 SW750: 2, 3, 4, 5	90% 83% 92%	88%
2.1.9c	Provide leadership in promoting sustainable changes in service delivery and practice to improve the quality of social services.	SW650: 7 SW670: 8,9 SW750: 6	92% 91% 93%	92%
2.1.9d	Develop intervention plans to accomplish systemic change.	SW750: 3, 4	89%	89%
2.1.9e	Assess the quality of client interactions within their evolving organizational, community and societal contexts.	SW650: 7 SW670: 2 SW750: 2, 3, 4, 6	92% 92% 92%	92%
2.1.9f	Work collaboratively with others to effect systemic changes. *	SW750: 3, 4, 9	89%	89%

 

2.1.10 Engage, assess, intervene, and evaluate with individuals, families, groups, organizations, and communities.
a. ENGAGEMENT
Average score for competency across practice behaviors: 92%

Competency #	Practice Behavior	Course and Objective #’s	Average per course	Average across courses
2.1.10a	Substantively and affectively prepare for action with individuals, families, groups, organizations, and communities.	SW650: 1-10 SW750: 2, 3, 4, 5, 6, 8	92% 91%	92%
2.1.10b	Use empathy and other interpersonal skills.	SW650: 5, 6 SW750: 2, 3, 4	93% 92%	93%
2.1.10c	Develop a mutually agreed-on focus of work and desired outcomes.	SW650: 3 SW750: 2,3, 4, 5	88% 91%	90%
2.1.10d	Attend to the interpersonal dynamics and contextual factors that both strengthen and challenge the therapeutic alliance. *	SW650: 7 SW750: 1, 2, 3, 4, 6, 8	92% 92%	92%

 

b.  ASSESSMENT
Average score for competency across practice behaviors: 92%

Competency #	Practice Behavior	Course and Objective #’s	Average per course	Average across courses
2.1.10e	Collect, organize, and interpret client data.	Sw650: 3, 5, 6, 8, 9 SW750: 2, 3, 4, 5 SW760: 5, 9	92% 91% 92%	92%
2.1.10f	Assess client strengths and limitations.	SW650: 3, 5, 6, 8, 9 SW750: 2, 3, 4	92% 92%	92%
2.1.10g	Develop mutually agreed-on intervention goals and objectives.	SW650: 3 SW750: 3	88% 90%	89%
2.1.10h	Select appropriate intervention strategies.	SW650: 3, 10 SW750: 3, 5,7	89% 92%	91%
2.1.10i	Use multidimensional assessment tools to assess clients and their relationship to the environment. *	SW650: 1, 2, 3, 6, 9, 10 SW750: 2, 3, 4, 5, 6 SW760: 2, 4, 5, 9 SW761: 7	90% 91% 89% 88%	90%
2.1.10j	Use differential and multi-axial diagnosis. *	SW760: 9	97%	97%

c. INTERVENTION
Average score for competency across practice behaviors: 91%

Competency #	Practice Behavior	Course  and Objective #’s	Average per course	Average across courses
2.1.10k	Initiate actions to achieve organizational goals.
2.1.10l	Implement prevention interventions that enhance client capacities.	SW750: 3	90%	90%
2.1.10m	Help clients resolve problems.	SW650: 3, 9 SW750: 3, 4	91% 89%	90%
2.1.10n	Negotiate, mediate, and advocate for clients.	SW650: 9 SW750:3, 4, 6	93% 90%	92%
2.1.10o	Facilitate transitions and endings.	SW750: 3	90%	90%
2.1.10p	Effectively facilitate the therapeutic relationship with purpose and discipline. *	SW750: 1, 2, 3, 4, 8	90%	90%
2.1.10q	Select and modify best practices and evidenced based intervention strategies based on continuous clinical assessment. *	SW750: 2, 3, 5, 7	93%	93%

 

d. EVALUATION
Average score for competency across practice behaviors: 91%

Competency #	Practice Behaviors	Course and Objective #’s	Average per course	Average across courses
2.1.10r	Social workers critically analyze, monitor, and evaluate interventions.	SW650: 1, 10 SW750: 3, 5, 7	89% 92%	91%
2.1.10s	Use evaluation to foster self-reflection in improving clinical skills. *	SW761: 9 SW750: 3, 5, 7	97% 92%	95%

 

* Advanced Practice Behavior