Findings/Results

When you present your findings please remember to focus the data presentation and discussion to those findings that explore student achievement related to your program level student learning outcomes.

 

A few key items to include in your data presentations and summary discussions are indicated below:

Method of demonstrating acquisition of and competency levels related to the departmental student learning outcomes: Capstone Project, at the end of their final semester students will submit a completed capstone project that is intended to provide students with an opportunity to synthesize the skills and knowledge they have gained in their academic program.

Instrument: Rubric - please upload a copy of your instrument into the document repository in our online software.

Description of Instrument: The rubric is designed to evaluate student competency levels related to departmental student learning outcomes as demonstrated through oral communication and written exposition.

 

Sampling Schedule: At the end of fall and spring semester capstone course.

 

Sample Size:  Include your sample size.

 

Date This Sample Gathered: Semester sample gathered, different from sampling schedule/plan.

 

Relationship to Student Learning Outcomes: If you look at the table below (Table 1), you can see that the instrument (Capstone Rubric) is designed to evaluate student competencies related to outcoms 1, 2, 3, and

Minimal Acceptable competency level: Please indicate the minimal acceptable performance level, this is different than your benchmark (see Achievement Targets for clarification)

Achievement target, aspirational competency level: Please indicate the performance level you would like to see all of your students to achieve (in a perfect world).

 

Brief Summary Discussion of Results:  Please briefly discuss your results.  You may compare them to national data if appropriate, to your historical data, indicate change in student competencies since you have made changes in curriculum.  Please discuss any highlights, strengths or weaknesses.

 

 

Data Presentation Samples

Sample 1.

Sample 2.

Sample 3.

 

The sample table below indicates the findings for the capstone project for four of the five student learning outcomes.

 Table 1. Findings For Capstone Project by Student Learning Outcomes, Fall 2012 and Spring 2013

n = 53

Exemplary (4)

Above Average (3)

Average (2)

Below Average (1)

Nonexistent (0)

 

#

%

#

%

#

%

#

%

#

%

Outcome #1 Critical Thinking

5

9

9

17

22

42

17

32

0

0

Outcome #2 Statistics

4

8

7

13

36

68

6

11

0

0

Outcome #3 Research Methods

4

8

13

25

32

60

4

8

0

0

Outcome #4 Theory

5

9

12

23

34

45

2

4

0

0

Outcome #5 Collaborative Skills

Not measured on this project.

 

 When presenting findings in our online software, we present and discuss results under each measure separately for each student learning outcome.

 

e.g. M1 and SLO1; results and key elements and summary discussion.

 

M1 and SLO2; results, key elements and summary discussion.

 

M1 and SLO3; results, key elements and summary discussion.

 

M1 and SLO 4 results, key elements and summary discussion.

 

Sample Data Presentation 1.

 

Therefore under Measure 1 and SLO1 include the following information:

 

Achievement Target: 

 

Indicate the minimal acceptable competency level: 

 

Sample achievement target/minimal acceptable competency level: Average, if a student does not receive an average rating for M1 – SLO1 their project is not acceptable, even if all their other ratings are Average or higher.

 

Indicate the aspirational achievement target:

 

Sample achievement target/aspirational: Our current aspirational achievement target is for 100% of our students to perform at Average or above rating for the M1 –SLO1 relationship and for at least 50% to perform at Above Average level.

 

Please Note: there is no punative action if students do not meet your minimal competency levels or your aspirational competency levels. Please do not set the bar so low that all of your students meet the competency levels, please consider setting them at appropriate levels (for minimal competency) and at aspirational levels.

 

Present the findings for M1 and SLO1: Fall 2012 and Spring 2013

n = 53

Exemplary (4)

Above Average (3)

Average (2)

Below Average (1)

Nonexistent (0)

 

#

%

#

%

#

%

#

%

#

%

Outcome #1 Critical Thinking

5

9

9

17

22

42

17

32

0

0

 

Sample Discussion: Thirty-two percent of our students received a below average rating on their Capstone Project for Critical Thinking.  Overall, 68% of our students received a rating of average or above.  One change we can make immediately is to modify the project requirements to include "check in" dates with their faculty/instructor to discuss the higher level thinking components of their project. e.g. to what level are they processing and synthesizing information in this project. 

 Action Plan:  We will be exploring methods of insuring that students are prepared for the capstone course.  We are considering requiring that specific courses be completed prior to a student enrolling in the capstone course.  Additionally, we will be looking at the core courses leading up to this course and review the opportunities students have to engage in higher level thinking.  We will be exploring options during the spring 2014 semester and be prepared to implement the solution in the fall of 2014.

  

Please Note: To complete the data presentation for Measure 1 and the associated student learning outcomes repeat this within the online software under Measure 1 for each of the student learning outcomes measured by this instrument.

 

 

Sample Data Presentaton 2.

 

Table 2. Rubric, n=43, Spring 2013

 

Mean

1 (low)

2

3 (high)

Knowledge

1.8

20 (47%)

13 (30%)

10 (23%)

Self Awareness

1.7

21 (49%)

12 (28%)

10 (23%)

Skills

1.8

20 (47%)

13 (30%)

10 (23%)

Adaptability

Not measured with this instrument

Minimal acceptable competency level is a mean of 1.5 for each domain, for each student.

Aspirational achievement target is for 100% of participants to reach a competency level of 2, for each domain.

Sample discussion:  The aggregate group mean is acceptable for each domain.  However, upon closer review of the data presentation the table indicates that close to 50% of the students received a less than acceptable competency rating in each domain.  

Action Plan:  We will begin by reviewing prior year results for this instrument and if it is determined that is not an anonmaly we will review the course to insure that students are receiving ample opportunities to develop competencies for each of the topics.

 

Sample Data Presentation 3.

 

Sample 3. Exam, n = 33, Spring 2013

Domain

Mean

≤ 69%

70 -79&

80-89%

90-100%

Globalization

79%

6 (18%)

7 (21%)

14(42%)

6 (18%)

Sustainability

82%

2 ( 6%)

11 (33%)

12 (36%)

8 (24%)

Ethics

85%

0

7 (21%)

18 (55%)

8 (24%)

Economics

68%

10 (30%)

18 (55%)

2  ( 6%)

3 (9%)

Minimal acceptable percent per domain is 70%, for each student.

Aspirational achievement target is for 100% of students to reach a competency level of 70% or greater in the domains explored on the exam.

Sample Discussion:  Although the majority of our students are achieving good competency levels, we do have some that are clearly struggling in Economics, Globalization and Sustainability.  Sustainablity is not historically an area that our students struggle in so this may be an anonmaly.  Economics has traditionally been an area that students struggle in but the percent of students performing below our minimal acceptable percent has decreased by 7% from our last testing cycle, as has Globalization (2% fewer students achieving below minimal acceptable competency level).

Action Plan: We will repeat our prior efforts and review the course and any core courses leading up to it, to insure that there are ample opportunities for students to develop competencies for each topic that students are struggling in.

 

Pleast Note!  These are samples, if your data does not fit into this type of presentation please just remember to hit all the keys points and indicate what percent of students are achieving at each key competency level for your instrument.  Please contact the Assessment Office if you need any assistance.