Our Assessment Process
Our Assessment Process
Our Assessment Process
Assessment data on the attainment of the student outcomes is obtained from three main sources:
- Individual student attainment data used for the yearly assessment report
- Senior Exit Survey
- Academic Advisory Panel
Yearly Assessment Report
A full assessment cycle takes place over the span of two years and works as follows.
- During the fall and spring semesters a set of courses is identified where measures will be assessed (the most current schedule is available in Table 4A-2).
- After the DROP/ADD period ends, course rosters are distributed to the department assessment coordinator by the university’s director of assessment.
- The assessment coordinator creates course roster files for each course on the assessment schedule.
- These course rosters are uploaded into a web-based software application known as TracDat and mapped to the appropriate assessment measure.
- An assignment in TracDat is then generated for each roster and emailed to the instructor of the course.
- The assignment allows the individual instructors to input whether the students met or did not meet the associated criterion.
The instructor of the course offering chooses how they will determine whether a particular criterion has been met. This determination is documented as an Assessment Vehicle. The individual vehicles are noted in the assessment schedule and archived in the assessment Google Drive folder. A sample selection of vehicles is provided in Table 4A-1.
Table 4A-1: Sample vehicles collected
Measure |
Criteria |
Course |
Vehicle |
6A: Presentation |
All |
Software Engineering I |
30 Minute Sprint Review; Team presentations during the semester with clients and professor; Final grade in the course, as well as the final grade on the team project |
8A: Algorithms |
1 |
Design and Analysis of Algorithms |
Quiz: Analysis of recursive algorithms and Quiz: Runtimes; Final grade in the course |
8F: Theoretical Foundations |
2 |
Foundations of Computer Science |
Overall grade on Exam 2; Questions 1, 2a, 2b, 2c from the final exam |
Once the student data is inputted into TracDat, the process continues as follows:
- The student data is ported to a software application called Tableau, which provides a multitude of data visualization and analysis tools.
- The data in Tableau is analyzed to determine whether or not the associated student learning outcome has been met given the data from the measure.
- The results for all student learning outcomes are collected in an assessment report generated by TracDat (i.e., Results sections).
- The generated assessment report is discussed at the department meetings during the following semester.
- The department also has an assessment committee that meets each fall to go over the previous year’s report.
Action items are generated based on the discussions derived from the report. The report may be further modified if action items require responses.
Senior Exit Survey
The Senior Exit Survey is conducted by the dean’s office. The dean’s office generates a survey for the students with questions about the university and their experiences. The department may then add additional questions to collect data points that are specific to that department. For example, the Computer Science department survey contains a question related to the department’s PEOs.
Academic Advisory Panel
The Academic Advisory Panel is a focus group constructed of former students, industry contacts, and faculty/administrators from other universities. The advisory panel is used to assess the strengths and weaknesses of our programs, as well as gain insight into the success of our students in the work force. The most recent advisory panel was held virtually on November 17, 2023 with invites given to representatives from Apple, Clover, NFL, Amazon, Splunk, and the University of Delaware.
Yearly Assessment Report
A full student attainment data assessment period takes place in a two-year cycle. Each measure is given a particular semester to be assessed. The scheduled semesters are fall of odd years, spring of even years, fall of even years and spring of odd years. The current schedule is as follows:
Table 4A-2: Schedule of assessment measures
Assessment Measure |
Criteria |
Course |
Frequency |
6A: Presentation |
All |
Software Engineering |
Spring Even |
6C: End-user/Technical Documents |
All |
Software Engineering |
Spring Odd |
7: Ethics |
All |
Computers and Society |
Fall Odd |
8A: Algorithms |
1 |
Design and Analysis of Algorithms |
Spring Even |
2 |
Design and Analysis of Algorithms |
Spring Odd |
|
8B: Data Structures |
All |
Data Structures and Algorithms |
Fall Even |
8C: Language Proficiency |
All |
Senior Project |
Fall Odd |
8F: Theoretical Foundations |
1 |
Foundations of Computer Science |
Fall Odd |
2 |
Spring Even |
||
3 |
Fall Even |
||
4 |
Spring Odd |
||
5 |
Fall Odd |
||
8G: Hardware |
6 |
Computer Organization |
Fall Odd |
7 |
Spring Even |
||
8 |
Fall Even |
||
9 |
Spring Odd |
||
8H: Operating Systems |
All |
Operating Systems |
Fall Every Year |
9: Teams |
All |
Software Engineering |
Fall Odd |
10A: Problem Solving: Client |
All |
Software Engineering |
Fall Odd |
10B: Problem Solving: Technical |
All |
Senior Project |
Fall Odd |
At the end of each academic year, generally during the summer, an assessment report summarizing the findings for that academic year is generated. The routine repeats for the next academic year with full coverage of all assessment measures occurring over the span of two years.
Repeat every two years |
Fall of Odd Years Assessment Measures |
Spring of Even Years Assessment Measures |
Yearly Assessment Report |
Fall of Even Years Assessment Measures |
Spring of Odd Years Assessment Measures |
Yearly Assessment Report |
Senior Exit Survey
The Senior Exit Survey is conducted in each section of the Senior Project course in the fall and spring semesters. A report of the data follows shortly after the conclusion of the semester.
Academic Advisory Panel
The Academic Advisory Panel is scheduled to occur once each year. The time frame for when the panel meets varies as the feasibility of the meeting depends on the availability of that year’s participants.
Expected Level of Attainment
Each course that is being assessed has a roster generated after the conclusion of the DROP/ADD period. The course roster is inputted into TracDat for data collection purposes. A student learning outcome is said to have been met if at least 80% of the students on the roster met or exceeded the goal. Therefore, the expected level of attainment for the student learning outcomes is 80%.
The Senior Exit Survey and Advisory Panel produce worthwhile information but are not given any specific attainment targets.The yearly assessment reports are generated and discussed during a department meeting in the fall semester. The reports are filed with the university’s director of assessment and archived in the Assessment Google Drive folder available to the department.
The Senior Exit Survey data is distributed to the department by the dean’s office. The data is discussed during a subsequent department meeting in the following semester to identify areas of weakness and generate action plans. The data is archived in the Senior Exit Survey Google Drive folder available to the department.
The Advisory Board meeting minutes are summarized and, together with the insights gleaned from the meeting, are shared with the department. Specific Advisory Board recommendations are further discussed in the appropriate committees, such as the curriculum committee. The minutes and report are archived in the Advisory Board Google Drive folder available to the department.