Institution-level Outcomes (Analyze Tab)

Institution-wide Outcomes (Analyze Tab)

The analytics reporting tool found in Waypoint 2 is extremely robust and allows multiple filtrable items to aggregate the data you need.  Almost every data point presented in this tool is clickable - allowing you to drill down further into the data if desired.

If you have the appropriate user role and license you will be able to run institution-wide outcomes reports.  These reports allow you to analyze data over a period of time across all of the institution's courses.

To run the outcome reports:

1. Log into Waypoint.
2. Click on the Analyze tab.
3. Locate the report you wish to run and click on the Generate button.

We currently offer custom built reports to help start the data aggregation process at your institution.  These reports run off a third-party software that features the ability to export the raw data into different formats (CSV, PDF, etc.) for further manipulation.  Depending on the type of data you plan to gather, using the right report makes all the difference.

Below is a list of all available Waypoint 2 reports, brief descriptions about them, and instructions on how to use them to achieve your data needs.  These reports are ideal for administrators or administrators who will be viewing data across multiple users, courses, and even the institution.  Waypoint 2 also offers analytics for rubric-level data.  For more information about this type, please click here.

NOTE: some of the graphics below were shrunk in order to fit on the page.  Clicking on them will open larger versions of the image in a new window.

Reporting Basics

Before detailing the various reports currently found in Waypoint 2, there is opportunity to discuss some of the built-in functionality found throughout all of the reports.

Menu

Located at the bottom of every report is a small menu.

From left to right, these buttons allow you to Export Data, Revert Data (removing any filters you chose and returning the report to its original state), Pause Automatic Updates, and Refresh Data.  Some of these buttons are available right from the start.  Others require separate actions by the user in order to become activated - such as the Export Data button:

After you have aggregated the data you need and it is displayed in the report window, you can export it four different ways.  The first way is as an Image (PNG format).  If you are looking to capture graphs specifically, this would be the best option.  Selecting Data opens up a new window which allows you to view additional details - student names, assessor names, specific rubric language, etc. - not already included in the report view.  The third option is to export the raw data into a Crosstab (Excel CSV) file for further unrestricted manipulation.  Lastly, you can export the report data as a PDF.  There are a few options related to the appearance of the data for this choice.

Assessor / Student Explorer

The Assessor / Student Explorer report has three distinct views.  These views are available under the "Display the following view" drop-down menu, located towards the bottom-left of the report window.  The three views include; Student Scores, Criteria Breakdown for Assignment, and Competencies for the Section.  More details for each view can be found below:

Student Scores

This view is the most basic of the three.  The report displays an assessor's student roster and the scores the students received for course assignments.  This student list can be filtered to include specific courses, sections, and assignments.

Criteria Breakdown for Assignment

This report displays similar data but approaches it with a focus around the assignment criteria.  The Criteria Breakdown for Assignment area will display assignments and their criteria.  Each criteria will contain an average score.  The circles, next to an assessor's name for example, is a visual indication of the size of data.  The bigger the circle, the more data.

After filtering a specific rubric (The Textual Analysis Essay for example) you can choose to display data for all of the assignment's criteria by selecting the assignment name on the left (highlighted above).  Below the Criteria Breakdown for Assignment area is the list of students and the scores they received for the assignment.  The scores are detailed by color which represents different performance levels.  The key for these colors is found in the bottom-left corner of the report window.

You can filter by specific criteria too.  In the example above, two criteria have been selected from The Textual Analysis Essay: Project Content and Writing, Grammar, Style, and Organization.  The information displayed below the Criteria Breakdown for Assignment area reflects the selections.

Focusing on a specific criterion is also easily accomplished.

This report also allows you to filter a specific group of students based on the performance level they received.  If you hover your mouse over one of the colored bars, you will get a popup of information including the number of students that received this score and the overall percentage for the criterion.  Clicking this bar will filter only that group of students:

Competencies for the Section

This view of the report displays competencies (outcomes) for assignments and the average scores received for each.

Selecting the course (English 101 for example) will display data below the Competencies for the Section area.  This data includes student names and the performance level scores they received for competencies against one or more rubrics.  The competencies are listed to the right of the student names.  The rubrics that contain the competency is displayed in the gray box above the score area.  In this case, the report is displaying data for two rubrics: Fall Term Journal and The Textual Analysis Essay.  Below each rubric title is its criteria.

The data can be filtered further by selecting specific competencies.  In the example above, only the Communication Skills and Information Literacy competencies were selected.  You'll notice that these competencies were associated with only one criterion (Evidence and Research) in two rubrics.

A single competency can also easily be selected.

Then with just the Communication Skills competency selected, individual students can be filtered so that their names are the only ones to appear:

This is achieved by holding CTRL+Select on PC or Command+Select on Mac to select multiple student names.  Once you have the student names selected, hovering over one of them will present a pop-up box.  Click on "Keep Only" to filter the data.  This ability opens exciting possibilities such as pairing tutor candidates with struggling students.

Criterion Summary by Date

When the Criterion Summary by Date report loads, you are presented with three areas; Select a Course, Select Rubrics, and Criterion Summary.  This report allows you to view criterion data for multiple rubrics across multiple courses.

The first step is to select a course from the left-hand side.  You are able to select multiple courses by holding CTRL+Select on PC or Command+Select on Mac.  The number to the right, 825 in the case above, represents the total number of evaluations in Waypoint 2 for a given course.

After selecting your course(s), the next step is to choose the rubric(s).  Based on the course(s) you selected, only its associated rubrics will appear under the Select Rubrics area.  Just like the previous step, you are able to select one or more rubrics you wish to display data for.  The total number of evaluations associated with the rubric appear on the right-hand side.  This number does not necessarily match the evaluations number listed under the first area (Select a Course).

The results of your selections will be displayed below under the Criterion Summary area.  In the example above, two rubrics were chosen for the course English 101: Critical Thinking & Written Communication and English Writing Rubric.  The graphs display average scores received for a given criterion (y axis).  The name of the criterion is found on the bottom (x) axis.  You can expand your view of the data by clicking on the "_Full Criterion View_" tab, located at the top of the report.  This will remove the first two areas, Select a Course and Select Rubrics, so that your data has more room to display.  This is especially helpful when viewing multiple courses with multiple rubrics.

Outcomes Explorer

The arrangement of the Outcomes Explorer report allows for flexible filtering.  On the left-hand side there are three objects that drive filtering; date range, wildcard search, and View drop-downs.  The date range will only display data between the time period you specify.  If there is a certain user, rubric, criterion, or standard (to name a few) you want data for, using the wildcard search will help locate and display any related data points.  The View drop-downs determine what data Waypoint 2 should display and in what order on the right-hand side (for 1, 2, and 3).  There is no correct order for the Views to follow, but depending on the type of data you need these may need to be adjusted.

Once the filterable items on the left are specified you can select one or more course(s) under the first area, Course listing.  For this example, we are keeping the default View ordering and selecting one course: English 101.  The circle found next to the course name is a visual indication of the size of data for the course.  The bigger the circle, the more data.

The next step after selecting the course(s) is selecting one or more rubric(s).  You are able to select multiple rubrics by holding CTRL+Select on PC or Command+Select on Mac.  Each rubric includes an average score.  The colored bars next to the rubric name represents the distribution of scores amongst the students.  A key, connecting the performance level text to a color, is displayed in the bottom left of the report window.  Hovering your mouse over any of these color blocks will display more information such as percentage of students that received this score and the number of assessors.

Once rubrics are selected, their criterion information will display on the right under the Criterion area.  Again, the average score is displayed for each criterion along with the distribution of scores amongst students.

From here, you are able to select different criteria to compare or just one - as is the case for this example: Intellectual Ambition.  After criteria is selected, a "View Assessor Drilldown" button will appear below the Criterion area.  Clicking this button will take you to the second tab of the report.  Displayed is the criterion (or criteria) you selected from the previous report tab and all assessors that assessed with those criteria.  Under the second area, Assessor Comparison, you can select one or more assessor names to populate the third area below.

In the example above, three different assessors were selected for comparison.  The course (English 101), assessment periods (August 2011 and March 2012), associated rubric (Critical Thinking & Written Communication) and selected criterion (Intellectual Ambition) are all displayed below the third area.  There are a total of three red circles in the details which represent the assessors (and ultimately the amount of data they created - based on the size of the circle).

On the first row for August 2011, the circle on the left is associated with assessor Andrew McCann.  Hovering over it, this information is confirmed in addition to displaying the total number of students assessed against Intellectual Ambition by him (9) and their average score (4.03 out of 5).  The circle on the right for August 2011 is tied to assessor Myles Ferich.  He has assessed 7 students with an average score of 4.14.  The final circle, found on the March 2012 row belongs to assessor William Faulkner.  He has assessed 25 students with an average score of 3.5.

Outcomes Summary by Date

When the Outcomes Summary by Date report loads, you are presented with three areas; Select a Course, Select Competencies, and Outcomes Summary.  This report allows you to view competency (outcomes) data across multiple courses.  It functions almost identically to the Criterion Summary by Date report.

The first step is to select a course from the left-hand side.  You are able to select multiple courses by holding CTRL+Select on PC or Command+Select on Mac.

After selecting your course(s), the next step is to choose the outcome(s).  Based on the course(s) you selected, only its associated outcomes will appear under the Select Competencies area.  Just like the previous step, you are able to select one or more rubrics you wish to display data for.

The results of your selections will be displayed below, under the Outcomes Summary area.  In the example above, two competencies (outcomes) were chosen for the course English 101: Communication Skills and Critical Thinking.  The graphs display average scores received for a given outcome (y axis).  The name of the outcome is found on the bottom (x) axis.  You can expand your view of the data by clicking on the "_Full Outcomes View_" tab, located at the top of the report.  This will remove the first two areas, Select a Course and Select Competencies, so that your data has more room to display.  This is especially helpful when viewing multiple courses with multiple outcomes.

Student Performance

The purpose of this report is to view complete academic data collected for an individual student in Waypoint.  The data collected spans the student's entire Waypoint career - including all courses and assignments they were associated with.

 

When the report first loads, you are presented with one text field: Find Student.  Search for the student by name (first and/or last name) you wish to view data for.  A list of matching students will appear below the search field.  Simply select the correct student.

 

After selecting the student's name, a list of all the courses the student has taken will appear under the first area.  You then have the ability to select one or more courses and populate assignment score data.

 

With the "Business 301" course selected, all of the course's assignments are listed under the second area.  From there, one can view how the student performed for each assignment compared to their peers.  The student, who was searched for, is represented by a triangle while their peers average is represented by a circle.  Hovering over these icons will present more granular data:

 

The student's score.

 

The student's peers.

 

Selecting an assignment from under the second area will display the rubric's details (criteria) and the scores the student received for each one under the third area (right side).  This allows you to determine where the student is exceeding and where they are struggling.