Grading and Evaluating Rumi Assignments

Rumi provides tools for faculty evaluate student submissions, including  Assignment Insights, Analytics, and Originality of student work.

Viewing the Rumi Assignment Dashboard

To view the Rumi assignment submissions, click on the assignment link (it may be a link titled "Load Rumi assignment in a new window").

The Rumi Dashboard will open and you will see student submissions. If a student is working on the assignment but has not submitted it, you will see a "Draft" status.

 

The Dashboard has several analytics that provide insight into the students' writing process.

Rumi AI Use 

Shows the number of AI prompts used by the student.

Originality Index

This scale indicates potential AI misuse. The index is based on the following four analytics.

1. Writing Duration: This measures the time spent typing in the document.

2. Word Count: The number of words in the document.

3. Unquoted Text Pasted: This is the proportion of text pasted into the document.

4. Text Revised: Indicates if the student revised their work or typed it all in one sitting.

Click the information icon to the right of the score to get a more detailed breakdown of the score.

To view an individual student's submission,  click on the student's linked name. You can also go directly to Speedgrader from the Assignment, and the Rumi interface will open within Speedgrader.

Grading each student's submission

You'll see a breakdown of the student's writing history and use of AI. This is where you will review their submission and enter a grade, which will automatically update in the Canvas Gradebook.

In this view, you have the same information on Originality, Writing Duration, etc. as on the Dashboard. Additionally, several buttons at the top provide further details about the submission.

• The "AI" button:  Displays text changed using Rumi AI tools. Use the Rumi AI button in the bottom right corner to get details on the AI prompt used. 
• The Comments button: Displays all comments made by you or the student on the document. Instructors can comment by highlighting the text and then selecting "Add comment."
  
• Similarity Report: Compares the student's work against publicly available text on the internet. Rumi does not compare student work to writing submitted by other students.
• Revision History: Instructors can play a video timeline of the student's writing process and identify any signs of pasting in large quantities of text or typing verbatim from another source.
  
• Rumi Assist: This is an AI-enabled feedback tool that works with an instructor's rubric or an AI-generated rubric.

Entering a Grade for the Assignment

How you enter the grade depends on whether you are grading directly in Rumi or through the Canvas Speedgrader.

• If you are grading within the Rumi interface, enter the grade in the grade field to the left of the submission. This grade will sync with the Canvas gradebook.
  
• If you are grading in the Speedgrader, enter your grade in the Canvas grade field.