Rumi provides tools for faculty evaluate student submissions, including Assignment Insights, Analytics, and Originality of student work.
Viewing the Rumi Assignment Dashboard
To view the Rumi assignment submissions, click on the assignment link (it may be a link titled "Load Rumi assignment in a new window").
The Rumi Dashboard will open and you will see student submissions. If a student is working on the assignment but has not submitted it, you will see a "Draft" status.
The Dashboard has several analytics that provide insight into the students' writing process.
Rumi recommends the following process.
- Start with the 5-star Originality Index for a quick, sortable overview of submissions.
- Drill into essay analytics (writing, revision, and source metrics) for more details and compare with class metrics (cohort analysis) if needed.
- Review the revision history for a complete picture of the student’s process.
Rumi AI Use
Shows the number of AI prompts used by the student.
Originality Index
This scale indicates potential AI misuse. The index is based on the following four analytics.
- Writing Duration: This measures the time spent typing in the document.
- Word Count: The number of words in the document.
- Unquoted Text Pasted: This is the proportion of text pasted into the document.
- Text Revised: Indicates if the student revised their work or typed it all in one sitting.
Click the Details button below the score to get a more detailed breakdown of the score.
The details break down what is considered in each analysis and the score for that analysis. See the Rumi Knowledge Hub for an explanation and why the context matters for determining if these scores are accurate.
For each analysis you can click for a more detailed breakdown by selecting on the "Click for details" button. For example, the details for Writing Analysis include writing speed, writing time, current words (excluding pasted text), words ever written (including prior revisions), quoted-words pasted (from external sources) and non-quoted pasted words (from external sources).
To view an individual student's submission, click on the student's linked name. You can also go directly to Speedgrader from the Assignment, and the Rumi interface will open within Speedgrader.
Grading each student's submission
You'll see a breakdown of the student's writing history and use of AI. This is where you will review their submission and enter a grade, which will automatically update in the Canvas Gradebook.
In this view, you have the same information on Originality, Writing Duration, etc. as on the Dashboard. Additionally, several buttons at the top provide further details about the submission.
- The "AI" button: Displays text changed using Rumi AI tools. Use the AI Prompts button on the right side of the screen to get details on the AI prompt used.
- The Comments button: Displays all comments made by you or the student on the document. Instructors can comment by highlighting the text and then selecting "Add comment."
- Similarity Report: Compares the student's work against publicly available text on the internet. Rumi does not compare student work to writing submitted by other students.
- Revision History: Instructors can play a video timeline of the student's writing process and identify any signs of pasting in large quantities of text or typing verbatim from another source.
Entering a Grade for the Assignment
How you enter the grade depends on whether you are grading directly in Rumi or through the Canvas Speedgrader.
- If you added a rubric to the assignment, you can view the rubric and use it to determine a grade. The grade computed by the rubric will not automatically fill the grade field. You'll need to submit it manually.
- You can also ask for AI Feedback based on the rubric and assignment instructions.
- If you are grading within the Rumi interface, enter the grade in the grade field to the left of the submission. This grade will sync with the Canvas gradebook.
- If you are grading in the Speedgrader, enter your grade in the Canvas grade field.