MERLOT Review Workflow Overview

Home

All Reviewers

Members

Editors

Tools

Scenario

The following scenario traces an item on MERLOT from posting, through the review workflow, to completion.  Many thanks to Martin Koning-Bastiaan for the creation of this document.

1. New Item

"Jumping Gluons" is added to MERLOT and categorized within Physics, under Particle Physics. This item shows up on the co-editor's Discipline Overview Page (in their Workspace) with the “None (not Triaged)” status designation by increasing that number.  An editor clicking on the “None” link will access the list that includes this item.

2. Add a triage value and comment

John W, as part of his assignment to monitor items in Particle Physics, looks for items without a triage using the Workflow Search Tool and finds “Jumping Gluons”. He looks at the site and thinks it is worth reviewing. John goes to the Detail Record of the item, clicks on "Item Workspace" on the menu bar, and clicks on "Add New Triage". He then adds a triage value of "High Priority Review (4)" and a short explanatory comment.  He also indicates on the triage form his interest in reviewing the item.

3. Send contact letter

Chuck B, co-editor for Physics, finds a new item with "Waiting for Review" status in the Physics Discipline Overview.  Checking the list, he finds a “high priority review” triage for “Jumping Gluons”. Going to the item’s Workflow Overview Page, he sees that the author has not yet been contacted by MERLOT. An Author Notification letter is waiting for him to edit and send. This letter states that the MERLOT Physics group wants to review her material and asks for a response if the author doesn't want her material reviewed. It also asks for permission to review any of the authors’ material. Chuck clicks on "Edit Author Notification Letter", makes sure that the letter says what he wants it to, and sends it off.

4. Clear for review

In this case, the author does not respond to the notification letter, so the system, after two weeks, updates the “Jumping Gluons” status to cleared for review. The Review Status Value that the material has been given is "Approval to Review Item (No Response)" and is noted on the item’s Workflow Overview Page. If the author had responded, that would have been recorded by the co-leader in the status drop down box on this page.

5. Assign individual reviewers

“Jumping Gluons” is ready to be reviewed and needs reviewers assigned.  John W decides to be one reviewer, goes to the item’s Workflow Overview page and assigns himself using the “Review” button.  John then asks Chuck B to select a second reviewer for the item. Chuck knows that both Bob T and Bill M have experience in particle physics and have finished their latest review. Chuck goes to his Workspace, clicks on "Manage Reviewers", and checks the statistics for both Bob and Bill to see where they are on their quarterly goals. Bill has completed 23 reviews in the past 60 days, while Bob has only finished 11. Chuck returns to the item’s Workspace Overview page, selects Bill's name from the text field, and assigns him to review the material.

(Alternatively, there is another Physics faculty member, Jill W who wishes to participate in peer review and has been trained by the group.  To add her as a reviewer, Chuck goes to Manage Reviewers”, types her name in the “Add New Reviewer” text box, and performs a search. Looking at the resulting list, Chuck finds Jill and sets the radio button by her name. He gives her “External Reviewer” status and clicks the submit button. Chuck then returns to the item’s Workspace Overview page and selects Jill as the second reviewer.)

6. Write individual reviews

In checking his Workspace page, Bill M sees he is assigned to write an individual review for “Jumping Gluons” with John W. He goes to the item’s Workflow Overview page and clicks on “Begin New Individual Review” to bring up the review form.  He then goes to the “Jumping Gluons” site and studies it, noting pluses and minuses in the three review criteria areas. Bill fills in his thoughts on the review form and, when finished with his initial review, selects “Save for Later" at the bottom of the form. Two days later he returns to the item’s Workflow Page, selects “Edit Individual Review”, checks his comments, cleans up his spelling and grammar, completes the assignment, and clicks "Submit Final Copy". By doing this, Bill has indicates that his individual review is complete and is available for the Physics Board to read.

Meanwhile, John W has also completed his “Jumping Gluons” review.  He uses a Microsoft Word template of the physics review form to write his review.  Once completed, he goes to the item’s Workflow Overview page, brings up the review form using the “Begin New Individual Review” link, and cuts and pastes his review from the word document to the text boxes on the review form.  Once completed, he submits his review as the final copy.

7. Write composite review

Bill M and John W decide that John will write the composite review for “Jumping Gluons”.  John goes to the item’s Workflow Overview page, looks at the two reviews linked under “Completed Reviews”, and clicks on “Begin New Composite Review”.  John then selects Bill's individual review as the base document to edit and clicks “Begin Review” to access the composite review form.  This form has the text from both individual reviews above the text input box for each review field. Since he chose Bill's review as the base document, these fields initially include Bill's text for editing. John goes through the form, cutting and pasting some of his review into the fields and editing the reviews to fit together. After John is satisfied with his composite, he clicks “Save for Later” and notifies Bill that he is finished.  Bill goes to the item’s Workflow Overview page, selects the “Edit Composite Review” link, makes a few modifications, and selects “Submit Final Copy”.  The composite review is now ready to send to the author for comment.

8. Send composite review and letter to author

In his Workspace, Chuck B sees that a new item has the status “Composite Review Completed”.  From the list of such items, he sees the review for “Jumping Gluons” is finished, clicks on the link to the item's Workspace Overview, and looks at the completed composite review.  Satisfied with the review, Chuck clicks on "Edit Review Letter" to send the review to the author. A default template letter is ready to edit and send with the review pasted into the letter below the template. Chuck “Sends” the letter so that the author can read and respond to the completed review.

9. Clear for posting

After receiving an email expressing warm regards for the review with some comments on research about the use of “Jumping Gluons” from the author, Chuck updates the "Response to Review" value to "Approved for Posting".

10. Post composite review to public

Chuck B goes to the “Jumping Gluon” Workflow Overview page, selects “Edit the Composite Review”, types the author’s comments at the bottom of the review form, and “Posts” the composite to MERLOT.  It is now a public review attributed to the Physics review panel.

11. Send out recognition letters

After posting the review of “Jumping Gluons”, Chuck B sends the author another email stating that letters of recognition can be sent to her and two others that she designates, again through a link on the item’s Workflow Overview page. In this case, the author requests a letter for herself and her Dean and provides the addresses to send these letters.  Chuck inputs these addresses into the fields on the item's Workflow Overview page to keep track of to whom and where the letters are to be sent. After the letters are sent, Chuck checks off that the letters have been sent to the author and her designee.

12. Complete process

In addition, Chuck checks the box on the bottom right of the material's Workflow Overview page and clicks the add/change button. The material has now officially completed the peer review process.

Functions from the different levels of access:

External Reviewers can add/edit Individual Reviews for material they have been assigned and add/edit composite reviews for the same.

Board Members can, in addition to the above, add/edit triages for materials and perform searches on material by workflow status in their discipline. They can indicate their interest in reviewing an item, and (depending on the discipline preferences) assign themselves as a reviewer.

Editors can, in addition to the above:

1. Compose, send, and set default author letters (Notification, Review, and Recognition)

2. Manage the reviewers for the discipline, including: add/edit Reviewers to the list, deactivate Reviewers from list, and generate individual statistics for reviewers in the discipline.

3. Set admin preferences to allow/disallow members from assigning themselves as reviewers, show/hide previous triages, and create a link to the discipline’s evaluation criteria.

4. Set author Responses on the material's workspace overview page for responses to the Notification letter and the Review letter.

5. View Discipline level stats for materials from the Discipline's overview section of the Workspace page.

6. Assign/unassign reviewers to items.

7. Post the peer review to the public.

8. Set the workflow status to complete.

home | all | members | editors | tools | scenario
Last Modified 6/21/02
Bruce Mason