Wikipedia:Wiki Ed/Vanderbilt University School of Medicine/WikiMed Fall 2022 (Fall 2022)

“Imagine a world where all people have access to high quality health information clearly written in their own language” – Wikipedia co-founder Jimmy Wales.

Welcome to the fourth Vanderbilt University School of Medicine WikiMed Advanced Elective (AE). In this month-long AE, you will have the opportunity to work individually and on small teams to better understand and contribute to medical content on collaborative learning platforms, or &quot;wikis&quot;. The goal of this course is to develop skills in literature search and review, as well as medical writing and editing. The course will kick off with a WikiMed “bootcamp” - an introduction to Wikipedia and medically focused wiki platforms (e.g., WikiEM, Radiopedia, Orthobullets, HemOnc.org) and the various considerations to keep in mind in contributing to this content. Students will work on teams on article selection, research, and editing over the course of the month. Over the course of the month, there will be mandatory virtual or in-person Work-in-Progress (WIPs) in which students will touch base with peer reviewers, course directors, and information scientists. By the end of the month, students will have made meaningful and durable contributions to Wikipedia or medical wiki topics of interest, and will have the tools to effectively contribute medical content to collaborative platforms.

Week 1
Welcome to the VUSM WikiMed course timeline! This page will serve as a resource with updates, required check-ins, links, and training modules for your upcoming rotation.

Thank you to Jeremy Warner for initially developing the course at VUSM and to Amin Azzam from UCSF and his team for laying the groundwork for the course. Many handouts and presentations were developed from their team, and we are grateful for their permission to share these valuable resources with you in the coming month!

Monday 10/24 from 12:30 pm - 3:30 pm


 * 12:30-1:00: Introductions and course overview
 * 1:00-2:00: Overview of WikiMed (Amin Azzam, UCSF)
 * 2:00-3:00: How to become a Wikipedian (Mary Anne Caton, Vanderbilt University)
 * 3:00-3:30: Discuss workplan, Wikiproject medicine style guidelines, begin selecting articles, begin designing teams and workplans

Homework: complete most basic Wikipedia training modules; select an article to present on day 2 as your semi-final chosen article

Tuesday 10/25 from 12:30 pm - 4:30 pm


 * 12:30-1:00: Begin to present and discuss selected articles
 * 1:00-1:30: Overview of library resources (Rachel Walden, Vanderbilt University)
 * 1:30-2:30: Publishing industry and SPI-Hub (Taneya Koonce, Vanderbilt University Medical Center)
 * 2:30-3:00: A future vision of WikiMed (Amin Azzam, UCSF)
 * 3:00-4:00: HemOnc.org (Jeremy Warner, Brown University)
 * 4:00-4:30: Finish discussing articles, discuss peer-review, works-in-progress (WIPS), and communication

Homework: complete any remaining basic Wikipedia training modules

'''Resources:

'''


 * Editing Wikipedia, pages 1–5
 * Evaluating Wikipedia
 * Hemingway App
 * All WPM list of missing articles (medicine)
 * Requested articles: people in medicine
 * Wikipedia:WikiProject Missing encyclopedic articles/List of notable books on history of medicine
 * Requested articles: Medicine

Presentations: (to be added)

Handouts/Readings: 


 * Workplan
 * Medical Wikis Dedicated to Clinical Practice: A Systematic Review
 * Medical Wiki Overview Table

These completed modules are due by the end of Day 1.

These completed modules are due by the end of Day 2

See below for suggestions for articles to edit during the course:

Health equity - currently rated B-class

Treatment and management of COVID-19- currently rated C-class

Coronavirus - currently rated C-class

Long COVID - currently rated C-class

MIS-C - currently rated B-class

Vaccine hesitancy - currently rated B-class

Monkeypox- currently rated C-class

After reading the systematic review and additional references in the overview table (as indicated by your interest), select a medical wiki to learn more about over the course of the block. Before the WIP, please write a short paragraph about why you made the choice, and upload to Dropbox. If the chosen medical wiki is open to contributors, sign up for an account.

Week 2


By the end of the day on Monday, October 31st (i.e., before  our first WP-WIP), post your final Workplan to your selected Wikipedia's talk page, so that you can engage with the Wikipedian community members who are interested &amp; actively following your article. If you are working on a team, I want you to be explicit about what section(s) you will  individually  be responsible for.

Consider explicitly declaring any/all of the following (but don't feel limited to these):


 * Is each fact referenced with an appropriate, reliable reference?
 * Is everything in the article relevant to the article topic? Is there anything that distracted you?
 * Is the article neutral? Are there any claims, or frames, that appear heavily biased toward a particular position?
 * Where does the information come from? Are these neutral sources? If biased, is that bias noted?
 * Are there viewpoints that are overrepresented, or underrepresented?
 * Check a few citations. Do the links work? Is there any close paraphrasing or plagiarism in the article?
 * Is any information out of date? Is anything missing that could be added?
 * Which sections will you prioritize?
 * What resources do you intend to look up, and when?
 * How will you decide what things (signs, symptoms, side-effects, etc.) to explicitly include? To explicitly exclude?
 * Will you also embed additional links to other Wiki pages?
 * How will you ensure you avoid &quot;doctor-speak&quot; and not use jargon?

<span style="caret-color: #2c2c2c; color: #2c2c2c; font-family: 'Open Sans', sans-serif; font-size: 15.008000373840332px; font-style: normal; font-variant-caps: normal;">Handout:  Workplan worksheet

Reach out to your Wikipedia Expert if you have questions using the Get Help button at the top of this page.

Resource: Editing Wikipedia, pages 7–9

By the end of this week, you should start making edits live on WIkipedia (not just your Sandbox)

This is perhaps the most important theme. Medical wiki entries and edits should be both accurate and unambiguous. This is particularly true for wikis that lend instructions for therapy and guidance on best practices. Inaccurate guidance can lead to tragic consequences. The reading this week relates to the importance of accuracy in chemotherapy prescribing and administration.

• Chemotherapy medication errors (Lancet Oncol)

Assignment: after reading the article, consider what the consequences of inaccurate information on your chosen medical wiki might be. Locate and read the liability information on the medical wiki. Before the WIP, write a paragraph on the consequences of inaccuracies on the medical wiki for the user as well as the wiki. Should medical wikis be subject to FDA or other oversight? Upload your paragraph to Dropbox.

On Tuesday, November 1st we will have an informal check-in to discuss progress, troubleshoot, and share thoughts about the process of writing and contributing to Wikipedia.

Upload your WIP to Dropbox for November 1st work-in-progress.

<span style="color: #2c2c2c; font-family: 'Open Sans', arial, sans-serif; font-size: 15.008px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400;">Zoom meeting details sent separately.

Week 3
<div style="font-family: 'Open Sans', sans-serif; font-size: 15.008px; font-style: normal; font-variant-caps: normal; caret-color: #2c2c2c; color: #2c2c2c; font-variant-ligatures: normal;">

Please perform peer reviews beginning on or around the Monday of Week 3

What should a peer-review look like? During our discussion in class in Week 2, we will define specific attributes we will itemize here.


 * Transparent (unblinded)
 * Goal should be clearly explained by the author and evaluated by the peer reviewer
 * Wikipedia peer-review rubric is nice, seems like a good starting point
 * Lead (Intro) section - is it clear, does it flow, easy to understand, have a picture?
 * Other sections generally following the Wiki Project Medicine content categories
 * Checklists, maybe? Rubric is pretty much the checklist
 * Are the changes significant enough to matter?
 * Thinking about the 6 B-class criteria for those trying to move from C to B
 * Gestalt and intuition --&gt; specific comments
 * Constructive feedback (don't just say &quot;great job!&quot;) - sandwich method of 2 good and 1 bad
 * Think about how to respond to comments from external reviewers (other Wikipedians)
 * Readability is important, but might be hard to assess - also it matters for who is going to read the material
 * Peer reviewers should refrain from making edits, leave these to the primary page &quot;owner&quot;
 * Think about a mechanism for adjudication

<div style="font-family: 'Open Sans', sans-serif; font-size: 15.008px; font-style: normal; font-variant-caps: normal; font-variant-ligatures: normal;">

How to conduct peer review? Themes/questions that might emerge:


 * Peer reviews are DUE by the Friday of Week 3
 * Post the peer-review on the TALK page of the article you are reviewing.
 * Here's a link to a grading rubric that Wiki Ed offers for evaluating student contributions to Wikipedia articles.  While we MIGHT formally use the point system, it does provide a nice complement to our &quot;home-grown&quot; peer-review process.

Handout: Guiding questions for peer review. Available from: https://en.wikipedia.org/wiki/Template:Dashboard.wikiedu.org_peer_review

Handout: Wiki Education Classroom Program example grading rubric. Available from: https://commons.wikimedia.org/wiki/File:Wiki_Education_Classroom_Program_example_grading_rubric.pdf

In addition to the accuracy of the existing content, medical wikis should be reasonably complete, at least for a described scope. Here are two readings focused on completeness of drug content on Wikipedia and timeliness to publish research findings, with findings easily transferrable to medical wikis:


 * Accuracy and completeness of drug information in Wikipedia: a com-parison with standard textbooks of pharmacology (PLoS One)
 * Time to publish: challenging the performance of cooperative group lymphoma trials (Lancet Haematology)

Optional reading: for historical context, this article published in 2008 is a good contrast to the 2014 PLoS One article above.


 * Scope, completeness, and accuracy of drug information in Wikipedia (Ann Pharmacother)

Assignment: <span style="font-family: 'Open Sans', arial, sans-serif; font-size: 15.008px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; text-align: inherit; color: #2c2c2c;">after reading the articles, consider what the consequences of incomplete information on your chosen medical wiki might be. Locate and read the standards for inclusion and prioritization on the medical wiki, if available (e.g., HemOnc.org's are here). <span style="font-family: 'Open Sans', arial, sans-serif; font-size: 15.008px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; text-align: inherit; font-weight: 600; color: #2c2c2c;">Before the WIP <span style="font-family: 'Open Sans', arial, sans-serif; font-size: 15.008px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; text-align: inherit; color: #2c2c2c;">, write a paragraph on the consequences of incompleteness on the medical wiki. Since no information source is going to be complete or &quot;real-time&quot;, is the missing information biased in some important way? For example consider the effects of publication bias. <span style="font-family: 'Open Sans', arial, sans-serif; font-size: 15.008px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; text-align: inherit;">Upload your paragraph to Dropbox.

On Monday, November 7th we will have an informal check-in to discuss progress, troubleshoot, and share thoughts about the process of writing and contributing to Wikipedia.

Upload your WIP to Dropbox for November 7th work-in-progress

<span style="font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; font-size: 15.008px; font-family: 'Open Sans', arial, sans-serif; color: #2c2c2c;">Zoom meeting details sent separately.

Week 4
On Monday, November 14th we will have an informal check-in to discuss progress, troubleshoot, and share thoughts about the process of writing and contributing to Wikipedia.

Upload your WIP to Dropbox for November 14th work-in-progress

<span style="font-family: 'Open Sans', arial, sans-serif; font-size: 15.008px; font-style: normal; font-variant-caps: normal; font-variant-ligatures: normal;">Zoom meeting details sent separately.

Every student has finished reviewing their assigned articles, making sure that every article has been reviewed.

All peer reviews should have been completed and posted to the talk page of the '''page being reviewed BEFORE WIP #3. '''

You probably have some feedback from other students and possibly other Wikipedians. Consider their suggestions, decide whether it makes your work more accurate and complete, and edit your draft to make those changes.

'''How to respond to peer-reviewer's comments:

[Insert from Week 2 discussion] '''

Resources:


 * Editing Wikipedia, pages 12 and 14
 * Reach out to your Wikipedia Expert if you have any questions.

Continue to expand and improve your work, and format your article to match Wikipedia's tone and standards. Remember to contact your Wikipedia Expert at any time if you need further help!

It's the final week to develop your article.


 * Read Editing Wikipedia page 15 to review a final check-list before completing your assignment.
 * Don't forget that you can ask for help from your Wikipedia Expert at any time!

Wikis that are not discovered by potential users are clearly not as useful as those that are heavily used. Wikipedia clearly has an outsized advantage, being one of the top 5 most-visited websites. Medical wikis tend to have a much more specialized audience. Once someone discovers a new site such as a medical wiki, content on a large wiki can be diﬃcult to locate and that can impact usefulness and willingness to continue to use the resource. Related to discovery, the ”rate of returning visitors” (RVR) is a major measure of success for any web resource.

Readings:


 * Google Analytics overview
 * Article on RVR

Assignment:

Using one or more search engines (e.g., Google, Bing, Yagoo, Baidu etc.) of your choice, try to discover some of the content of your chosen medical wiki. Before the WIP, in a short paragraph, comment on where the search results appear (if at all) and how this might impact traﬃc to the medical wiki. Are search engines the best way for new users to discover medical wiki content? What are other methods that might also be effective? <span style="font-family: 'Open Sans', arial, sans-serif; font-size: 15.008px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; text-align: inherit;">Upload your paragraph to Dropbox.

<div style="font-family: 'Open Sans', sans-serif; font-size: 15.008px; font-style: normal; font-variant-caps: normal; caret-color: #2c2c2c; color: #2c2c2c; font-variant-ligatures: normal;">

These activities will occur on the Friday of Week #4

<div style="font-family: 'Open Sans', sans-serif; font-size: 15.008px; font-style: normal; font-variant-caps: normal; caret-color: #2c2c2c; color: #2c2c2c; font-variant-ligatures: normal;">

On Friday we will convene to share accomplishments and discuss lessons learned. Final presentations will be structured as follows: round robin &quot;reports&quot; (maximum of 10 minutes each) from each of you as follows:

<div style="font-family: 'Open Sans', sans-serif; font-size: 15.008px; font-style: normal; font-variant-caps: normal; caret-color: #2c2c2c; color: #2c2c2c; font-variant-ligatures: normal;">


 * What did I accomplish this month (broad overview)?
 * What did I learn?
 * What will I take forward with me into the future?
 * Now in hindsight, is there anything I would have done differently?

<div style="font-family: 'Open Sans', sans-serif; font-size: 15.008px; font-style: normal; font-variant-caps: normal; caret-color: #2c2c2c; color: #2c2c2c; font-variant-ligatures: normal;">

We will conclude our meeting with a focus group about the elective overall. This will include:


 * Feedback about the guest consultants
 * Strategies for improvement for future cycles of the elective

Everyone should have finished all of the work they'll do on Wikipedia, and be ready for grading.