Wikipedia:Wiki Ed/Vanderbilt University School of Medicine/WikiMed Fall 2020 (Fall 2020 elective)

“Imaging a world where all people have access to high quality health information clearly written in their own language” – Wikipedia co-founder Jimmy Wales.

Welcome to the second Vanderbilt University School of Medicine WikiMed Advanced Elective (AE).In this month-long AE, you will have the opportunity to work individually and on small teams to better understand and contribute to medical content on collaborative learning platforms, or &quot;wikis&quot;. The goal of this course is to develop skills in literature search and review, as well as medical writing and editing. The course will kick off with a WikiMed “bootcamp” - a two-day introduction to medically focused wiki platforms (Wikipedia, Radiopedia, Orthobullets, HemOnc.org) and the various considerations to keep in mind in contributing to this content. Students will work on teams on article selection, research, and editing over the course of the month. Over the course of the month, there will be mandatory virtual or in-person Work-in-Progress (WIPs) in which students will touch base with peer reviewers, course directors, and librarians. By the end of the month, students will have made meaningful and durable contributions to Wikipedia or medical wiki topics of interest, and will have the tools to effectively contribute medical content to collaborative platforms.

Week 2
Welcome to the VUSM WikiMed course timeline! This page will serve as a resource with updates, required check-ins, links, and training modules for your upcoming rotation.

Thank you to Amin Azzam from UCSF and his team for laying the groundwork for this course. Many handouts and presentations were developed from their team, and we are grateful for their permission to share these valuable resources with you in the coming month!

'''Monday 10/28 @undefined 10 am - 4 pm, 2525 WEA 1545

'''


 * 10-11: Introduction and HemOnc.org (Jeremy Warner)
 * 11-12: How to become a Wikipedian (Mary Anne Caton)
 * 12-1: Lunch and trainings
 * 1-2: Overview of WikiMed (Amin Azzam)
 * 2-2:30: More trainings
 * 2:30-3: WikEM (Dan Ostermayer)
 * 3-4: discuss workplan, Wikiproject medicine style guidelines, begin selecting articles, begin designing teams and workplans

All sessions available on Zoom: https://zoom.us/j/5855066483

Homework: select an article to present on day 2 as your semi-final chosen article

Tuesday 10/29 @undefined 10 am - 4 pm, EBL 325B


 * 10-11: Present and discuss selected articles
 * 11-12: Overview of library resources (Philip Walker)
 * 12-1: Lunch and trainings
 * 1-1:30: Wiki Journal Club (Tim Plante)
 * 1:30-3:  discuss peer-review, WIPs, and communication,  draw names for peer review
 * 3-4: A future vision of WikiMed (Amin Azzam)

All sessions available on Zoom:  https://zoom.us/j/5855066483

'''Resources:

'''


 * Editing Wikipedia, pages 1–5
 * Evaluating Wikipedia
 * Hemingway App
 * All WPM list of missing articles (medicine)
 * Requested articles: people in medicine
 * Wikipedia:WikiProject Missing encyclopedic articles/List of notable books on history of medicine
 * Requested articles: Medicine

Presentations: 


 * Jeremy's slides
 * MaryAnne's slides
 * Amin's slides: Day 1
 * Amin's slides: Day 2
 * Recording of Philip Walker's remarks
 * Recording of discussion about peer review and Amin's Day 2 remarks

Handouts/Readings: 


 * Workplan
 * Medical Wikis Dedicated to Clinical Practice: A Systematic Review
 * Medical Wiki Overview Table

These completed modules are due by the end of Day 1.

These completed modules are due by the end of Day 2



By 10am on Friday November 1st (e.g., before  our first WP-WIP), post your final Workplan to your selected Wikipedia's talk page, so that you can engage with the Wikipedian community members who are interested &amp; actively following your article. If you are working on a team, I want you to be explicit about what section(s) you will  individually  be responsible for.

Consider explicitly declaring any/all of the following (but don't feel limited to these):


 * Is each fact referenced with an appropriate, reliable reference?
 * Is everything in the article relevant to the article topic? Is there anything that distracted you?
 * Is the article neutral? Are there any claims, or frames, that appear heavily biased toward a particular position?
 * Where does the information come from? Are these neutral sources? If biased, is that bias noted?
 * Are there viewpoints that are overrepresented, or underrepresented?
 * Check a few citations. Do the links work? Is there any close paraphrasing or plagiarism in the article?
 * Is any information out of date? Is anything missing that could be added?
 * Which sections will you prioritize?
 * What resources do you intend to look up, and when?
 * How will you decide what things (signs, symptoms, side-effects, etc.) to explicitly include? To explicitly exclude?
 * Will you also embed additional links to other Wiki pages?
 * How will you ensure you avoid &quot;doctor-speak&quot; and not use jargon?

Handout:  Workplan worksheet

After reading the systematic review and additional references in the overview table (as indicated by your interest), select a medical wiki to learn more about over the course of the block. Before the WIP, please write a short paragraph about why you made the choice, and upload to Dropbox. If the chosen medical wiki is open to contributors, sign up for an account.

On Friday, November 1 we will have an informal check-in to discuss progress, troubleshoot, and share thoughts about the process of writing and contributing to Wikipedia.

Upload your WIP document to Dropbox for November 1 work-in-progress

Join Zoom Meeting

https://zoom.us/j/5855066483

Meeting ID: 585 506 6483

One tap mobile

+19292056099,,5855066483# US (New York)

+16699006833,,5855066483# US (San Jose)

Dial by your location

+1 929 205 6099 US (New York)

+1 669 900 6833 US (San Jose)

Meeting ID: 585 506 6483

Find your local number: https://zoom.us/u/acRpwFMqxU

Week 3
Reach out to your Wikipedia Expert if you have questions using the Get Help button at the top of this page.

Resource: Editing Wikipedia, pages 7–9

By the end of this week, you should start making edits live on WIkipedia (not just your Sandbox)

This is perhaps the most important theme. Medical wiki entries and edits should be both accurate and unambiguous. This is particularly true for wikis that lend instructions for therapy and guidance on best practices. Inaccurate guidance can lead to tragic consequences. The reading this week relates to the importance of accuracy in chemotherapy prescribing and administration.

• Chemotherapy medication errors (Lancet Oncol)

Assignment: after reading the article, consider what the consequences of inaccurate information on your chosen medical wiki might be. Locate and read the liability information on the medical wiki. Before the WIP, write a paragraph on the consequences of inaccuracies on the medical wiki for the user as well as the wiki. Should medical wikis be subject to FDA or other oversight? Upload your paragraph to Dropbox.

On Friday, November 8 we will have an informal check-in to discuss progress, troubleshoot, and share thoughts about the process of writing and contributing to Wikipedia.

Upload your WIP to Dropbox for November 8 work-in-progress

Join Zoom Meeting

https://zoom.us/j/5855066483

Meeting ID: 585 506 6483

One tap mobile

+19292056099,,5855066483# US (New York)

+16699006833,,5855066483# US (San Jose)

Dial by your location

+1 929 205 6099 US (New York)

+1 669 900 6833 US (San Jose)

Meeting ID: 585 506 6483

Find your local number: https://zoom.us/u/acRpwFMqxU

Week 4


Please perform peer reviews beginning on or around Monday November 11

What should a peer-review look like? During our discussion in class on Tues 10/29, we will define specific attributes we will itemize here.


 * Transparent (unblinded)
 * Goal should be clearly explained by the author and evaluated by the peer reviewer
 * Wikipedia peer-review rubric is nice, seems like a good starting point
 * Lead (Intro) section - is it clear, does it flow, easy to understand, have a picture?
 * Other sections generally following the Wiki Project Medicine content categories
 * Checklists, maybe? Rubric is pretty much the checklist
 * Are the changes significant enough to matter?
 * Thinking about the 6 B-class criteria for those trying to move from C to B
 * Gestalt and intuition --&gt; specific comments
 * Constructive feedback (don't just say &quot;great job!&quot;) - sandwich method of 2 good and 1 bad
 * Think about how to respond to comments from external reviewers (other Wikipedians)
 * Readability is important, but might be hard to assess - also it matters for who is going to read the material
 * Peer reviewers should refrain from making edits, leave these to the primary page &quot;owner&quot;
 * Think about a mechanism for adjudication



How to conduct peer review? Themes/questions that might emerge:


 * Peer reviews are DUE by Friday, November 15th
 * Post the peer-review on the TALK page of the article you are reviewing.
 * Here's a link to a grading rubric that Wiki Ed offers for evaluating student contributions to Wikipedia articles.  While we MIGHT formally use the point system, it does provide a nice complement to our &quot;home-grown&quot; peer-review process.

Handout: wikipedia peer-review rubric

In addition to the accuracy of the existing content, medical wikis should be reasonably complete, at least for a described scope. Here are two readings focused on completeness of drug content on Wikipedia and timeliness to publish research findings, with findings easily transferrable to medical wikis:


 * Accuracy and completeness of drug information in Wikipedia: a com-parison with standard textbooks of pharmacology (PLoS One)
 * Time to publish: challenging the performance of cooperative group lymphoma trials (Lancet Haematology)

Optional reading: for historical context, this article published in 2008 is a good contrast to the 2014 PLoS One article above.


 * Scope, completeness, and accuracy of drug information in Wikipedia (Ann Pharmacother)

Assignment: after reading the articles, consider what the consequences of incomplete information on your chosen medical wiki might be. Locate and read the standards for inclusion and prioritization on the medical wiki, if available (e.g., HemOnc.org's are here). <span style="font-family: 'Open Sans', arial, sans-serif; font-size: 15.008px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; text-align: inherit; font-weight: 600; color: #2c2c2c;">Before the WIP <span style="font-family: 'Open Sans', arial, sans-serif; font-size: 15.008px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; text-align: inherit; color: #2c2c2c;">, write a paragraph on the consequences of incompleteness on the medical wiki. Since no information source is going to be complete or &quot;real-time&quot;, is the missing information biased in some important way? For example consider the effects of publication bias. <span style="font-family: 'Open Sans', arial, sans-serif; font-size: 15.008px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; text-align: inherit;">Upload your paragraph to Dropbox.

On Friday, November 15 we will have an informal check-in to discuss progress, troubleshoot, and share thoughts about the process of writing and contributing to Wikipedia.

<span style="font-family: 'Open Sans', arial, sans-serif; font-size: 15.008px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; text-align: inherit;">Upload your WIP to Dropbox for November 15 work-in-progress

Join Zoom Meeting

https://zoom.us/j/5855066483

Meeting ID: 585 506 6483

One tap mobile

+19292056099,,5855066483# US (New York)

+16699006833,,5855066483# US (San Jose)

Dial by your location

+1 929 205 6099 US (New York)

+1 669 900 6833 US (San Jose)

Meeting ID: 585 506 6483

Find your local number: https://zoom.us/u/acRpwFMqxU

Week 5
Every student has finished reviewing their assigned articles, making sure that every article has been reviewed.

All peer reviews should have been completed and posted to the talk page of the '''page being reviewed BEFORE WIP #4. '''

You probably have some feedback from other students and possibly other Wikipedians. Consider their suggestions, decide whether it makes your work more accurate and complete, and edit your draft to make those changes.

'''How to respond to peer-reviewer's comments:

[Insert from 10/29 discussion] '''

Resources:


 * Editing Wikipedia, pages 12 and 14
 * Reach out to your Wikipedia Expert if you have any questions.

Continue to expand and improve your work, and format your article to match Wikipedia's tone and standards. Remember to contact your Wikipedia Expert at any time if you need further help!

It's the final week to develop your article.


 * Read Editing Wikipedia page 15 to review a final check-list before completing your assignment.
 * Don't forget that you can ask for help from your Wikipedia Expert at any time!

Wikis that are not discovered by potential users are clearly not as useful as those that are heavily used. Wikipedia clearly has an outsized advantage, being one of the top 5 most-visited websites. Medical wikis tend to have a much more specialized audience. Once someone discovers a new site such as a medical wiki, content on a large wiki can be diﬃcult to locate and that can impact usefulness and willingness to continue to use the resource. Related to discovery, the ”rate of returning visitors” (RVR) is a major measure of success for any web resource.

Readings:


 * Google Analytics overview
 * Article on RVR

Assignment:

Using one or more search engines (e.g., Google, Bing, Yagoo, Baidu etc.) of your choice, try to discover some of the content of your chosen medical wiki. Before the WIP, in a short paragraph, comment on where the search results appear (if at all) and how this might impact traﬃc to the medical wiki. Are search engines the best way for new users to discover medical wiki content? What are other methods that might also be effective? <span style="font-family: 'Open Sans', arial, sans-serif; font-size: 15.008px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; text-align: inherit;">Upload your paragraph to Dropbox.

<div style="font-family: 'Open Sans', sans-serif; font-size: 15.008px; font-style: normal; font-variant-caps: normal; caret-color: #2c2c2c; color: #2c2c2c; font-variant-ligatures: normal;">

These activities will occur in EBL (room TBD) on Friday, November 22

<div style="font-family: 'Open Sans', sans-serif; font-size: 15.008px; font-style: normal; font-variant-caps: normal; caret-color: #2c2c2c; color: #2c2c2c; font-variant-ligatures: normal;">

On Friday, November 22 we will convene for a 2 hour  meeting to share accomplishments and discuss lessons learned. Final presentations will be structured as follows: round robin &quot;reports&quot; (maximum of 10 minutes each) from each of you as follows:

<div style="font-family: 'Open Sans', sans-serif; font-size: 15.008px; font-style: normal; font-variant-caps: normal; caret-color: #2c2c2c; color: #2c2c2c; font-variant-ligatures: normal;">


 * What did I accomplish this month (broad overview)?
 * What did I learn?
 * What will I take forward with me into the future?
 * Now in hindsight, is there anything I would have done differently?

<div style="font-family: 'Open Sans', sans-serif; font-size: 15.008px; font-style: normal; font-variant-caps: normal; caret-color: #2c2c2c; color: #2c2c2c; font-variant-ligatures: normal;">

We will conclude our meeting with a focus group about the elective overall. This will include:


 * Feedback about the guest consultants
 * Strategies for improvement for future cycles of the elective

Everyone should have finished all of the work they'll do on Wikipedia, and be ready for grading.