Community health initiative/Blocking tools and improvements/Block notices
This page documents a feature the Wikimedia Foundation's Anti-Harassment Tools team may build. Development of this feature is complete.
Block notices are the messages that appear to blocked users that inform them of their block status and parameters. In 2018 the WMF's Mobile Web and Anti-Harassment Tools teams made some changes to the mobile block notice and measured how often they appear to users across different devices.
- Block notices appear very often on the largest Wikimedia projects, sometimes outnumbering actual edits. (6.2 million blocked edits occured on English Wikipedia over a 30-day period.)
- The desktop wikitext editor sees the vast majority of impressions by a wide margin. (98% on English Wikipedia, 89.5% on Spanish, and 98.7% on Russian.)
- The VisualEditor and mobile block notices may occur less frequently, but still display to thousands of people every month. There are hurdles to optimizing their displays, given the legacy of desktop-first design.
Here are the standard block notices:
When a user is blocked, the system can display the following information. Not all needs to be displayed:
- The current session's username or IP
- The target username, IP address, or autoblock ID number
- The admin who configured the block
- The timestamp of when the block was set
- The timestamp (and/or calculated time remaining) of when the block expires
- The block reason
- If the block is partial or sitewide
The desktop messages include information on how to report an incorrect block. The mobile block notices do not, because the workflow is not optimized for mobile.
In December 2018 we enabled tracking on block notices to roughly answer the question "how many times do these notices display?" An interactive dashboard of graphs is available at this Grafana link and a screenshot of data from December 19, 2018 to January 18, 2019 is embedded on this page. Here are some preliminary findings:
- Far and away, the most common format which people see the block notices is on the desktop wikitext editor. (They display as green in the charts.)
- English Wikipedia — 98.47% of all block notices that appeared were the desktop wikitext editor, resulting in 6.1 million impressions.
- Spanish Wikipedia — 89.5%
- Russian Wikipedia — 98.74%
- French Wikipedia — 94.06%
- Italian Wikipedia — 62.21%
- The second-most common display of the block notice is the VisualEditor. The percentage of these is much lower than expected. A next step for investigation would be to calculate the ratio of wikitext edits to wikitext block notices, and visual edits to visual blocks notices.
- The occurrence of API block notice displays vary greatly from wiki to wiki, but appears steady across all 30 days. These are likely unsophisticated spam bots that are blocked but still attempt to edit.
- The ratio of edits to blocked edits varies greatly on a wiki by wiki basis. (See table below.) On some wikis there are more attempted edits that are blocked (RU, EN) but on others the edits greatly outweigh the block notice impressions (ES, IT).
- Another aspect that should be explored is page protection as a spam, vandalism, and misconduct mitigation tool.
|English Wikipedia||EN % Total||Spanish Wikipedia||ES % Total||Russian Wikipedia||RU % Total||Italian Wikipedia||IT % Total|
|IP Range (current)||8,502||0.75%||24||0.04%||47,856||2.44%||30||0.05%|
|Monthly Block notices||Wikitext||6,100,000||98.47%||40,000||89.54%||1,000,000||98.74%||10,700||62.21%|
|Ratios||Notices : All blocks||5.46||0.75||0.52||0.31|
|All blocks : Notices||0.18||1.33||1.93||3.27|
|Notices : Edits||1.54||0.08||2.27||0.04|
|Blocks set : Edits||0.00||0.00||0.09||0.00|
|Notices : IP Edits||7.81||0.25||11.75||0.15|
|Blocks set : IP Edits||0.01||0.00||0.46||0.00|
|Notices : Editors||14.14||0.47||21.46||0.38|
|Blocks set : Editors||0.02||0.00||0.85||0.01|
|Notices : IP Editors||20.77||0.59||29.01||0.48|
|Blocks set : IP Editors||0.03||0.00||1.15||0.01|
|Mobile : Desktop notice||0.01||0.06||0.00||0.17|
|Blocks set||April 30 - May 7, 2018||https://docs.google.com/spreadsheets/d/1_4GZ2WUurxaehlNeab5mF7VDgOgHd-PXjFjsLD5tY2Q/edit#gid=1703473757|
|Block notices displayed||Dec 19 - Jan 18, 2019||https://grafana.wikimedia.org/d/000000618/blocknotices?orgId=1&from=now-7d&to=now|
|Edits + Editors||Nov 2018||https://stats.wikimedia.org/v2/#/it.wikipedia.org/contributing/edits/normal|bar|1-Month|~total|
|Blocks active||Dec 20||https://quarry.wmflabs.org/query/32169|
- Ideally all of this data would be from the same period of time (e.g. January 1 to January 31, 2019.) This did not happen for this initial report, for time constraints. I'll aim to recalculate everything in early February.
- Data could be affected by adblock and privacy blockers. The actual numbers will be higher.
- API edits include mobile app edits, bot edits, and a longtail of other sources
- The visualeditor 'returned' data is calculated via API and the 'shown' is calculated via tracking pixel. In short, 'shown' means a human saw it.
- There are usual seasonality changes around late December for the holidays — edits usually decrease. We'll leave the tracking on until March 1 at a minimum to capture two full calendar months of data. (phab:T214214)
- There appears to be something interfering the data from properly gathering on German Wikipedia. We do not have time to investigate, it will just have to be an unsolved mystery.
Considerations for the futureEdit
Intended audiences & designEdit
Blocks are set to quarantine damage from occurring to the wikis, they are not set as punishments. There are two intended audiences who may see these block notices, and one unintended audience:
- People who are temporarily blocked who can return after cooling down
- People who are not welcome to ever return
- Accidental bystanders who happen to be on the same IP address or range.
In the case for #1 and #3, the block notice should likely be informative on when the block expires and/or how to request the block be lifted. For #2, the block should be clear but not motivate the people to evade the block. With the current block software it is impossible to differentiate between these, but maybe in the future we want to offer different styles of block notices.
The block notice field supports wikitext. Many wikis have used this functionality to build desktop-appropriate block messages, such as the English Wikipedia screenshot above. This message does not appropriately display in the VisualEditor or on mobile (web or apps.) A new approach to block reasons should be considered to 1) allow for better display across experiences and 2) allow for more structured logging, to better help determine the efficiency of blocks.