Wikimedia Enterprise/zh

This page is a translated version of the page Wikimedia Enterprise and the translation is 10% complete.

Wikimedia Enterprise是维基媒体基金会新的跨部门项目。该项目的目标是为使用维基媒体内容的大型营利机构建立一套服务。该项目旧称“Okapi”。

Wikimedia Enterprise
enterprise.wikimedia.com
项目首页原则
文章 & 常見問題 (2021年3月)
技術MediaWikiPhabricator
GitAPI 文档

The focus is on organizations that want to repurpose Wikimedia content in other contexts, providing data services at a large scale, so that they are faster and more comprehensive, reliable, and secure. Wikimedia Enterprise aims to improve the user experience of Wikimedia's readers beyond our own websites; increase the reach and discoverability of the content; and improve awareness and ease of attribution and verifiability by the organizations that reuse Wikimedia content the most—through self-funding services.

Contact the team if you would like to arrange a conversation about this project with your community, at a time and meeting software platform of your choice.

slides
Presentation at the EMWCon Spring 2021 conference

Next public meeting: Friday October 22 @ 1500 UTC on Zoom.

Past public meetings:

...and also at the March Strategic Wikimedia Affiliates Network (SWAN) meeting; the May 2021 Wikimedia Clinic; and at Wikimania 2021. In March 2021 the project was also featured in WIRED.


除了普通的阅读和编辑之外,使用维基媒体数据的进入门槛很高。这是因为机器难以分割并理解这些内容,这就影响了维基媒体数据在我们的生态系统之外使用范围能有多广、作用能有多大。

In the Movement Strategy recommendations to increase the sustainability of our movement and improve user experience there are the recommendations to, respectively: "Explore new opportunities for both revenue generation and free knowledge dissemination through partnerships and earned income—for example...Building enterprise-level APIs," and "Make the Wikimedia API suite more comprehensive, reliable, secure and fast, in partnership with large scale users.... and improve awareness of and ease of attribution and verifiability for content reusers."

众所周知,一些大公司使用了我们项目的数据。这些公司意识到如果没有维基媒体项目,他们就无法为自己的用户提供如此丰富或可靠的使用体验。社群成员中早就有一种感觉,即这些公司应该将他们在这些内容和使用的资源上获得的利益再投资多一些给维基媒体的社群。

This led to the idea of developing a new approach that is more sustainable in the long term and provides a much clearer relationship between Wikimedia and enterprise users. Most financial benefit for Wikimedia would likely only come from a very small handful of heavy for-profit users, and would feed back into the Wikimedia movement.

As this idea developed, it became clear there is a responsibility to democratize our data for organizations that do not possess the resources of these largest users, to ensure we are leveling the playing field and helping to foster a healthy internet without reinforcing monopolies. The benefits of such a service shouldn't just be for startups or alternatives to the internet giants, but also for universities and university researchers; archives and archivists; along with the wider Wikimedia movement.

Wikimedia Enterprise timeline (2020-21).png

概况

Wikimedia Enterprise主要关注的是重复使用我们内容的商业机构,通常是大规模的——例如把内容整合进知识图谱、搜索引擎、语音助手、地图、新闻、社群工具、第三方应用以及完整语料研究的机构。将维基媒体为数众多的数据集切割开,在我们无系统性的内容背后构建出一套体系,就能够让我们的内容重用者满足他们各自的需求,也能让我们在未来为所有人打造新工具、提供新服务。我们内容的重用者寻求的是三个关键要素:

  • 效率:定期的维基媒体项目最新数据快照
  • 可靠:可信赖的、易使用的底层系统
  • 质量:一个“最好的最终版本”

Emphasizing a self-funding set of specific use cases allows the Wikimedia API team to focus on volunteers, teams, and organizations looking to access (and, most importantly, interact with) our data sets. This includes the majority of community editing tools, which will be out of scope for this project. For more information on improvements to the existing Wikimedia APIs see the project page on the "API Gateway" initiative.

Program Goals:

  • Content: Make more of our movement's content available in consistent machine-readable formats, freely available for all researchers and re-users.
  • Resource-load: Reduce the need for high-intensity site-scraping by the highest-frequency and highest-volume reusers, which currently target our production servers.
  • Fundraising: Provide a clearer and more consistent way for the largest re-users to reinvest derived benefits back to the movement, instead of making occasional altruistic donations that vary in size.

Community

These are the introduction paragraphs for a much more detailed Community essay.

The full essay covers the following topics

Libre and Gratis are the two meanings of “free,” commonly phrased as free as in speech, or free as in beer.

Wikimedia projects are, have always been, and will always remain libre. The principles of free cultural works mean that anyone can use Wikimedia without restriction, including commercially. As a movement, we embrace this. It is why we reject ‘non-commercial’ licenses, as they would limit the kinds of reuse possible. And it is why we consider commercial reuse an important means of distributing knowledge to audiences.

Equally, Wikimedia projects are, have always been, and will always remain gratis. The ability to freely access the knowledge available across all Wikimedia projects has always been core to the mission of the Foundation and the movement. We provide this access not only to individuals visiting our websites but also programmatically to machines so that our content can be repurposed in other environments. The full corpus of Wikimedia content always has been, and will continue to be, made available for reuse in various forms (including but not limited to database dumps, APIs, and scraping) at no cost.

As a result, our content is often repurposed by for-profit organizations that rely on it to support their business models, and which consequently earn revenue from it. Outside of voluntary corporate donations to the Wikimedia Foundation, the movement has never received benefits from any of this revenue through return investment. In acknowledgement of this, under the heading of Increase the sustainability of our movement the Movement Strategy process asked the Wikimedia Foundation to explore, among other things, “enterprise-level APIs...models for enterprise-scale for-profit reusers, taking care to avoid revenue dependencies or other undue external influence in product design and development.” Furthermore, under the heading Improve User Experience, a further recommendation stated, "Make the Wikimedia API suite more comprehensive, reliable, secure, and fast, in partnership with large scale users where that aligns with our mission and principles, to improve the user experience of both our direct and indirect users, increase the reach and discoverability of our content and the potential for data returns, and improve awareness of and ease of attribution and verifiability for content reusers."

The Enterprise project team is developing a new resource aimed at for-profit content reusers, who have product, service, and system requirements that go beyond what we freely provide. Use of this offering will not be required for for-profit content reuse; companies can continue to use the current tools available at no cost. All Enterprise API revenue will unequivocally be used to support the Wikimedia mission—for example, to fund Wikimedia programs or help grow the Wikimedia Endowment.

This project represents a new kind of activity at the Foundation. The project is at a very early stage that should be considered a learning period. We will have successes, we will make mistakes, and we will need to adapt our strategies. The team is committed to listening, engaging, and where possible, integrating the feedback we get on our work. This document is organic and is reflective of the team's current thinking; we are attempting to document as much work as possible in the open. Up until now, our work has been shaped by a series of initial interviews with community members, Wikimedia Foundation Board and staff, researchers, and reusers.

...continue to read the rest of the Community essay. See also the FAQ and Principles.

Given the nature of the project, primary decision making for it will rest with the Wikimedia Foundation. We are seeking community input, in particular from the technical community and those who have been involved in the strategy process, throughout the lifetime of the project. Technical feedback has been gathered from colleagues at the Wikimedia Foundation, industry and research partners, technical partners across the movement, and with the broader technical communities via Phabricator. Input into the funding development side of the project will follow a similar pattern. We will continue gathering input via research interviews and focus groups, as well feedback here on Meta as per our principles.

Technical

For full information about the product work, see
the documentation homepage on MediaWiki.org
.

Over time, the "product" being offered will grow and improve.

The Q4 2021 release (May/June 2021) of the Enterprise APIs proposes the following:

Type Name Compare To What is it? What’s New?
Realtime Enterprise Activity "Firehose" API EventStream HTTP API A stable, push HTTP stream of real time activity across “text-based” WMF Projects
  • Push changes to client with stable connection
  • Filter by Project and Page-Type
  • Be Notified of suspected vandalism in real time
  • Machine Readable and Consistent JSON schema
  • Guaranteed uptime, no rate-limiting
Enterprise Structured Content API Restbase APIs Recent, machine readable content from all “text-based” WMF Projects
  • Machine Readable and Consistent JSON schema
  • Guaranteed uptime, no rate-limiting
Bulk Enterprise Bulk Content API Wikimedia Dumps Recent, compressed WMF data exports for bulk content ingestion
  • Machine Readable and Consistent JSON schema
  • Daily “Entire Corpus” exports
  • Hourly “Activity” exports
  • Guaranteed delivery
  • Historical Downloads

Access

有三种方法获得企业版API数据集的使用权:

  • 付费

**Bulk and Real-time. Through the dedicated Enterprise API product website, when it is launched.

  • 免费

**Bulk. A fortnightly update of the Enterprise API data will be provided for all at https://dumps.wikimedia.org/ **Daily+Hourly diffs. Via Wikitech:Portal:Data Services, available to anyone with a Wikimedia cloud services account.

 
A screenshot from the alpha dashboard (when the project was nicknamed "Okapi") where users can download and save daily exports of HTML from "text-based" Wikimedia projects

Team

Additionally, Speed & Function are providing contracted engineers. At this early stage in the project, we are not yet sure of the long-term engineering needs and we wish to thoroughly assess the project's ability to become self-sustaining. This way we don't excessively disrupt other WMF projects or divert resources.

The board of the LLC overseeing the project are from Wikimedia Foundation leadership, representing their WMF staff roles: Lisa Seitz-Gruwell Chief Advancement Officer; Tony Sebro, Deputy General Counsel; and Lane Becker. Ultimately, the LLC is subject to the governance of the Wikimedia Foundation Board of Trustees.

The LLC's legal registration can be found at the State of Delaware, Division of Corporations, Entity name: Wikimedia, LLC, File number: 7828447.

See also: FAQ § Legal

See also

  • API:Main page – the central listing of all Wikimedia APIs.
  • Wikitech: Data Services portal – A list of community-facing services that allow for direct access to databases and dumps, as well as web interfaces for querying and programmatic access to data stores.
  • Enterprise hub – a page for those interested in using the MediaWiki software in corporate contexts.