aboutsummaryrefslogtreecommitdiffstats
path: root/includes/deferred
Commit message (Collapse)AuthorAgeFilesLines
...
* | Track deletion timestamp in LinksDeletionUpdateAaron Schulz2016-06-141-3/+10
|/ | | | | | | | | Use this to prevent deleting new RC entries at the title of page deletion that were created since the deletion. This is useful if an event performs a deletion and makes a new RC entry or if there is high job queue lag. Change-Id: I20f6a4aa0a660a24583c1d71f825b73daa748a24
* LinksDeletionUpdate: Fix typos in column namesGlaisher2016-06-081-3/+3
| | | | | Bug: T137280 Change-Id: I78ee489f10e796d2b3fa39dcb4f65f0763860bf3
* Avoid contention in updateLinksTimestamp()Aaron Schulz2016-06-071-6/+6
| | | | | | | | | | Since LinksUpdate::doUpdate() already flushes the transaction, go ahead and flush before other DataUpdates might run (e.g. from RefreshLinksJob). Also release the lock before running the LinksUpdateComplete handlers, as the lock is just to keep LinksUpdate instances from racing with each other. Change-Id: Ied97fa36fbca0203123e9fc966d2e23bfd621c0e
* Merge "Make LinksDeletionUpdate use query batching"jenkins-bot2016-06-021-22/+94
|\
| * Make LinksDeletionUpdate use query batchingAaron Schulz2016-05-231-22/+94
| | | | | | | | | | Bug: T95501 Change-Id: Ib0c911b030ae17cb7b0729be223b89d64c8c4b3f
* | Merge "Add LinksUpdate::getRevision()"jenkins-bot2016-05-261-0/+8
|\ \
| * | Add LinksUpdate::getRevision()Roan Kattouw2016-05-261-0/+8
| |/ | | | | | | | | | | | | | | Similar to getTriggeringUser(). Also propagate it to subjobs similarly. Bug: T135959 Change-Id: I3d894acaf3d85b790e5034c7d9f76bf94672f445
* / Lowered incrTableUpdate() batch size to $wgUpdateRowsPerQueryAaron Schulz2016-05-191-5/+5
|/ | | | Change-Id: I05787b6e9ace26e7a20c228fbc3502983dfed777
* Make LinksUpdate only wait on the DB with the link tablesAaron Schulz2016-05-181-2/+2
| | | | | Bug: T135690 Change-Id: If79ca385884f422e5ed11e77b29033c8cabf494c
* Convert CdnCacheUpdate to event per URLStanislav Malyshev2016-05-161-5/+11
| | | | | Bug: T134535 Change-Id: I73e22606e86b4db1bc9bf2cb12b9605507ffe2c2
* Batch links updates performed by refreshLinks jobsAaron Schulz2016-05-132-31/+94
| | | | | | | | | | | | | This should avoid erratic lag spikes that happen as many links are added and removed via new pages (sometimes bot generated) and edits that blank pages as well as their reversions. In the common cases of a modest number of link changes, the entire update will still happen in one transaction. In any case, link updates now use a lock to avoid clobbering each other on the same page. Bug: T109943 Change-Id: Icd453fcc3d28342065893260ad327eae11870245
* Merge "Do not let DataUpdate exceptions block other deferred updates"jenkins-bot2016-05-061-1/+6
|\
| * Do not let DataUpdate exceptions block other deferred updatesAaron Schulz2016-04-261-1/+6
| | | | | | | | Change-Id: Ida563b29b5450c44358155fc937cd7eeb87090c2
* | Document mInterwikis in LinksUpdateAaron Schulz2016-05-021-0/+3
|/ | | | Change-Id: If10840c5df849455027b5a497097e583fb982a65
* Convert SearchEngine to service containersStanislav Malyshev2016-04-251-7/+12
| | | | Change-Id: Icef1ecbed3d831557e0256fdfa53743b194007cc
* Convert EventRelayerGroup to services infrastructureStanislav Malyshev2016-04-251-1/+3
| | | | Change-Id: If55ddf441de69189c7fcdd3440f899c6b14f690f
* Convert all array() syntax to []Kunal Mehta2016-02-177-140/+140
| | | | | | | | | | Per wikitech-l consensus: https://lists.wikimedia.org/pipermail/wikitech-l/2016-February/084821.html Notes: * Disabled CallTimePassByReference due to false positives (T127163) Change-Id: I2c8ce713ce6600a0bb7bf67537c87044c7a45c4b
* Stop doing $that = $this in includes/deferredRicordisamoa2016-02-101-3/+2
| | | | | | Closures support $this as of PHP 5.4 Change-Id: I2632d0c2bdc9e2fec72f1c64c3868dcb442ba871
* Make CDN purges send EventRelayer eventsAaron Schulz2016-02-091-0/+12
| | | | | | | * Also create EventRelayerGroup class and config Bug: T97562 Change-Id: Id7c9b0deb0ffd21277572a8e6407f87be6931a4d
* Merge "Small code cleanups to MWCallableUpdate"jenkins-bot2016-01-201-8/+3
|\
| * Small code cleanups to MWCallableUpdateAaron Schulz2016-01-131-8/+3
| | | | | | | | Change-Id: I269199f65ffc6ad50d16cb984c28b51a815e9a8f
* | Add AtomicSectionUpdate deferred update classAaron Schulz2016-01-141-0/+34
|/ | | | | | | This makes it easier to have deferred atomic DB transactions Bug: T122115 Change-Id: I67afe335f03cc21fdce78abdf3f31fa67a368419
* Pass __METHOD__ to load balancer commit/rollback methodsAaron Schulz2015-12-221-2/+2
| | | | Change-Id: I3fd87908c2a493fae49de6a29efe79f8d433c112
* Rename getSquidURLs() => getCdnUrls()Aaron Schulz2015-12-111-2/+2
| | | | Change-Id: I433acc7990a5fcefd0d2ff5b14ba33dec0424706
* Use GAID_FOR_UPDATE for getArticleID() in LinksUpdateAaron Schulz2015-12-111-1/+1
| | | | | Bug: T121228 Change-Id: I33addea4261d58cc93ab739621481065eb9c908d
* Add $wgCdnReboundPurgeDelay for more consistent CDN purgesAaron Schulz2015-12-101-6/+18
| | | | | Bug: T113192 Change-Id: I89deb4f8143c1cc6154cdd05bcee1f49d3e3a75a
* Replace "squid" with "CDN" in various commentsAaron Schulz2015-12-091-4/+3
| | | | Change-Id: Idcc528daf28e119349155d36e30a9bcf61b2e7d5
* Rename SquidUpdate => CdnCacheUpdateAaron Schulz2015-12-091-7/+14
| | | | | | Squid is not the only possible CDN Change-Id: Ie2a2955847c5706e630322bbbab71c9d063b378f
* Remove obsolete category links codeAaron Schulz2015-12-051-12/+0
| | | | | | | * These calls and methods should no longer be needed * Follow-up to 6dedffc2d7f8 Change-Id: Iff121263610117112c84edb5e575f039456d1ac8
* Remove DeferredUpdates::forceDeferral() testing hackAaron Schulz2015-12-041-16/+0
| | | | Change-Id: I7f2ad8190e1a746b6c39190b86fa9c83c5b921fe
* Merge "Add mergeable update support DeferredUpdates"jenkins-bot2015-12-043-12/+45
|\
| * Add mergeable update support DeferredUpdatesAaron Schulz2015-12-043-12/+45
| | | | | | | | | | | | | | | | | | | | * DeferrableUpdate classes can implement MergeableUpdate. Duplicate updates will be merged via the merge() method. * Make SquidUpdate support merge() so that duplicate URL purges are now caught accross the entire pre-send request execution. Change-Id: Idffdd3e71d89e4a0f28281e65a881113caae497c
* | Merge "Add pre-send update support to DeferredUpdates"jenkins-bot2015-12-042-52/+84
|\|
| * Add pre-send update support to DeferredUpdatesAaron Schulz2015-12-042-52/+84
| | | | | | | | | | | | | | | | | | | | | | | | | | * PRESEND/POSTSEND constants can now be used in addUpdate() and addCallableUpdate() to control when the update runs. This is useful for updates that may report errors the client should see or to just get a head start on queued or pubsub based updates like CDN purges. The OutputPage::output() method can easily take a few 100ms. * Removed some argument b/c code from doUpdates(). * Also moved DeferrableUpdate to a separate file. Change-Id: I9831fe890f9f68f9ad8c4f4bba6921a8f29ba666
* | Merge "Make HTMLCacheUpdate always use the job queue"jenkins-bot2015-12-041-18/+2
|\ \ | |/ |/|
| * Make HTMLCacheUpdate always use the job queueAaron Schulz2015-11-301-18/+2
| | | | | | | | | | | | | | | | | | * This puts these updates behind the JobRunner lag checks * Made HTMLCacheUpdateJob::newForBacklinks() method, which, along with lazyPush(), obsoletes this class. Bug: T95501 Change-Id: I934de63bb6fe9e9b7abae157f0b3b2dbfd3188e1
* | Merge "Move category membership RC updates to CategoryMembershipChangeJob"jenkins-bot2015-12-041-28/+0
|\ \
| * | Move category membership RC updates to CategoryMembershipChangeJobAaron Schulz2015-12-031-28/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Recursive link updates no longer mention an category changes. It's hard to avoid either duplicate mentioning of changes or confusing explicit and automatic category changes. * LinksUpdate no longer handles this logic, but rather WikiPage decides to spawn this update when needed in doEditUpdates(). * Fix race conditions with calculating category deltas. Do not rely on the link tables for the read used to determine these writes, as they may be out-of-date due to slave lag. Using the master would still not be good enough since that would assume FIFO and serialized job execution, which is not garaunteed. Use the parser output of the relevant revisions to determine the RC rows. If 3 users quickly edit a page's categories, the old way could misattribute who actually changed what. * Make sure RC rows are inserted in an order that matches that of the corresponding revisions. * Better avoid mentioning time-based (parser functions) category changes so they don't get attributed to the next editor. * Also wait for slaves between RC row insertions if there where many category changes (it theory it could well over 10K rows). * Using a separate job better separates concerns as LinksUpdate should not have to care about recent changes updates. * Added more docs to $wgRCWatchCategoryMembership. Bug: T95501 Change-Id: I5863e7d7483a4fd1fa633597af66a0088ace4c68
* | | Don't load WikiPage (w/ READ_LATEST) if search-update is not supportedaude2015-12-031-3/+21
| | | | | | | | | | | | | | | | | | instead lazy load WikiPage, when needed. Change-Id: If67057b0b76f0f889ed498d8bbedaaeae3b2785d
* | | Consolidate Title normalization code in SearchUpdateaude2015-12-021-5/+5
| | | | | | | | | | | | | | | | | | and rename the private method to be more clear Change-Id: Iec7b934babddd102402cfa7616accd91fd3422ff
* | | Do SearchUpdate::indexTitle after search-update is supported checkaude2015-12-021-1/+1
|/ / | | | | | | | | | | | | | | If the SearchEngine does not support search-update, then $indexTitle is not used and thus no need to create it in that case. Change-Id: I487d06274e921223a3bcb5af846b48b7c2b8065e
* / Make HTMLCacheUpdate callers more consistentAaron Schulz2015-12-011-2/+1
|/ | | | | | | A few random callers were calling doUpdate() themselves instead of using DeferredUpdates Change-Id: If121e6afab9899dae92f0bf831b0b0c9967deeb5
* SquidUpdate doc cleanupsAaron Schulz2015-11-181-5/+5
| | | | Change-Id: Ia5b8060e8a93f40a2e31272e043b225f59fb6d50
* Merge "Have SquidUpdate::newFromTitles use getSquidURLs"jenkins-bot2015-11-171-1/+1
|\
| * Have SquidUpdate::newFromTitles use getSquidURLsMatthew Flaschen2015-11-131-1/+1
| | | | | | | | | | | | | | This causes it to add history, and trigger the TitleSquidURLs hook. Bug: T116095 Change-Id: I41ebd2f34347a3f218f7d0bfc8962d286b943c16
* | Reduce updateLinksTimestamp() DB contentionAaron Schulz2015-11-171-1/+5
|/ | | | | | | | | | | Do the LinksUpdateComplete hook updates in a separate transaction as they may do slow SELECTs and updates. A large amount of DBPerformance warnings were triggered by such cases. Bug: T95501 Change-Id: Ie4e6b7f6aefc21bafba270282c55571ff5385fe0
* Merge "Add triggeringRevisionId to LinksUpdate JobSpec"Aaron Schulz2015-11-071-0/+8
|\
| * Add triggeringRevisionId to LinksUpdate JobSpecaddshore2015-11-051-0/+8
| | | | | | | | | | Bug: T117860 Change-Id: I8c730a434b8bdda7664fd1e3bb3fbc8840804950
* | Make DeferredUpdates exception handling more robustAaron Schulz2015-11-031-2/+4
|/ | | | Change-Id: Ica2b8dce0978818a2f51684b97c93a3ba845d81a
* Convert SiteStatsUpdate to using getMainStashInstance()Aaron Schulz2015-10-311-12/+8
| | | | | | Also fixed various $wgMemc related comments Change-Id: I20602b672f724c8df1e82bbe3c586cb899a54640
generated by cgit v1.2.3 (git 2.25.1) at 2025-04-24 20:28:18 +0000