aboutsummaryrefslogtreecommitdiffstats
path: root/includes/filerepo/backend
Commit message (Collapse)AuthorAgeFilesLines
* [FileBackend] Moved filerepo/backend/ up to filebackendAaron Schulz2012-08-0818-9461/+0
| | | | Change-Id: I62ba23bd22e0f177fb48acaf6bcc38cbffacd3e7
* Merge "[LockManager] Cleaned up DBLockManager and reduced code duplication."Demon2012-08-081-219/+85
|\
| * [LockManager] Cleaned up DBLockManager and reduced code duplication.Aaron2012-06-211-219/+85
| | | | | | | | Change-Id: If2b56935b8e89c4a2f3b9d0c790bbd6d6d88c520
* | Remove unused variables/function values returnedReedy2012-08-081-1/+1
| | | | | | | | | | | | Fix trailing whitespace Change-Id: I53abf75e142f0166032b98e4adb3dabe06643017
* | [FileBackend] Fixed curl call broken by 10ec7a1.Aaron2012-08-061-1/+1
| | | | | | | | Change-Id: I661d2f586d3e3177c2f233153787597095872535
* | [FileBackend] Fixed bogus sync-check status errors.Aaron2012-08-061-1/+23
| | | | | | | | Change-Id: Iefb3a9575e241cfdc3220301a89667d6ad96a307
* | [FileBackend] Made swift handle unknown content types better.Aaron2012-07-311-0/+6
| | | | | | | | Change-Id: I50a5c17c40152a9e469a54bdd70a8408c57ebd50
* | [FileBackend] Bumped Swift listing page size.Aaron Schulz2012-07-231-2/+2
| | | | | | | | Change-Id: I44cab543246c0ff65b2bd64020d642a18c48cb67
* | Merge "[LockManager] Made LSLockManager session 32 chars (128 bits)."Aaron Schulz2012-07-211-9/+9
|\ \
| * | [LockManager] Made LSLockManager session 32 chars (128 bits).Aaron Schulz2012-07-181-9/+9
| | | | | | | | | | | | Change-Id: I1eba3eb44ebef02c771b518c2bcbdc0d41eb8086
* | | [FileBackend] Cleanups for doxygen.Aaron Schulz2012-07-201-7/+5
| | | | | | | | | | | | Change-Id: I82cd7e4ef01c6fa10fbdb6ccce5cc8e42e8aac67
* | | [FileBackend] Make sure multiwrite sub-backends use the proxy backend wiki ID.Aaron Schulz2012-07-181-0/+1
|/ / | | | | | | Change-Id: I886b0aeb891a108e3a61e9d98e70b5a0bdc2bdc5
* | Various doc cleanups for doxygen.Aaron Schulz2012-07-187-91/+92
| | | | | | | | Change-Id: I079f66997111d27d89910505dd5978aac613d383
* | [FileBackend] Removed @since formatting for options to fix doxygen.Aaron Schulz2012-07-171-10/+11
| | | | | | | | Change-Id: Ic1cb55dc9317de34fc50b7c590a2cd6e80c800ad
* | [FileBackend] Added "bypassReadOnly" flag.Aaron Schulz2012-07-171-19/+28
| | | | | | | | | | | | | | | | * Added flag to bypass read-only checks to the 6 write functions. * Made backend copy and sync scripts pass in this new flag. * Also made sync script use doQuickOperations() since its faster. Change-Id: Iee47f79ed7ab002cfc2d0adb5321c3a8520f971d
* | [FileBackend] MultiWrite code improvements and sanity checks.Aaron2012-07-183-66/+74
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Automatically override a few sub-backend settings in FileBackendMultiWrite. We should ignore locking, journaling, or read-only settings of sub-backends. Journaling is now done just for master sub-backend paths (under the proxy backend name). We don't need to log for each sub-backend, which is a waste of disk space. * Changed FileBackendMultiWrite::doOperationsInternal() to be similiar to the other write functions. It now uses doOperations() of the sub-backends rather than manual code. This makes settings like 'concurrency' easier to manage; we might want to have some sub-backends with varying setings for that. * Made FileBackendMultiWrite::doQuickOperationsInternal() compliant with docs. * Added CHECK_SHA1 option for consistency checking. * Fixed function visibility in two places. * Improved multiwrite backend tests by calling consistencyCheck(). Change-Id: Iac7bfe10c77ecd069fb9ef0ec26a01512f5f4eea
* | Merge "[LockManager] Memc lockmanager improvements."Aaron2012-07-171-1/+14
|\ \
| * | [LockManager] Memc lockmanager improvements.Aaron2012-07-171-1/+14
| | | | | | | | | | | | | | | | | | | | | | | | * Throttled key lock polling and changed the key locking to happen in sorted key order. This should reduce deadlocks and wasted RTTs for frequently used items. * Also tweaked the wfRandomString() argument to be 32 (128 bit). Change-Id: I12bbc988251ad3c895aa40a08b0215b2bcdb5e4f
* | | [FileBackend] Doc formatting tweaks for doxygen.Aaron Schulz2012-07-161-71/+71
| | | | | | | | | | | | Change-Id: I2741cb90d0afae4c38515d0c295b5f0085b54d56
* | | [FileBackend] Factored out code into ProcessCacheLRU class.Aaron Schulz2012-07-121-92/+34
| | | | | | | | | | | | | | | | | | | | | | | | Factor out duplicated code into the new ProcessCacheLRU. It is a fixed size an per process cache which invalidate the least recently used cache key. Change-Id: Ib4475f21879ef6286ce2a28f248acd296fdbd45d
* | | [FileBackend] More Swift ACL documentation.Aaron2012-07-111-1/+2
| | | | | | | | | | | | Change-Id: If6a3f70824b05545e5ee5b406cd66fa2b046c981
* | | [FileBackend] More documentation fixes.Aaron Schulz2012-07-101-4/+3
| | | | | | | | | | | | Change-Id: I0841e66018522df18ad06a0ac075eb0fbab16e40
* | | [FileBackend] Documentation fixes.Aaron Schulz2012-07-101-2/+5
| | | | | | | | | | | | Change-Id: Id98c2001c01ab03f63e85f4e08ea14f1750dd9ed
* | | [FileBackend] Refactored backend access control functions.Aaron2012-07-105-37/+226
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Made secure() no longer create the container/directories. * Added a new publish() function, which is the reverse of secure(). It's seems reasonable to be able to reverse secure() if needed. * Added the ability to call prepare() with the secure() parameters. The "securing" will only be done if the container had to be created. This kills a bunch of slow RTTs with setContainerAccess() in Swift. * Also made the Swift doSecureInternal() function respect the arguments and set 'r:*' to properly make containers public. * Consolidated FileRepo directory creation into an initDirectory() function. This uses the new prepare() arguments. Change-Id: Ie16331ebf26c99295f60b266e07a4727228f53f2
* | | prettify filerepo documentationAntoine Musso2012-07-101-7/+52
| | | | | | | | | | | | Change-Id: Ia84494c8c0c09a3d509975d63ab698e0a35c4631
* | | move parameter doc under @paramAntoine Musso2012-07-101-43/+25
| | | | | | | | | | | | | | | | | | | | | The description of an array of parameter really belong under @param, makes doxygen HTML documentation nicer. Change-Id: If2c01a11b8dbf02b272b7ccce591a92293346731
* | | escape tags and entity in doxygen commentsAntoine Musso2012-07-102-6/+7
|/ / | | | | | | | | | | | | | | | | | | | | When inserting XML elements inline <such as this one>, doxygen chokes about it not being known. Simply enclosing the tag in double quotes prevents doxygen from emitting a warning. Also enclosed a few invalid functions calls such as \. and double quoted the HTML entities such as &foobar; Change-Id: I4019637145e683c2bec3d17b2fd98b0c50a932f1
* | Merge "[FileBackend] Rewrote FileBackendStoreShardListIterator to actually ↵Tim Starling2012-06-291-58/+58
|\ \ | | | | | | | | | work."
| * | [FileBackend] Rewrote FileBackendStoreShardListIterator to actually work.Aaron2012-06-131-58/+58
| | | | | | | | | | | | | | | | | | * Beefed up the relevant file backend unit tests. Change-Id: I62e741fada1197a7fa253a418829dd8f4728a9cd
* | | [LockManager] Added support for a default lock manager.Aaron Schulz2012-06-231-3/+28
| |/ |/| | | | | Change-Id: I730c8b078b9f3a0ad73b1b0887a8c991c9d81bde
* | [LockManager] Added a memcached lock manager class.Aaron2012-06-212-5/+314
| | | | | | | | Change-Id: Ie99a7f1335bb5cceb0cb1c33a40094b3a22101ea
* | [LockManager] Factored QuorumLockManager class out of LSLockManager.Aaron2012-06-192-162/+257
| | | | | | | | Change-Id: I4031085faef4a1a7ce49dbeeb0b3ddf94d41132c
* | Merge "[FileBackend] Process cache fixes and cleanups."Hashar2012-06-152-19/+45
|\ \
| * | [FileBackend] Process cache fixes and cleanups.Aaron Schulz2012-05-262-19/+45
| | | | | | | | | | | | | | | | | | | | | | | | * Made getLocalReference() and getFileSha1Base36() respect latest wrt to cache. * Made Made getLocalReference() and getFileSha1Base36() normalize the paths for cache. * Avoid misleading (suggesting cache misses) getFileSha1Base36() profile calls for Swift. Change-Id: I192a4f00c123029cfa338ec74cd08a355e29896b
* | | Bug 24985 use $wgTmpDirectory when availableMark A. Hershberger2012-06-131-1/+1
| |/ |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | We had two way to get a temporary directory: - $wgTempDirectory: more or less stable accross sessions - wfTempDir(): set through environnement variable and could potentially vary from a session to another one thanks to tempnam() This patch makes wfTempDir() to always use the global $wgTempDirectory first when it is available. Thus explicitly overriding tempnam() or any environnement variable such as TMP or TEMP. Hence, people who don't have access to a system wide directory specificed by their environnement (such as /tmp) can specify an alternative straight from the MediaWiki configuration. The patch remove references to $wgTmpDirectory and replace them with calls to wfTempDir(). Make wfTempDir() use $wgTmpDirectory first. The default setting of $wgTmpDirectory was removed in favor of having it initialized through Setup.php by calling wfTempDir. Note: this may also address Bug 36475 - Generating thumbnails does not work when there is no access to /tmp Change-Id: Ifdc79e9c5d95f978025b237a5eeb95fd75092f46
* | [FileBackend] Fixed writer-populater cache race condition.Aaron2012-06-071-6/+8
| | | | | | | | | | | | | | | | | | * Set the keys to PURGED on purge. We already only treat array values in cache is valid. This means that if a process reads the file, it caches in the meantime, and then the process tries to cache the file, the stale version will not be cached. Change-Id: I7eb7b4529f8cea44b0d68c9149db4bcf100ac9d2
* | Fixed infinite loop in tests with FSLockManager.Aaron Schulz2012-06-051-2/+4
| | | | | | | | | | | | | | | | * If PHPUnit converts warnings to exceptions, any I/O warnings can throw exceptions which leave locksHeld in an inconsistent state, breaking the __destruct() function. This commits reorders the variable update slightly. Change-Id: I5deac811e7b4d0bc71f3d4096b8d72711904a444
* | Big oops - merged to wrong branch.awjrichards2012-06-054-12/+115
| | | | | | | | | | Revert "Revert to arbitrarily old point before initial remote branch creation to help clean up" This reverts commit ee0d3d330f76b97c451c168dc9b052ee84609b5b
* | Revert to arbitrarily old point before initial remote branch creation to ↵awjrichards2012-06-024-115/+12
| | | | | | | | | | | | help clean up Change-Id: I41a3d1e55d3ea9dffa42451237fe065f9334361d
* | Merge "[FileBackend] Gave doQuickOperations() some wrapper methods just like ↵Demon2012-06-042-2/+86
|\ \ | | | | | | | | | doOperations()."
| * | [FileBackend] Gave doQuickOperations() some wrapper methods just like ↵Aaron Schulz2012-05-242-2/+86
| | | | | | | | | | | | | | | | | | doOperations(). Change-Id: I0186a60bddcb26f008f6a6512eb5190a08142802
* | | Merge "[FileBackend] Purge Swift process cache before container delete for ↵Demon2012-06-041-3/+3
|\ \ \ | | | | | | | | | | | | sanity."
| * | | [FileBackend] Purge Swift process cache before container delete for sanity.Aaron Schulz2012-05-251-3/+3
| |/ / | | | | | | | | | | | | | | | * Also tweaked some documentation. Change-Id: I89369d6211de216193ae1d895356137cacded5d7
* | | Merge "[FileBackend] Worked around Akamai CDN purge limits."Demon2012-06-041-3/+18
|\ \ \
| * | | [FileBackend] Worked around Akamai CDN purge limits.Aaron Schulz2012-05-231-3/+18
| |/ / | | | | | | | | | | | | | | | | | | * Added swiftCDNTTL to let the cache TTL be configurable * Also added swiftCDNPurgable option to disable purges Change-Id: Ic8e779c20f7501a5a55f4a49fc612923d0dc268c
* | / Fixed destructor in FSLockManager to clear all the locks.Aaron Schulz2012-06-021-4/+8
| |/ |/| | | | | Change-Id: I019d24c19f317eb649b5a0415618b453e1ea171b
* | Merge "[FileBackend] Added getScopedLocksForOps() function."Brion VIBBER2012-05-243-0/+46
|\ \ | |/ |/|
| * [FileBackend] Added getScopedLocksForOps() function.Aaron Schulz2012-05-143-0/+46
| | | | | | | | | | | | This lets callers safely change files *and* update DB data. Change-Id: I6ec70e98b1535528b756e109b8b28e4a3e839552
* | [FileBackend] Avoid an extra RTT on Swift listing operations.Aaron Schulz2012-05-221-7/+20
| | | | | | | | | | | | | | * Also tweaked timestamp tolerance in tests, intended for Swift * Also made a few tweaks to speed up tests a bit Change-Id: Ibdee36d3bf86089b027dc74bb2582acc1ab4b96b
* | Merge "Improved/added parameter documentation"Siebrand2012-05-2114-16/+181
|\ \