aboutsummaryrefslogtreecommitdiffstats
path: root/maintenance/dumpTextPass.php
Commit message (Collapse)AuthorAgeFilesLines
...
* Remove wfDie() that Ariel keeps trying to resurrect :)Chad Horohoe2011-08-301-4/+4
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/95810
* check the checkpoint related options only if we specified checkpoints, duhAriel Glenn2011-08-291-6/+8
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/95720
* move some member vars to parent class since they are needed there now, set ↵Ariel Glenn2011-08-281-11/+0
| | | | | | | lastTime and other vars so checkpoints without prefetch work, update progress reporting in parent class to give rates during interval and from start of run Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/95634
* define and use closeAndRename() after last write of xml dump file; convert ↵Ariel Glenn2011-08-271-1/+1
| | | | | | | from popen (child inherits all open descriptors and there is no workaround) to proc_open (CLOEXEC set on all descriptors), needed so close and rename doesn't hang forever if a child (prefetcher) is forked Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/95604
* remove extraneous hyphen that crept in, grrAriel Glenn2011-08-241-1/+1
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/95443
* fix timestamp stuff, more fallout from bad merge attemptAriel Glenn2011-08-231-1/+6
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/95290
* fix a couple bad lines in previous commit from bad merge attemptAriel Glenn2011-08-231-3/+1
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/95288
* add support for writing out checkpoint files of xml dump at regular ↵Ariel Glenn2011-08-221-3/+140
| | | | | | | intervals (close and rename file based on filename pattern which includes first and last page id written) Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/95272
* Revert r85034, r81186, r77638: per CR on r77638: XMLReader and XMLWriter are ↵Chad Horohoe2011-07-201-70/+110
| | | | | | | | | memory-hungry beasts and this script OOMs constantly. This was already reverted in 1.17wmf1 (r82930) by Ariel. Doing the same in trunk now. I'm not opposed to using the new pretty XML* classes, but somebody needs to debug why they eat memory for breakfast, lunch and dinner. Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/92707
* Swap = to == in conditionalSam Reed2011-03-301-1/+1
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/85034
* eta shows revs/pages per sec in current interval as well as overall; useful ↵Ariel Glenn2011-03-271-12/+54
| | | | | | | for investigating problems, now that we have logging Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/84843
* * (bug 27016) Fix for r77638: dumpTextPass.php now consider the "output" ↵Alexandre Emsenhuber2011-01-291-2/+4
| | | | | | | | | parameter Also added "output" parameter to the doc since nothing was mentioning it Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/81186
* open a series of files for xml input, if supplied (used for multiple xml ↵Ariel Glenn2011-01-281-11/+21
| | | | | | | prefetch files) Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/81150
* When opening the subprocess fetchText.php, pass the complete wiki ID through ↵Alexandre Emsenhuber2010-12-061-2/+2
| | | | | | | the --wiki parameter so that it works for all setups and not only for wikimedia Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/77865
* Follow-up r67324: removed check for empty text since the length is checked ↵Alexandre Emsenhuber2010-12-041-9/+4
| | | | | | | explicitly Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/77737
* Modifier dumpTextPass.php to use XMLReader and XMLWriter rather than xml_* ↵Alexandre Emsenhuber2010-12-031-110/+68
| | | | | | | functions Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/77638
* More reversion of r77297, 2 of 2 commits to keep it readable in CR (hopefully)Sam Reed2010-11-251-1/+0
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/77305
* revert r76464Antoine Musso2010-11-251-0/+1
| | | | | | | | | | * mixed style changes and variable removing * logic changes * useful comments removed Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/77297
* Various unused variables, add some bracesSam Reed2010-11-101-1/+0
| | | | | | | Explicitally define some variables used in hook type calls Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/76464
* One more remplacement to __METHOD__Alexandre Emsenhuber2010-10-091-1/+1
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/74546
* * Standardised file description headersAlexandre Emsenhuber2010-10-031-0/+2
| | | | | | | | * added @file where needed * added file description headers where needed Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/74194
* And while I'm a it:Alexandre Emsenhuber2010-10-021-3/+4
| | | | | | | | * Fixed E_STRICT about different signature of TextPassDumper::dump() and BackupDumper::dump() * Add the possibility to show the help message... Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/74163
* Per Platonides; follow-up r74158: XMLReader is included in PHP since 5.1.0Alexandre Emsenhuber2010-10-021-1/+1
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/74160
* MediaWiki even require PHP 5.1.0+ ;)Alexandre Emsenhuber2010-10-021-1/+1
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/74158
* Refactor to avoid defining globals inside switches.Platonides2010-08-121-1/+1
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/70957
* clean up space/tab stuffAriel Glenn2010-07-191-34/+34
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/69558
* intval ( $id ) once in caller instead of in all the getTextXXX functionsAriel Glenn2010-07-151-1/+1
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/69408
* distinguish failed text retrieval from empty text, consolidate text ↵Ariel Glenn2010-06-161-33/+53
| | | | | | | retrieval retry code, die after maxConsecutiveFailedTextRetrievals (of separate revisions) Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/68132
* XML snapshots: check length of revision text from prefetched content against ↵Ariel Glenn2010-06-041-2/+9
| | | | | | | length in db before using, partial fix for bugs 23264, 18694 Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/67324
* XML snapshots: when retrieving revision text, send the text id back to ↵Ariel Glenn2010-06-041-1/+11
| | | | | | | requester for doublechecking (avoids revision text out of sync errors), partial fix for bugs 23264, 18694 Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/67322
* Stylize maintenance folder..Sam Reed2010-05-221-54/+54
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/66751
* Fix for bug 9413 and the related Malayalam issue reported on wikitech-l.Tim Starling2010-01-041-2/+5
| | | | | | | | | | | | * Added $wgFixArchaicUnicode, which, if enabled, converts some deprecated Unicode sequences in Arabic and Malayalam text to their Unicode 5.1 equivalents. * Added generateNormalizerData.php to generate the relevant data files. Added the generated data files also. * Made most things call the new wrapper method $wgContLang->normalize() instead of UtfNormal::cleanUp(), so that Unicode normalization can be customised on a per-language basis. * Added some generic support for conversion tables to Language so that subclasses can easily implement these kinds of transformations. Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/60599
* Follow-up to http://www.mediawiki.org/wiki/Special:Code/MediaWiki/54561: use ↵Benjamin Lees2009-08-191-1/+0
| | | | | | | the class autoloader. Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/55309
* (bug 19289) importDump.php can now handle bzip2 and 7zip.Benjamin Lees2009-08-071-69/+1
| | | | | | | I split out our 7zip stream wrapper into its own file, 7zip.inc. Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/54561
* Revert r54244 which was stupid and fix this properly. Require ↵Chad Horohoe2009-08-031-1/+1
| | | | | | | commandLine.inc/Maintenance.php using the full path every time. Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/54312
* Fix a silly bug that isn't the mystery dump bug we were looking for, but ↵Brion Vibber2009-05-061-1/+1
| | | | | | | could result in infinite loop during text pass if it fails just at the right time. Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/50291
* War on wfElement() and friends. Call the Xml members directly, rather than ↵Chad Horohoe2008-12-141-1/+1
| | | | | | | using old wrappers. Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/44588
* Don't break vim syntax highlightingTim Starling2008-06-041-2/+2
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/35841
* WARNING: HUGE COMMITAlexandre Emsenhuber2008-05-201-2/+7
| | | | | | | | | | | | | | | | | | Doxygen documentation update: * Changed alls @addtogroup to @ingroup. @addtogroup adds the comment to the group description, but doesn't add the file, class, function, ... to the group like @ingroup does. See for example http://svn.wikimedia.org/doc/group__SpecialPage.html where it's impossible to see related files, classes, ... that should belong to that group. * Added @file to file description, it seems that it should be explicitely decalred for file descriptions, otherwise doxygen will think that the comment document the first class, variabled, function, ... that is in that file. * Removed some empty comments * Removed some ?> Added following groups: * ExternalStorage * JobQueue * MaintenanceLanguage One more thing: there are still a lot of warnings when generating the doc. Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/35098
* tweak paths moreBrion Vibber2008-01-081-2/+2
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/29468
* fix include path regressions with text prefetchBrion Vibber2008-01-081-3/+4
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/29465
* * (bug 12184) Exceptions now sent to stderr instead of stdout for command-lineBrion Vibber2007-12-061-1/+2
| | | | | | | | | | scripts, making for cleaner reporting during batch jobs. PHP errors will also be redirected in most cases on PHP 5.2.4 and later, switching 'display_errors' to 'stderr' at runtime. Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/28222
* Do text normalization in dumpTextPass rather than fetchText, to ensure that ↵Brion Vibber2007-11-201-1/+10
| | | | | | | the force-loaded ICU plugin will be used in the parent process. Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/27685
* Initial implementation of restartable subprocess for text fetching in ↵Brion Vibber2007-11-201-2/+133
| | | | | | | dumpTextPass.php Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/27673
* Quick fix for dump problem:Brion Vibber2007-08-021-2/+11
| | | | | | | | | Errors are ignored on a connection once it's died, so additional exceptions weren't getting thrown. We weren't detecting this case and ended up spitting out the rest of the XML without any more text. Should now die correctly once the timeouts finish. Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/24535
* Remove ?>'s from files. They're pointless, and just asking for people to ↵Aryeh Gregor2007-06-291-1/+1
| | | | | | | mess with the files and add trailing whitespace. (Yes, I looked over every one and reverted those that were bogus. Slash-enter a million times in less worked well enough, although it was a bit mind-numbing.) Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/23531
* * Skip additional setting of include_path in commandLine.inc (for ↵Brion Vibber2007-06-061-2/+1
| | | | | | | | | | | non-Wikimedia mode) * Fix some scripts that assumed include_path was set with various additional directories Stuff now seems to mostly work when not overriding include_path. Taking that out of LocalSettings is the next step... whee! Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/22798
* prettify:Brion Vibber2007-03-091-1/+1
| | | | | | | | * set_timeout() -> setTimeout() * remove a couple obsolete references from dump code Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/20290
* Use Doxygen @addtogroup instead of phpdoc @package && @subpackageAntoine Musso2007-01-201-2/+1
| | | | Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/19502
* Abolished $wgDBname as a unique wiki identifier, it doesn't work with the ↵Tim Starling2006-10-041-2/+1
| | | | | | | | | new-fangled feature we call "table prefixes". Instead use wfWikiID() for an identifier containing the DB name and the prefix if there is one, and wfMemcKey() for cache key construction. Caches for wikis with table prefixes will be lost on upgrade, caches for wikis without table prefixes will be preserved. Custom cache keys in extensions can be migrated at leisure. Extensions which write to core cache keys should be migrated ASAP, as I have done with Special:Makesysop. Notes: http://mediawiki.org/wiki/Special:Code/MediaWiki/16791
generated by cgit v1.2.3 (git 2.25.1) at 2025-04-21 11:52:06 +0000