aboutsummaryrefslogtreecommitdiffstats
path: root/maintenance/benchmarks/README.md
blob: 6838a884a1283390268364ccae2df7b2e187fc1b (plain) (blame)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
This directory hold several benchmarking scripts used track performances of
MediaWiki and/or PHP.

## Consistency

To gain greater precision than the time elapsed as reported by the benchmark
itself, one can use the `perf_events` tool on Linux to count the number of
CPU instructions, in addition to measuring how long it took to execute them.

This should accurately tell you how much machine code is executed. Note that
this does not correctly model the cost of each instruction (especially
memory access).

For example:

```
$ perf stat -e instructions php -d opcache.enable_cli=1 \
  maintenance/benchmarks/benchmarkEval.php --code="Html::openElement( 'a', [ 'class' => 'foo' ] )" \
  --inner=1000 --count=10000

eval:
   count: 10000
    rate:    590.1/s
   total: 16946.61ms
    mean:     1.69ms
      ...

Performance counter stats for 'php maintenance/benchmarks/..':
    83651088078  instructions
   17.225255198  seconds time elapsed
            ...
```

## Fixtures

* data/tidy/australia-untidy.html.gz: Representative input text for benchmarkTidy.php.
  It needs to be decompressed before use.
* data/CommentFormatter/rc100-2021-07-29.json: Input for Linker::formatComment() from
https://en.wikipedia.org/w/api.php?action=query&format=json&list=recentchanges&rcprop=title%7Ccomment&rclimit=100