aboutsummaryrefslogtreecommitdiffstats
path: root/etc/taskcluster/decision_task.py
Commit message (Collapse)AuthorAgeFilesLines
* Auto merge of #24811 - servo:fail-fast, r=jdmhomu-tmpbors-servo2019-11-221-18/+33
|\ | | | | | | | | | | | | | | Fix updating the GitHub Status as soon as any TC task fails … rather than only when the entire task group is resolved. This allows Homu to more quickly be notified of a failure, and move on to the next PR in the queue sooner. (Plus drive-by Brewfile fix.)
| * Fix updating the GitHub Status as soon as any TC task failsSimon Sapin2019-11-221-0/+6
| | | | | | | | | | | | … rather than only when the entire task group is resolved. This allows Homu to more quickly be notified of a failure, and move on to the next PR in the queue sooner.
| * Remove support for shallow clones. The bundle is already shallow.Simon Sapin2019-11-221-1/+1
| |
| * Fetch repository from artifacts rather than GitHubSimon Sapin2019-11-221-12/+11
| |
| * Decision taks: add artifacts of the repository’s contentsSimon Sapin2019-11-221-0/+5
| |
| * Move `mkdir` call out of `with_curl_script`Simon Sapin2019-11-221-2/+7
| |
| * Fix Brewfile’s for running Servo without bulding itSimon Sapin2019-11-221-4/+4
| |
* | Auto merge of #24692 - paulrouget:checkcpp-tc, r=jdmbors-servo2019-11-211-0/+1
|\ \ | |/ |/| | | Run test-tidy with CPP files check on Windows
| * Run test-tidy on WindowsPaul Rouget2019-11-211-0/+1
| |
* | Move WPT Linux from Buildbot to TaskclusterSimon Sapin2019-11-191-4/+0
| | | | | | | | | | | | | | Update expectations as differences don’t look intermittent: https://github.com/servo/servo/pull/24785#issuecomment-555602259 Fixes https://github.com/servo/servo/issues/23569
* | Tweak WPT task names and configSimon Sapin2019-11-191-4/+4
|/
* Zero-pad the chunk number in WPT task namesSimon Sapin2019-11-181-1/+3
|
* Only use high prority for macOS when testing a PR for merging.Simon Sapin2019-11-181-1/+2
|
* Don’t pretend that `update_wpt()` doesn’t use debug assertionsSimon Sapin2019-11-181-5/+5
| | | | | It already was, since the key given to `find_or_create()` did not include `args`.
* Raise the priority of the release build task for WPT on macOSSimon Sapin2019-11-181-2/+3
| | | | | | | | | | … since other time-sensitive tasks depend on them. Note: we need to be careful with task priorities, especially in worker pools with limited capacity, since they are absolute and can cause starvation: https://docs.taskcluster.net/docs/manual/tasks/priority
* Split WPT macOS testing into many more chunksSimon Sapin2019-11-181-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ## Before this Before this PR, we had roughly as many chunks as available workers. Because the the number of test files is a poor estimate for the time needed to run them, we have significant variation in the completion time between chunks when testing one given PR. https://github.com/servo/taskcluster-config/pull/9 adds a tool to collect this data. Here are two full runs of `test_wpt` before this PR: https://community-tc.services.mozilla.com/tasks/groups/DBt9ki9gTdWmwAk-VDorzw ``` count 1, total 0:00:32, max: 0:00:32 docker 0:00:32 count 1, total 0:59:14, max: 0:59:14 macos-disabled-mac1 0:59:14 count 6, total 4:12:16, max: 1:01:14 macos-disabled-mac1 WPT 0:40:29 0:18:55 0:46:50 0:44:38 1:01:14 0:40:10 count 1, total 0:55:19, max: 0:55:19 macos-disabled-mac9 0:55:19 count 6, total 4:25:09, max: 1:01:40 macos-disabled-mac9 WPT 0:37:58 0:37:24 0:27:18 1:01:40 0:46:17 0:54:31 ``` Times for a given chunk vary between 19 minutes and 61 minutes. Assuming no `try` testing, with Homu’s serial scheduling of `r+` testing this means that that worker sits idle for 42 minutes and our limited CPU resources are under-utilized. When there *are* `try` PRs being tested however, they compete with each other and any `r+` PR for the same workers. If we get unlucky, a 61 minute task could only *start* after some other tasks have finished, Increasing the overall time-to-merge a lot. ## This This PR changes the number of chunks to be significantly more than the number of available workers. When one of them finishes, that worker can pick up another one instead of sitting idle. Now the ratio of number of tasks to number of workers doesn’t matter: the differences in run time between tasks becomes somewhat of an advantage and the distribution to workers evens out on average. The number 30 is a bit arbitrary. A higher number reduces resource under-utilization, but increases the effect of per-task overhead. The git cache added in https://github.com/servo/servo/pull/24753 reduced that overhead, though. Another worry I had was whether this would make worse the similar problem of unequal scheduling between processes within a task, where some CPU cores sit idle while the rest processes finish their assigned work. This turned out not to be enough of a problem to negatively affect the total machine time: https://community-tc.services.mozilla.com/tasks/groups/VnDac92HQU6QmrpzWPCR2w ``` count 1, total 0:00:48, max: 0:00:48 docker 0:00:48 count 1, total 0:39:04, max: 0:39:04 macos-disabled-mac9 0:39:04 count 31, total 4:03:29, max: 0:15:29 macos-disabled-mac9 WPT 0:07:26 0:08:39 0:04:21 0:07:13 0:12:47 0:10:11 0:04:01 0:03:36 0:10:43 0:12:57 0:04:47 0:04:06 0:10:09 0:12:00 0:12:42 0:04:40 0:04:24 0:12:20 0:12:15 0:03:03 0:07:35 0:11:35 0:07:01 0:04:16 0:09:40 0:05:08 0:05:01 0:06:29 0:15:29 0:02:28 0:06:27 ``` (4h03min is even lower than above, but seems within variation.) ## After this https://github.com/servo/servo/issues/23655 proposes automatically restarting failed WPT tasks, in case the failure is intermittent. With the test suite split into more chunks we have fewer tests per chunk, and therefore lower probability that a given one fails. Restarting one of them also causes less repeated work.
* Move "extra" WPT testing to its own task (chunk "zero")Simon Sapin2019-11-181-24/+23
|
* macOS CI: use a cache of github.com/servo/servoSimon Sapin2019-11-171-6/+13
| | | | Relies on https://github.com/servo/taskcluster-config/pull/6
* Reduce macOS build task timeoutSimon Sapin2019-11-161-2/+3
|
* Verbose HomebrewSimon Sapin2019-11-161-1/+1
|
* Make the macOS worker type configurableSimon Sapin2019-11-151-10/+11
|
* Install zlib on macOSSimon Sapin2019-11-151-0/+1
| | | | | | https://community-tc.services.mozilla.com/tasks/fcbLrz33RHeshgRZGvSAjg/runs/0/logs/https%3A%2F%2Fcommunity-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FfcbLrz33RHeshgRZGvSAjg%2Fruns%2F0%2Fartifacts%2Fpublic%2Flogs%2Flive.log#L1359 Note that the above is on macOS 10.15. Maybe previous versions provided zlib system-wide?
* Expect Homebrew to already be installed and in `$PATH`Simon Sapin2019-11-151-11/+3
|
* Fix sccache failure when rustc generates hundreds of thousands of warningsSimon Sapin2019-11-121-1/+3
| | | | Fixes https://github.com/servo/servo/issues/24714
* Remove support for taskcluster.net in the decision taskSimon Sapin2019-11-081-15/+6
|
* Auto merge of #24689 - servo:FLIP-THE-SWITCH, r=jdmbors-servo2019-11-081-23/+6
|\ | | | | | | Move all tasks to Community-TC
| * Move all tasks to Community-TCSimon Sapin2019-11-081-23/+6
| |
* | Add missing import to docs upload script.Josh Matthews2019-11-071-1/+1
|/
* Split doc generation into its own taskSimon Sapin2019-11-071-7/+18
| | | | | This task reached its 60 minutes timeout in https://community-tc.services.mozilla.com/tasks/YByC2V7uQq2lQv40TVi5KQ/runs/1/logs/live/https%3A%2F%2Fcommunity-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FYByC2V7uQq2lQv40TVi5KQ%2Fruns%2F1%2Fartifacts%2Fpublic%2Flogs%2Flive.log#L6276
* Run non-macOS tasks on Community-TC for push eventsSimon Sapin2019-11-071-5/+20
|
* Add a decision task for `try-windows-ami`Simon Sapin2019-11-071-8/+17
|
* Run a decision task on both deployments for push eventsSimon Sapin2019-11-061-0/+4
|
* Always construct TC API URLs from $TASKCLUSTER_PROXY_URL or ↵Simon Sapin2019-11-051-1/+2
| | | | $TASKCLUSTER_ROOT_URL
* Auto merge of #24652 - servo:nitouryuu, r=noxbors-servo2019-11-051-5/+12
|\ | | | | | | Don’t run tasks on new TC for GitHub push events (for now)
| * Support both Taskcluster deploymentsSimon Sapin2019-11-041-5/+12
| | | | | | | | Part of https://bugzilla.mozilla.org/show_bug.cgi?id=1574648
* | Auto merge of #24603 - servo:jdm-patch-36, r=SimonSapinbors-servo2019-11-031-5/+8
|\ \ | |/ |/| | | | | | | Install rustc-dev for nightly rust toolchain Fixes #24579.
| * Avoid instaling rustc-dev twice.Josh Matthews2019-10-311-5/+7
| |
| * Install rustc-dev for nightly rust toolchain.Josh Matthews2019-10-311-0/+1
| |
* | Use surfman for managing GL surfacesPatrick Walton2019-11-011-14/+20
|/ | | | | | Co-authored-by: Alan Jeffrey <ajeffrey@mozilla.com> Co-authored-by: Zakor Gyula <gyula.zakor@h-lab.eu> Co-authored-by: Josh Matthews <josh@joshmatthews.net>
* Taskcluster: install the `rustc-dev` rustup component, required for compiler ↵Simon Sapin2019-10-271-0/+14
| | | | plugins
* Don’t install rust-docs, rust-src, or clippy on CISimon Sapin2019-10-211-1/+1
| | | | See https://blog.rust-lang.org/2019/10/15/Rustup-1.20.0.html#profiles
* Support building UWP with native UWP rustc target.Josh Matthews2019-10-121-7/+7
|
* Create a zip of all UWP packaging artifacts.Josh Matthews2019-10-101-8/+5
|
* Auto merge of #24268 - servo:jdm-patch-57, r=SimonSapinbors-servo2019-09-251-1/+1
|\ | | | | | | | | | | | | | | | | | | | | Extend nightly WPT update timeout by an hour. Jobs have been timing out more than usual recently, and on machines that don't have any clear resource hogging going on. <!-- Reviewable:start --> --- This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/24268) <!-- Reviewable:end -->
| * Extend nightly WPT update timeout by an hour.Josh Matthews2019-09-231-1/+1
| |
* | Don't set PKG_CONFIG_PATH anymoreAnthony Ramine2019-09-241-6/+1
|/ | | | glib will find libffi on its own in its opt path now.
* Fix python precedence issue.Josh Matthews2019-09-171-1/+1
|
* Make APPX build part of package command. Add nightly build for UWP.Josh Matthews2019-09-121-2/+43
|
* Updated magicleap signing certAlan Jeffrey2019-08-261-3/+3
|
* Remove explicit nuget setup in CI.Josh Matthews2019-08-211-16/+0
|
generated by cgit v1.2.3 (git 2.25.1) at 2025-04-22 17:30:07 +0000