aboutsummaryrefslogtreecommitdiffstats
path: root/etc/ci
Commit message (Collapse)AuthorAgeFilesLines
* feat: Track the binary size for all the different platforms (#34744)DK Liao2025-01-201-1/+2
| | | | | | | | | | | | | | | | | | | * feat: Track the binary size for all the different platforms Signed-off-by: DK Liao <dklassic@gmail.com> * Add target to bencher job name Signed-off-by: DK Liao <dklassic@gmail.com> * Update .github/workflows/bencher.yml Co-authored-by: Martin Robinson <mrobinson@igalia.com> Signed-off-by: DK Liao <dklassic@gmail.com> --------- Signed-off-by: DK Liao <dklassic@gmail.com> Co-authored-by: Martin Robinson <mrobinson@igalia.com>
* Add linux-pref job (#33261)Samson2024-12-061-0/+58
| | | | | | Job will do some performance benchmarks (Dromeo, Speedometer) and mesure binary size and will report results to bencher.dev Signed-off-by: sagudev <16504129+sagudev@users.noreply.github.com> Co-authored-by: DK Liao <dklassic@gmail.com>
* do WPT reports as GitHub job summery (#33587)Samson2024-10-021-4/+13
| | | | | | this is less user friendly as GitHub checks but has bigger content limits Signed-off-by: sagudev <16504129+sagudev@users.noreply.github.com> Co-authored-by: Martin Robinson <mrobinson@igalia.com>
* Move android port code to servoshell (#32533)Jonathan Schwender2024-06-191-1/+1
| | | | Signed-off-by: Jonathan Schwender <jonathan.schwender@huawei.com> Signed-off-by: Jonathan Schwender <schwenderjonathan@gmail.com>
* Use --locked when building in CI (#31720)Oriol Brufau2024-03-211-13/+0
| | | | | | | Thus the build will immediately fail if a PR modifies Cargo.toml but forgets to include the changes in Cargo.lock This was previously checked by lockfile_changed.sh after building normally, wasting resources.
* Escaped reporting (#31691)Samson2024-03-151-3/+6
|
* Move Stylo to its own repo (#31350)Delan Azabani2024-02-271-58/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | * Remove packages that were moved to external repo * Add workspace dependencies pointing to 2023-06-14 branch * Fix servo-tidy.toml errors * Update commit to include #31346 * Update commit to include servo/stylo#2 * Move css-properties.json lookup to target/doc/stylo * Remove dependency on vendored mako in favour of pypi dependency This also removes etc/ci/generate_workflow.py, which has been unused since at least 9e71bd6a7010d6e5723831696ae0ebe26b47682f. * Add temporary code to debug Windows test failures * Fix failures on Windows due to custom target dir * Update commit to include servo/stylo#3 * Fix license in tests/unit/style/build.rs * Document how to build with local Stylo in Cargo.toml
* Fail gracefully when DMG smoketest fails (#30975)Martin Robinson2024-01-021-1/+4
| | | | | | | | | It seems that timing issues (related to MacOS or the GitHub MacOS) runners can sometimes cause `hdiutil detach` to fail. Instead of having this cause the entire build to fail, fail gracefully. This is essentially a non-issue as the CI environment is always cleaned up when using GitHub Actions. Fixes #30757.
* Improve formatting of Python files (#30919)Taym Haddadi2023-12-243-27/+27
| | | Signed-off-by: Bentaimia Haddadi <haddadi.taym@gmail.com>
* Replace virtualenv with Python's built-in venv (#30377)Corey Farwell2023-12-071-10/+0
| | | | | | | | | | | | | | | | | | * Replace virtualenv with Python's built-in venv. * Apply Delan's suggestions and make a couple small fixes - Fix a tidy warning about directories that don't exist - Use shutil instead of the redundant get_exec_path - Miscellaneous cleanups * Fix typo in environment variable * fix bug where pip still tries to the wrong site-packages --------- Co-authored-by: Martin Robinson <mrobinson@igalia.com> Co-authored-by: Delan Azabani <dazabani@igalia.com>
* Remove `__future__` imports that are no longer necessary (#30661)Martin Robinson2023-11-022-4/+0
| | | These are no longer necessary as we always use Python 3.
* Allow trigger try workfows using labels (#30383)Martin Robinson2023-10-231-0/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | This change adds and alternate method for triggering try changes. Instead of comments, changes are triggered via applying labels to pull requests. The action will remove the label from the request and start the requested jobs. This will require creating at least a few labels: - T-full - T-linux-wpt-2013 - T-linux-wpt-2020 - T-macos - T-windows More labels can be added as we support more configurations. The good thing about this change is that try jobs against the actual branch in the pull request instead of the master branch. This means that changes to CI can be tested (unlike for comment processing). One bit caveat with this change is that when adding multiple labels, a CI job is triggered for each. Only one real build will run for each label, but whether or more try jobs is triggered is a race condition. The first CI job to successfully remove the label will actually trigger the job. If the same job removes two compatible labels, then they can share a build (for instance two types of WPT linux jobs). If not there will be two. Note that this is at least as efficient as the current behavior.
* Remove some unused buildbot files (#30476)Martin Robinson2023-10-032-57/+0
|
* Revert "Combine all try workflows (#30096)" (#30149)Martin Robinson2023-08-211-29/+16
| | | This reverts commit fed3491f23f8b7f3064ce297776deda76e485289.
* Combine all try workflows (#30096)Martin Robinson2023-08-201-16/+29
| | | | | | | | There are currently two ways to run try. One is to push to the `try` or `try-*` branches and the other is to trigger a workflow via GitHub comment. This change combines these methods into one workflow. In addition, WPT results are reported together rather than separately and filtered results for all WPT tests are bundled together in the same artifact.
* Support mac wpt builds (#29867)Samson2023-08-111-1/+1
| | | | | | | * Add wpt-mac builds * Fix wpt reporting check run tag * There can only be five concurrent mac runners
* Make "@bors-servo try" a GitHub Action (#30014)Martin Robinson2023-07-241-17/+13
| | | | | | | | | | | | | | This is the last piece of the puzzle to turning off bors. This makes functionality provided by bors to understand "@bors-servo try" a GitHub Action. For now the syntax is more or less the same, but we can modify it in the future and even add support for custom configuration options (more specific build combinations or even passing compiler flags). The big difference between this and what bors does is that there is no merge commit. GitHub simply runs tests on the version of the branch that is on a pull request. There is always the risk that tests might start failing when a branch is rebased, but this offers a bit more control because you can easily rebase from the PR and the merge queue will check this as well.
* Fix WPT sync and simplify the update scripts (#29999)Martin Robinson2023-07-172-205/+0
| | | | | | | | | Much of the code used to import WPT tests from upstream has been moved to the WPT repository itself, so this can be reused. In addition, simplify the workflows by merging the entire process into mach and also directly into the GitHub workflow. This should fix WPT imports after combining compilation of layout and legacy layout. Signed-off-by: Martin Robinson <mrobinson@igalia.com>
* Fix the WPT update (#29996)Martin Robinson2023-07-132-60/+1
| | | | | - No longer issue the bors-servo r+ comment as we use the merge queue now. - Explicitly trigger all layout tests so that results are generated.
* Rename metadata directoriesMartin Robinson2023-06-222-4/+5
| | | | | | | | This renames: - `tests/wpt/metadata` → `tests/wpt/meta-legacy-layout` - `tests/wpt/metadata-layout-2020` → `tests/wpt/meta` - `tests/wpt/mozilla/meta` → `tests/wpt/mozilla/meta-legacy-layout` - `tests/wpt/mozilla/meta-layout-2020` → `tests/wpt/mozilla/meta`
* Remove magicleap related references from config filesmichaelgrigoryan252023-05-221-2/+0
|
* Run the Layout 2020 tests in main workflowMartin Robinson2023-05-171-2/+5
| | | | | | | Also fix report_aggregated_expected_results.py which was reporting an error when there were no failing tests. This is more commonly an issue with Layout 2020 because if runs fewer tests and was causing builds to show up as failing even when they were not.
* Don't report test results for closed PRsMartin Robinson2023-05-051-10/+22
| | | | | | | | | | | | | When doing a try run, bors will often push the last closed merge onto the branch before pushing the change to try. This means that test results get reported on closed PRs. There are two issues with this: 1. Doing too much work on the bots. 2. Extra results on closed PRs. This changes fixes the second issue. Fixes #29583.
* Auto merge of #29670 - mrobinson:improve-wpt-output, r=delanbors-servo2023-04-271-8/+11
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Make WPT results output more useful Before when a subtest failed, the text of the failed assertion was not printed. This changes makes sure that it is printed in both the console and the aggregated test output. Also fix a couple typing errors. <!-- Please describe your changes on the following line: --> --- <!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `___` with appropriate data: --> - [x] `./mach build -d` does not report any errors - [x] `./mach test-tidy` does not report any errors - [x] These changes do not require tests because these are improvements to build tools. <!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.--> <!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->
| * Make WPT results output more usefulMartin Robinson2023-04-261-8/+11
| | | | | | | | | | | | | | | | Before when a subtest failed, the text of the failed assertion was not printed. This changes makes sure that it is printed in both the console and the aggregated test output. Also fix a couple typing errors.
* | WPT results aggregating based on layoutsagudev2023-04-271-11/+18
|/
* Reorganize Servo's WPT Python scriptsMartin Robinson2023-04-2034-5046/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | This change moves all of Servo's WPT Python support scripts into one directory as they were previously scattered throughout the directory structure. This should allow more code reuse and make it easier to understand how everything fits together. The changes: - `tests/wpt/update` → `python/wpt/importer` - `etc/ci/upstream-wpt-changes/wptupstreamer` → `python/wpt/exporter` - `etc/ci/upstream-wpt-changes/test.py` → `python/wpt/test.py` - `etc/ci/upstream-wpt-changes/tests` → `python/wpt/tests` - `tests/wpt/servowpt.py` → - `python/wpt/update.py` - `python/wpt/run.py` - `tests/wpt/manifestupdate.py` → `python/wpt/manifestupdate.py` This change also removes - The ability to run the `update-wpt` and `test-wpt` commands without using `mach`. These didn't work very well, because it was difficult to get all of the wptrunner and mach dependencies installed outside of the Python virtualenv. It's simpler if they are always run through `mach`. - The old WPT change upstreaming script that was no longer used.
* Auto merge of #29623 - mrobinson:wpt-import-one-week, r=mukilanbors-servo2023-04-131-0/+0
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Import WPT tests every week instead of every day We often have multiple imports stacked up which makes it more confusing to land each one. In addition, giving a week to do the import will give us more margin to triage failing tests and hopefully to be able to use intermittent expectations for flaky tests. <!-- Please describe your changes on the following line: --> --- <!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `___` with appropriate data: --> - [x] `./mach build -d` does not report any errors - [x] `./mach test-tidy` does not report any errors - [x] These changes do not require tests because this just change the frequency of a scheduled action. <!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.--> <!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->
| * Import WPT tests every week instead of every dayMartin Robinson2023-04-121-0/+0
| | | | | | | | | | | | | | We often have multiple imports stacked up which makes it more confusing to land each one. In addition, giving a week to do the import will give us more margin to triage failing tests and hopefully to be able to use intermittent expectations for flaky tests.
* | Handle non-UTF8 diffs in the WPT upstream scriptMartin Robinson2023-04-124-6/+42
|/ | | | | | | The output of `git diff` and `git show` can include non-UTF8 text or binary data, so the WPT upstream script should handle this properly. Fixes #29620.
* Fix the WPT export scriptMartin Robinson2023-04-113-13/+52
| | | | | | | | | | | - Have the WPT exporter script use the WPT_SYNC_TOKEN for checking out wpt. - Make sure the local WPT repository is unshallow when pushing. - When searching for existing PRs use the main GitHub search API, as the pull request search does not seem to properly process the "head" parameter. - When deleting branches in the downstream WPT repository, use the full URL to avoid trying to modify the upstream repository.
* Remove more Taskcluster and Treeherder integrationMartin Robinson2023-04-101-5/+0
| | | | | Servo no longer uses Taskcluster and Treeherder, so this change removes script references to those services and support files.
* WPT agregated results also as github checksagudev2023-04-031-5/+60
|
* Update wpt-nightly-update.sh with right paths from workflowsSamson2023-04-011-2/+2
|
* Fix permissions of etc/ci/wpt-nightly-update.shMartin Robinson2023-03-281-0/+0
| | | | | | The permissions were mistakenly modified in a previous change. Fixes #29550.
* Add Layout 2020 support to nightly WPT updateMartin Robinson2023-03-241-12/+14
|
* Be more verbose when a command fails in the WPT upstream scriptMartin Robinson2023-03-231-3/+8
|
* Merge forbidden panic check into test-tidyMartin Robinson2023-03-221-34/+0
| | | | | | | | | This cleans up the GitHub actions yaml a bit and ensures that developers are running this check locally before submitting changes. In addition, it allows adding tests for this check. Finally, this change fixes the tidy tests by upgrading voluptuous for Python 3.10 as well as by reverting an inadvertent change for NixOS compatibility on one of the dummy testing files.
* Filter unknown flaky tests when filtering known intermittentsMartin Robinson2023-02-211-17/+21
| | | | | | | | | | | | | | | | | | | | | | | | | There are two kinds of flaky/intermittent tests in Servo. The traditional kind is the test that fails on the CI, but has an associated bug indicating that the test is an intermittent failure. Many of these tests have completely unstable results, for instance those where an unpredictable set of subtests fail. It's impossible to generate stable results for these, so we have traditionally simply discard these unexpected results. Another kind of intermittent test is one that will produce an expected result when rerun (ie will flake). Some of these are also labeled with bugs, while some are not. In some cases, there is flakiness in some core Servo functionality that can lead to *any* test flaking, such as a race condition that can lead to an early screenshot for reftests. When these kinds of tests do not have associated bugs, they cause the CI to fail. In this case, it is impossible to label these tests as intermittent because it can literally be any test. This change, reruns failed tests in order to detect unlabeled tests in the second category. Instead of blocking the CI when the second run leads to expected results, the CI will now pass, but the flake will be reported to the new flakiness dashboard. This prevents unrelated flakes from slowing down the merge queue.
* Add support for the intermittent dashboardMartin Robinson2023-02-151-0/+7
| | | | | | | | Use the new intermittent dashboard to report intermittents and get information about open bugs. This is now used to filter out known-intermittents from results. In addition, this also allows the scripts to report bug information to the GitHub. Display that in all output.
* Make two small improvements to try result commentMartin Robinson2023-02-101-2/+22
| | | | | Sort the test names alphabetically so that they are stable between try runs and also include the action URL in the comment when possible.
* Output test results as a GitHub commentMartin Robinson2023-02-041-0/+144
| | | | | | | | | After filtering intermittents, output the results as JSON. Update the GitHub workflow to aggregate this JSON data into an artifact and use the aggregated data to generate a GitHub comment with details about the try run. The idea here is that this comment will make it easier to track intermittent tests and notice when a change affects a test marked as intermittent -- either causing it to permanently fail or fixing it.
* ci: Produce a single WPT log artifactMartin Robinson2023-02-021-1/+1
| | | | | | GitHub supports adding files to an artifact in parallel, as long as the filenames are unique. This makes it easier to download build results when more than a single builder fails.
* Fix upstreaming of WPT changesMartin Robinson2023-01-253-8/+27
| | | | | | | | | The GitHub Action needs access to Servo repository secrets, so switch to using the 'pull_request_target' event. Since these PRs have more complete access to the Servo repository, do not execute the version of the upstream script that comes with the PR. Instead, simply fetch the changes. To make this work, the script no longer expects the PR commit to be checked out, merely that they exist in the repository somewhere.
* Enable the Github Action-based WPT upstream scriptMartin Robinson2023-01-201-2/+2
|
* Add a script to upstream WPT changes via a GitHub ActionMartin Robinson2023-01-1732-0/+4946
| | | | | | | | | | | | This is a modified version of the webhook found at servo/upstream_wpt_webhook and deployed via SaltStack. It is updated to use modern Python and to assume that GitHub Actions will fetch the appropriate source code locally before the script is run. Fixes #29206. Fixes #23798. Signed-off-by: Martin Robinson <mrobinson@igalia.com>
* Run WPT sync nightly on GitHub Actioncybai2022-08-162-1/+49
|
* chore(ci): remove the auto-generation of `main.yml`yvt2021-07-182-267/+0
|
* Use codesigning in UWP builds.Josh Matthews2021-07-021-7/+7
|
* Add missing CI checks.Josh Matthews2021-05-291-0/+4
|
generated by cgit v1.2.3 (git 2.25.1) at 2025-04-24 00:47:20 +0000