Skip to content
Build

SLI-2467 Reduce test flakyness #321

Sign in to view logs

SLI-2467 Reduce test flakyness

SLI-2467 Reduce test flakyness #321

Triggered via pull request January 30, 2026 13:27
@nquinquenelnquinquenel
opened #1624
task/nq/reduce-flakyness
Status Failure
Total duration 34m 30s
Artifacts 67

build.yml

on: pull_request
Get build number
10s
Get build number
Build Plugin
8m 29s
Build Plugin
Test Windows
12m 58s
Test Windows
Matrix: qa
Tests and Sonar
7m 12s
Tests and Sonar
Verify Plugin
14m 45s
Verify Plugin
Promote
Promote
Update Dogfood Repository
0s
Update Dogfood Repository
Notify on Failure
6s
Notify on Failure
Fit to window
Zoom out
Zoom in

Annotations

28 errors and 28 warnings
ExcludeFileActionTests.disable_if_project_is_not_init(): build\classes\java\test\org\sonarlint\intellij\actions\ExcludeFileActionTests.class#L66
org.opentest4j.AssertionFailedError: Expecting value to be true but was false
ExcludeFileActionTests.do_nothing_if_there_are_no_files(): build\classes\java\test\org\sonarlint\intellij\actions\ExcludeFileActionTests.class#L66
org.opentest4j.AssertionFailedError: Expecting value to be true but was false
ExcludeFileActionTests.invisible_if_no_file(): build\classes\java\test\org\sonarlint\intellij\actions\ExcludeFileActionTests.class#L66
org.opentest4j.AssertionFailedError: Expecting value to be true but was false
ExcludeFileActionTests.do_nothing_if_disposed(): build\classes\java\test\org\sonarlint\intellij\actions\ExcludeFileActionTests.class#L66
org.opentest4j.AssertionFailedError: Expecting value to be true but was false
ExcludeFileActionTests.disable_if_project_is_null(): build\classes\java\test\org\sonarlint\intellij\actions\ExcludeFileActionTests.class#L66
org.opentest4j.AssertionFailedError: Expecting value to be true but was false
ExcludeFileActionTests.disable_if_project_is_disposed(): build\classes\java\test\org\sonarlint\intellij\actions\ExcludeFileActionTests.class#L66
org.opentest4j.AssertionFailedError: Expecting value to be true but was false
Test Windows
Process completed with exit code 1.
ExcludeFileActionTests.disable_if_project_is_not_init(): src/test/java/org/sonarlint/intellij/actions/ExcludeFileActionTests.java#L66
org.opentest4j.AssertionFailedError: Expecting value to be true but was false
ExcludeFileActionTests.do_nothing_if_there_are_no_files(): src/test/java/org/sonarlint/intellij/actions/ExcludeFileActionTests.java#L66
org.opentest4j.AssertionFailedError: Expecting value to be true but was false
ExcludeFileActionTests.invisible_if_no_file(): src/test/java/org/sonarlint/intellij/actions/ExcludeFileActionTests.java#L66
org.opentest4j.AssertionFailedError: Expecting value to be true but was false
ExcludeFileActionTests.do_nothing_if_disposed(): src/test/java/org/sonarlint/intellij/actions/ExcludeFileActionTests.java#L66
org.opentest4j.AssertionFailedError: Expecting value to be true but was false
ExcludeFileActionTests.disable_if_project_is_null(): src/test/java/org/sonarlint/intellij/actions/ExcludeFileActionTests.java#L66
org.opentest4j.AssertionFailedError: Expecting value to be true but was false
ExcludeFileActionTests.disable_if_project_is_disposed(): src/test/java/org/sonarlint/intellij/actions/ExcludeFileActionTests.java#L66
org.opentest4j.AssertionFailedError: Expecting value to be true but was false
StandaloneModeMediumTests.should_analyze_terraform_file(): src/test/java/org/sonarlint/intellij/mediumtests/StandaloneModeMediumTests.kt#L102
java.lang.RuntimeException: Analysis failed for src/Terraform.tf
StandaloneModeMediumTests.should_analyze_html_file(): src/test/java/org/sonarlint/intellij/mediumtests/StandaloneModeMediumTests.kt#L108
java.lang.RuntimeException: Analysis failed for src/file.html
StandaloneModeMediumTests.should_analyze_ruby_file(): src/test/java/org/sonarlint/intellij/mediumtests/StandaloneModeMediumTests.kt#L126
java.lang.RuntimeException: Analysis failed for src/file.rb
StandaloneModeMediumTests.should_analyze_php_file(): src/test/java/org/sonarlint/intellij/mediumtests/StandaloneModeMediumTests.kt#L120
java.lang.RuntimeException: Analysis failed for src/file.php
StandaloneModeMediumTests.should_analyze_css_file(): src/test/java/org/sonarlint/intellij/mediumtests/StandaloneModeMediumTests.kt#L68
java.lang.RuntimeException: Analysis failed for src/style.css
StandaloneModeMediumTests.should_analyze_java_file(): src/test/java/org/sonarlint/intellij/mediumtests/StandaloneModeMediumTests.kt#L56
java.lang.RuntimeException: Analysis failed for src/Main.java
StandaloneModeMediumTests.should_analyze_cloudformation_file(): src/test/java/org/sonarlint/intellij/mediumtests/StandaloneModeMediumTests.kt#L86
java.lang.RuntimeException: Analysis failed for src/CloudFormation.yaml
StandaloneModeMediumTests.should_analyze_xml_file(): src/test/java/org/sonarlint/intellij/mediumtests/StandaloneModeMediumTests.kt#L62
java.lang.RuntimeException: Analysis failed for src/file.xml
StandaloneModeMediumTests.should_analyze_kubernetes_file(): src/test/java/org/sonarlint/intellij/mediumtests/StandaloneModeMediumTests.kt#L96
java.lang.RuntimeException: Analysis failed for src/k8s.yaml
StandaloneModeMediumTests.should_analyze_kotlin_file(): src/test/java/org/sonarlint/intellij/mediumtests/StandaloneModeMediumTests.kt#L114
java.lang.RuntimeException: Analysis failed for src/file.kt
StandaloneModeMediumTests.should_analyze_python_file(): src/test/java/org/sonarlint/intellij/mediumtests/StandaloneModeMediumTests.kt#L80
java.lang.RuntimeException: Analysis failed for src/file.py
StandaloneModeMediumTests.should_analyze_dockerfile(): src/test/java/org/sonarlint/intellij/mediumtests/StandaloneModeMediumTests.kt#L74
java.lang.RuntimeException: Analysis failed for src/Dockerfile
ConnectionTestTaskTests.should_not_validate_connection_when_host_does_not_exist(): src/test/java/org/sonarlint/intellij/tasks/ConnectionTestTaskTests.kt#L1
com.intellij.testFramework.TestLoggerFactory$TestLoggerAssertionError: null
Tests and Sonar
Process completed with exit code 1.
Run ITs - IC-2025.2 - ConnectedAnalysisTests
Process completed with exit code 1.
Deactivating UseContainerSupport
The GitHub-hosted Ubuntu runners have an issue with Java's UseContainerSupport feature.
Build Plugin
The DEVELOCITY_ACCESS_KEY env var should be mapped to a short-lived token
Build Plugin
Failed to fetch short-lived token for Develocity
Deactivating UseContainerSupport
The GitHub-hosted Ubuntu runners have an issue with Java's UseContainerSupport feature.
Tests and Sonar
The DEVELOCITY_ACCESS_KEY env var should be mapped to a short-lived token
Tests and Sonar
Failed to fetch short-lived token for Develocity
Run ITs - PY-2023.1.6 - PyCharmProfessional2023
Cache save failed.
Run ITs - PC-2023.1.6 - PyCharmCommunity2023
Cache save failed.
Run ITs - GO-2023.3.8 - GoLand2023
Cache save failed.
Run ITs - PS-2025.2 - PhpStorm2025
Cache save failed.
Run ITs - CL-2023.1.7 - CLion2023
Cache save failed.
Run ITs - GO-2025.2 - GoLand2025
Cache save failed.
Run ITs - PY-2025.2 - PyCharmProfessional2025
Cache save failed.
Run ITs - RD-2023.3.6 - Rider2023
Cache save failed.
Run ITs - CL-2025.2 - CLion2025
Cache save failed.
Run ITs - IC-2023.1.7 - Standalone
Cache save failed.
Run ITs - IC-2025.2 - Standalone
Cache save failed.
Deactivating UseContainerSupport
The GitHub-hosted Ubuntu runners have an issue with Java's UseContainerSupport feature.
Verify Plugin
The DEVELOCITY_ACCESS_KEY env var should be mapped to a short-lived token
Verify Plugin
Failed to fetch short-lived token for Develocity
Run ITs - IC-2025.2 - ConnectedAnalysisTests
No files were found with the provided path: **/test-results/**/*.xml. No artifacts will be uploaded.
Run ITs - IC-2025.2 - ConnectedAnalysisTests
No files were found with the provided path: **/reports/**/*. No artifacts will be uploaded.
Run ITs - IC-2025.2 - ConnectedAnalysisTests
No files were found with the provided path: /home/runner/work/sonarlint-intellij/sonarlint-intellij/recording_IC-2025.2.mp4. No artifacts will be uploaded.
Run ITs - IC-2025.2 - ConnectedAnalysisTests
Cache save failed.
Run ITs - IU-2023.1.7 - IdeaUltimate2023
Cache save failed.
Run ITs - IC-2023.1.7 - OpenInIdeTests
Cache save failed.
Run ITs - IC-2023.1.7 - ConnectedAnalysisTests
Cache save failed.
Run ITs - IC-2025.2 - ConfigurationTests
Cache save failed.

Artifacts

Produced during runtime
Name Size Digest
junit-results-linux
190 KB
sha256:6191e00eb4b6686f47a6b420e81c6356a70a5e3d310a412cdc7d511a12cecc3e
junit-results-qa-CL-2023.1.7-CLion2023
34.8 KB
sha256:8b9cb2cc37bbc0631a077c86fef91e3048a6fbee18b06218576e492a3a70d22e
junit-results-qa-CL-2025.2-CLion2025
34.7 KB
sha256:18f7aa05b3acbe5c037d43db0cd6083c108a1ad6033357cd745c84954a7db3ed
junit-results-qa-GO-2023.3.8-GoLand2023
23.2 KB
sha256:f40d9e3e8bbce85cc0260712201c8ba7592c882093849c000bbba21133c3a7a9
junit-results-qa-GO-2025.2-GoLand2025
14.3 KB
sha256:d87f71949e5f36666cea7af134e08d898567810e9e79bf6e5b00b36a346c8cfa
junit-results-qa-IC-2023.1.7-ConfigurationTests
202 KB
sha256:64500ff7685f5102a9d35734d2947d78cb49e2c72930986dd4d96c6cf842cfec
junit-results-qa-IC-2023.1.7-ConnectedAnalysisTests
156 KB
sha256:408a3698e6ea9afa5e985cacdd71627b765a8fc0d6b8571faef56b7499af8d90
junit-results-qa-IC-2023.1.7-OpenInIdeTests
91.8 KB
sha256:bca1e53fb74ce661bfb4b868d1a7536ea5fc62e4c34367554117d9b4b525605d
junit-results-qa-IC-2023.1.7-Standalone
67.1 KB
sha256:3afd8daed901eedf14a028e3c9316318fe8942ced8a21195c8edb9c550da4f84
junit-results-qa-IC-2025.2-ConfigurationTests
198 KB
sha256:0e63b4b787187f522b84ab9382f26ceda9c864cf0ad454ca7d5d1cba5dad2b8f
junit-results-qa-IC-2025.2-OpenInIdeTests
94.1 KB
sha256:1727836b06c35281da59223118a1db70b3653e89e8571cba16c5890abf07f64d
junit-results-qa-IC-2025.2-Standalone
69.4 KB
sha256:02f4713fb0d3a245737baeb64a746abd1e2f08270a675ddaf37e51b221cfc0bd
junit-results-qa-IU-2023.1.7-IdeaUltimate2023
198 KB
sha256:6757626258d2734f4369580fa5ebbb8326cbc21056f27a1f584d3ebae9854c27
junit-results-qa-IU-2025.2-IdeaUltimate2025
199 KB
sha256:82b9fa4725655ae445778730b4e72fe69acd16af8778c9606e8f93e1cfb19f4a
junit-results-qa-PC-2023.1.6-PyCharmCommunity2023
21.1 KB
sha256:cf0487c684f8c2b55c286b85ac794e7a23a635f4d37526c06c278a8e3f1cd122
junit-results-qa-PC-2025.2-PyCharmCommunity2025
21.4 KB
sha256:6d60e7aee1a8f926e52c5add7480c15ba73aded344edba3694d5a79e44d27247
junit-results-qa-PS-2023.1.6-PhpStorm2023
20.1 KB
sha256:3ef49133d1ff9f57c84f183b8125580c1c71a5fe0a2c122df4d446d1ee493621
junit-results-qa-PS-2025.2-PhpStorm2025
20 KB
sha256:29b9561ad63f0f42508b774a5b23b10d296089b5b75f602b882b2680069491aa
junit-results-qa-PY-2023.1.6-PyCharmProfessional2023
21 KB
sha256:71d55f6f60cbc438533bd409b3c6dc8cdc65a747f1e8cc2f91d2e3dc61045f7f
junit-results-qa-PY-2025.2-PyCharmProfessional2025
21.4 KB
sha256:c0f0f9bd4d1552fa007227f3675079852d2b00f0df1779ac70aaa3de5a9f40e7
junit-results-qa-RD-2023.3.6-Rider2023
59 KB
sha256:de2cc598ab06c240bc010c6d6bca6422ff28fd78adf4bfa0684bb58ccd781f27
junit-results-windows
212 KB
sha256:1a9fc62ad74992bee9b087c2812861d5f141020844427eb4e9b5f1f2abe948bd
problems-report-build-plugin0
40.6 KB
sha256:0fd01244240a4f62933f5c8e383bbcac685fe223906415ed134f5cc6288b96ad
problems-report-test-and-sonar0
40.4 KB
sha256:30a233da4993cef0f5fc240e345de3f869dab117e8408908a8f84be7d2da5c08
problems-report-verify-plugin0
43.1 KB
sha256:f6776a1eae8718e2ed01fb6121fe2b66cca6164c0b6e1b6c781fb641026710f3
test-recording-CL-2023.1.7-CLion2023
1.3 MB
sha256:8d32be45b38aaaf26452b8692708dbea680aaef3f0e6458ed282fba14971656a
test-recording-CL-2025.2-CLion2025
1.23 MB
sha256:2ffa49c9f840c5cc5dd509cbe91fc9a74e2c7b54fb2c5619fce17c043092f8b4
test-recording-GO-2023.3.8-GoLand2023
1.19 MB
sha256:3221c5ad7456e49a912189afc7c67ee34556defa4f696c696b3a027dba361f01
test-recording-GO-2025.2-GoLand2025
1.07 MB
sha256:c843645556016964ff292c046a8e8a335c73c4ef134fe1abeaecef4dbbe63d31
test-recording-IC-2023.1.7-ConfigurationTests
8.43 MB
sha256:fb9e9aced2bbe8322db21dcf2b289ec65332b7c4c3e91ac7c8fd2a5a2e4fb3ef
test-recording-IC-2023.1.7-ConnectedAnalysisTests
4.94 MB
sha256:d57feabaa55d63e316fff4e79d6d242ebed26c872d268abd08cf0ce289ad9290
test-recording-IC-2023.1.7-OpenInIdeTests
4.11 MB
sha256:e1692f658ab63dca7a9f6c23fffa0894bf5fe358dbd4a49e9b4ba520f860b7fa
test-recording-IC-2023.1.7-Standalone
4.32 MB
sha256:01422c82d11e13f428c185bd12d4d4ebd316df48f49c51beb92ed781c2e403c4
test-recording-IC-2025.2-ConfigurationTests
7.52 MB
sha256:8b90fb0c39789790e7d9559d85d6d469fe5ef3fbb30dbd986224dc1ad6514eee
test-recording-IC-2025.2-OpenInIdeTests
3.79 MB
sha256:be3b00b030ef79c0e83123e3441ca04298772b20fb11d4aab3b975e7062ec851
test-recording-IC-2025.2-Standalone
3.9 MB
sha256:82e1e6da470a70d01575b1f6db69887794eda0ce2bc01d8b45321b85d1d28bcf
test-recording-IU-2023.1.7-IdeaUltimate2023
4.52 MB
sha256:ae29ddc3272a90e7b1cde6262c2a5fcc335203b4d7ef40418eadfaf3df689299
test-recording-IU-2025.2-IdeaUltimate2025
4.35 MB
sha256:494d924cb0f1234974134df958f0b13f3d2d1b6e9b66bfbe0e7a7149cc9a3f39
test-recording-PC-2023.1.6-PyCharmCommunity2023
1020 KB
sha256:715973de83b161f15e8adea8fecce7846ed8368271388fd2064bce4c0c2ad2ba
test-recording-PC-2025.2-PyCharmCommunity2025
985 KB
sha256:557a9b12481a609fe80f5b2070deffbe41e55c8e1edd07d6a80fc49f950430f8
test-recording-PS-2023.1.6-PhpStorm2023
877 KB
sha256:793d3f22a54d7fabebe42a1c52a8581f5e54c9c131808c537c5aa21596366034
test-recording-PS-2025.2-PhpStorm2025
707 KB
sha256:529b631527f4117500d7a0b257c1aee56fd1d47446402df63e519a6c7e57d17b
test-recording-PY-2023.1.6-PyCharmProfessional2023
1010 KB
sha256:ad419a8186c795eff136fb53022e24ad0164934e5153060c4dbbb0ce6f07421c
test-recording-PY-2025.2-PyCharmProfessional2025
1.02 MB
sha256:08234705fa1ea5272122be4d661214cf9f5b4f830acf3ab5f9adcdd5053a03c9
test-recording-RD-2023.3.6-Rider2023
2.83 MB
sha256:b9539c1d0c1c5bfd1f2b94fa9f5ec33c29a063eadfc01367e5df4d06e3f5be93
test-reports-linux
352 KB
sha256:cafb2cc0e52a62b885c117ea20526b71f0ee995fd692a448568d15ea04fe79f6
test-reports-qa-CL-2023.1.7-CLion2023
91.5 KB
sha256:2223b8f704e4d43a7ab0a0bd5b38752ecfa49cfdf9d73f6813bed6bd7733192b
test-reports-qa-CL-2025.2-CLion2025
192 KB
sha256:7b28156a5c4c2d0325d767d56526566135d1689e6a2ca7997294e895b4aaf7c2
test-reports-qa-GO-2023.3.8-GoLand2023
180 KB
sha256:f606e9bc2c02d51bac124bbc2b990752f2faf729180c2158d4ae6800beaa1798
test-reports-qa-GO-2025.2-GoLand2025
172 KB
sha256:f7430e227bf86ea50ceea43e9995dcdd31925386b3adce81008ad431bb4ff323
test-reports-qa-IC-2023.1.7-ConfigurationTests
254 KB
sha256:9aeafa86cc207a63837709a0bd5510f5accc85e588f155c5e891bd6f1a31fab2
test-reports-qa-IC-2023.1.7-ConnectedAnalysisTests
207 KB
sha256:97740213dc5717b0a38c722993955f62adee949b9fd834d8f9bda570e3f3d76b
test-reports-qa-IC-2023.1.7-OpenInIdeTests
142 KB
sha256:2ee7afdc23ab8c6519b263d03cc4b5daeaf2709cd9e42c0db63525325bec330e
test-reports-qa-IC-2023.1.7-Standalone
114 KB
sha256:8cfe2dea68e11393a3d4bcd5bb73e9d44f66dc1444c30c92cef4a6bd5e0b306b
test-reports-qa-IC-2025.2-ConfigurationTests
350 KB
sha256:361a244897d7f35dae06b9e2c3c98afc1e62cac4e45bcedb0682d88166e73b52
test-reports-qa-IC-2025.2-OpenInIdeTests
245 KB
sha256:3da36aeddcf15b4dd47d8df28f23ba590fafe52ec0cb81919462b920f881dd2e
test-reports-qa-IC-2025.2-Standalone
217 KB
sha256:f3d508482d9b86ec55ea876f90fb8326c79cce04ee7e20ef83bbefe4554b82b3
test-reports-qa-IU-2023.1.7-IdeaUltimate2023
257 KB
sha256:ae19c43d5c945f7e893853da30576aaf82a1de4be60cf9556212f521aba15acb
test-reports-qa-IU-2025.2-IdeaUltimate2025
359 KB
sha256:ff27a193c696b35a49172d17a5e280696e30488b97b94a1986b81a0707f4974b
test-reports-qa-PC-2023.1.6-PyCharmCommunity2023
77.7 KB
sha256:30c5138365a969f4c67683ac869a60ece5e0d400848afe61bdae3f7dcba61ab3
test-reports-qa-PC-2025.2-PyCharmCommunity2025
179 KB
sha256:a6862f7bceab8b51c5528de49843721462d3ccf775f5dae247b830155737ed21
test-reports-qa-PS-2023.1.6-PhpStorm2023
76.7 KB
sha256:5bec2707abb2de6decec943cd2197907ac841f618b0f72cfeade564923702f1d
test-reports-qa-PS-2025.2-PhpStorm2025
177 KB
sha256:f2292b15d1fbf37540f0a742406f83eea9c19597ef60a57b72f0edd8ce512436
test-reports-qa-PY-2023.1.6-PyCharmProfessional2023
77.6 KB
sha256:994b61ecc7b25aca07220ca87a335c3b11e0f79c23aa1d6dd1a55b7d0e9ea76d
test-reports-qa-PY-2025.2-PyCharmProfessional2025
179 KB
sha256:ea53fff69ee58d981cdc22885511cc9483486e007052a44ef4978fc7f32bdd5b
test-reports-qa-RD-2023.3.6-Rider2023
217 KB
sha256:fba622e7b868274d87123ee280b9024651302f5502f6e577663c6d5627281d97
test-reports-windows
341 KB
sha256:dffc0191c5689261ee19f28b4518e4ba36160e649712a71f36c2b84bedb0b0dd