Skip to content

fix: morpc client lock contention causing long blocking during CN node terminated #32922

fix: morpc client lock contention causing long blocking during CN node terminated

fix: morpc client lock contention causing long blocking during CN node terminated #32922

Triggered via pull request January 4, 2026 03:45
@XuPeng-SHXuPeng-SH
reopened #23435
Status Failure
Total duration 56m 7s
Artifacts 2

entrypoint.yaml

on: pull_request_target
CHECK PR VALID
5s
CHECK PR VALID
Matrixone Utils CI (3.0)  /  check_organization_user
Matrixone Utils CI (3.0) / check_organization_user
Matrixone Utils CI  /  check_organization_user
3s
Matrixone Utils CI / check_organization_user
Matrixone Standlone CI  /  Multi-CN e2e BVT Test on Linux/x64(LAUNCH, PROXY)
30m 43s
Matrixone Standlone CI / Multi-CN e2e BVT Test on Linux/x64(LAUNCH, PROXY)
Matrixone Standlone CI  /  e2e BVT Test on Linux/x64(LAUNCH, PESSIMISTIC)
28m 10s
Matrixone Standlone CI / e2e BVT Test on Linux/x64(LAUNCH, PESSIMISTIC)
Matrixone Standlone CI (3.0)  /  Multi-CN e2e BVT Test on Linux/x64(LAUNCH, PROXY)
Matrixone Standlone CI (3.0) / Multi-CN e2e BVT Test on Linux/x64(LAUNCH, PROXY)
Matrixone Standlone CI (3.0)  /  e2e BVT Test on Linux/x64(LAUNCH, PESSIMISTIC)
Matrixone Standlone CI (3.0) / e2e BVT Test on Linux/x64(LAUNCH, PESSIMISTIC)
Matrixone CI  /  UT Test on Ubuntu/x86
29m 43s
Matrixone CI / UT Test on Ubuntu/x86
Matrixone CI  /  UT Test on Darwin/x86
0s
Matrixone CI / UT Test on Darwin/x86
Matrixone CI  /  SCA Test on Ubuntu/x86
13m 10s
Matrixone CI / SCA Test on Ubuntu/x86
Matrixone Upgrade CI  /  Compatibility Test With Target on Linux/x64(LAUNCH)
54m 45s
Matrixone Upgrade CI / Compatibility Test With Target on Linux/x64(LAUNCH)
Matrixone Upgrade CI  /  Compatibility Test With Release on Linux/x64(LAUNCH)
32m 1s
Matrixone Upgrade CI / Compatibility Test With Release on Linux/x64(LAUNCH)
Matrixone Compose CI  /  multi cn e2e bvt test docker compose(Optimistic/PUSH)
25m 41s
Matrixone Compose CI / multi cn e2e bvt test docker compose(Optimistic/PUSH)
Matrixone Compose CI  /  multi cn e2e bvt test docker compose(PESSIMISTIC)
31m 56s
Matrixone Compose CI / multi cn e2e bvt test docker compose(PESSIMISTIC)
Matrixone Standlone CI  /  e2e BVT Test on Linux/x64(LAUNCH,Optimistic)
38m 40s
Matrixone Standlone CI / e2e BVT Test on Linux/x64(LAUNCH,Optimistic)
Matrixone CI (3.0)  /  SCA Test on Ubuntu/x86
Matrixone CI (3.0) / SCA Test on Ubuntu/x86
Matrixone CI (3.0)  /  UT Test on Darwin/x86
Matrixone CI (3.0) / UT Test on Darwin/x86
Matrixone CI (3.0)  /  UT Test on Ubuntu/x86
Matrixone CI (3.0) / UT Test on Ubuntu/x86
Matrixone Compose CI (3.0)  /  multi cn e2e bvt test docker compose(Optimistic/PUSH)
Matrixone Compose CI (3.0) / multi cn e2e bvt test docker compose(Optimistic/PUSH)
Matrixone Compose CI (3.0)  /  multi cn e2e bvt test docker compose(PESSIMISTIC)
Matrixone Compose CI (3.0) / multi cn e2e bvt test docker compose(PESSIMISTIC)
Matrixone Standlone CI (3.0)  /  e2e BVT Test on Linux/x64(LAUNCH,Optimistic)
Matrixone Standlone CI (3.0) / e2e BVT Test on Linux/x64(LAUNCH,Optimistic)
Matrixone Upgrade CI (3.0)  /  Compatibility Test With Release on Linux/x64(LAUNCH)
Matrixone Upgrade CI (3.0) / Compatibility Test With Release on Linux/x64(LAUNCH)
Matrixone Upgrade CI (3.0)  /  Compatibility Test With Target on Linux/x64(LAUNCH)
Matrixone Upgrade CI (3.0) / Compatibility Test With Target on Linux/x64(LAUNCH)
Matrixone Utils CI (3.0)  /  Coverage
Matrixone Utils CI (3.0) / Coverage
Matrixone Utils CI (3.0)  /  Pull Request Basic Benchmark Test
Matrixone Utils CI (3.0) / Pull Request Basic Benchmark Test
Matrixone Utils CI (3.0)  /  pr-size-label
Matrixone Utils CI (3.0) / pr-size-label
Matrixone Utils CI  /  Coverage
45m 32s
Matrixone Utils CI / Coverage
Matrixone Utils CI  /  pr-size-label
4s
Matrixone Utils CI / pr-size-label
Matrixone Utils CI  /  Pull Request Basic Benchmark Test
23m 24s
Matrixone Utils CI / Pull Request Basic Benchmark Test
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 3 warnings
Matrixone Upgrade CI / Compatibility Test With Release on Linux/x64(LAUNCH)
Process completed with exit code 1.
Matrixone Upgrade CI / Compatibility Test With Release on Linux/x64(LAUNCH)
Process completed with exit code 1.
Matrixone CI / UT Test on Ubuntu/x86
WARNING: /opt/hostedtoolcache/hdfs/3.4.1/x64/logs does not exist. Creating. 2026-01-04 03:47:46,578 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = runnervmdwttx/10.1.0.131 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 3.4.1 STARTUP_MSG: classpath = /opt/hostedtoolcache/hdfs/3.4.1/x64/etc/hadoop:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/checker-qual-2.5.2.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jersey-servlet-1.19.4.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-native-epoll-4.1.100.Final-linux-aarch_64.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/audience-annotations-0.12.0.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/curator-client-5.2.0.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-resolver-dns-native-macos-4.1.100.Final-osx-aarch_64.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/commons-net-3.9.0.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-codec-mqtt-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/avro-1.9.2.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/commons-compress-1.26.1.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/hadoop-annotations-3.4.1.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-codec-stomp-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jetty-webapp-9.4.53.v20231009.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/snappy-java-1.1.10.4.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/guava-27.0-jre.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/woodstox-core-5.4.0.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-handler-ssl-ocsp-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/j2objc-annotations-1.1.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jettison-1.5.4.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-udt-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jetty-security-9.4.53.v20231009.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-classes-kqueue-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/reload4j-1.2.22.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-codec-http-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/slf4j-api-1.7.36.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/httpclient-4.5.13.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jakarta.activation-api-1.2.1.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/httpcore-4.4.13.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-native-epoll-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-native-epoll-4.1.100.Final-linux-x86_64.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jackson-annotations-2.12.7.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/nimbus-jose-jwt-9.37.2.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-classes-epoll-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/kerby-pkix-2.0.3.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/commons-daemon-1.0.13.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jetty-util-ajax-9.4.53.v20231009.jar:/opt/hostedtoolcac
Matrixone CI / UT Test on Ubuntu/x86
+ chmod g-w /home/runner + chmod o-w /home/runner + ssh-keygen -t rsa -P -f /home/runner/.ssh/id_rsa Created directory '/home/runner/.ssh'. + cat /home/runner/.ssh/id_rsa.pub + chmod 0600 /home/runner/.ssh/authorized_keys + ssh-keyscan -H localhost # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.13 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.13 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.13 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.13 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.13 + chmod 0600 /home/runner/.ssh/known_hosts + ssh-agent + eval SSH_AUTH_SOCK=/tmp/ssh-XXXXXXJh2mPN/agent.2429; export SSH_AUTH_SOCK; SSH_AGENT_PID=2430; export SSH_AGENT_PID; echo Agent pid 2430; + SSH_AUTH_SOCK=/tmp/ssh-XXXXXXJh2mPN/agent.2429 + export SSH_AUTH_SOCK + SSH_AGENT_PID=2430 + export SSH_AGENT_PID + echo Agent pid 2430 + ssh-add /home/runner/.ssh/id_rsa Identity added: /home/runner/.ssh/id_rsa (runner@runnervmdwttx)
Matrixone Upgrade CI / Compatibility Test With Release on Linux/x64(LAUNCH)
No files were found with the provided path: /home/runner/work/matrixone/matrixone/upload-2. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
Compatibility-Test-Release-on-Linux-x64(LAUNCH)-reports
18.8 MB
sha256:85f486f5c84995515590f9f140255a8b99fc1c4e419ed81eb111bd05ba488443
final-result-files
1.34 MB
sha256:75d0a6b993031e1fae2e108fd41e820a741248cd7e638673773ebef39fdad642