Skip to content

fix: morpc client lock contention causing long blocking during CN node terminated #32915

fix: morpc client lock contention causing long blocking during CN node terminated

fix: morpc client lock contention causing long blocking during CN node terminated #32915

Triggered via pull request January 3, 2026 16:01
@XuPeng-SHXuPeng-SH
synchronize #23435
Status Cancelled
Total duration 2m 17s
Artifacts

entrypoint.yaml

on: pull_request_target
CHECK PR VALID
5s
CHECK PR VALID
Matrixone Utils CI (3.0)  /  check_organization_user
Matrixone Utils CI (3.0) / check_organization_user
Matrixone Utils CI  /  check_organization_user
4s
Matrixone Utils CI / check_organization_user
Matrixone Standlone CI  /  Multi-CN e2e BVT Test on Linux/x64(LAUNCH, PROXY)
1m 49s
Matrixone Standlone CI / Multi-CN e2e BVT Test on Linux/x64(LAUNCH, PROXY)
Matrixone Standlone CI  /  e2e BVT Test on Linux/x64(LAUNCH, PESSIMISTIC)
1m 47s
Matrixone Standlone CI / e2e BVT Test on Linux/x64(LAUNCH, PESSIMISTIC)
Matrixone Standlone CI (3.0)  /  Multi-CN e2e BVT Test on Linux/x64(LAUNCH, PROXY)
Matrixone Standlone CI (3.0) / Multi-CN e2e BVT Test on Linux/x64(LAUNCH, PROXY)
Matrixone Standlone CI (3.0)  /  e2e BVT Test on Linux/x64(LAUNCH, PESSIMISTIC)
Matrixone Standlone CI (3.0) / e2e BVT Test on Linux/x64(LAUNCH, PESSIMISTIC)
Matrixone CI  /  UT Test on Ubuntu/x86
1m 47s
Matrixone CI / UT Test on Ubuntu/x86
Matrixone CI  /  UT Test on Darwin/x86
0s
Matrixone CI / UT Test on Darwin/x86
Matrixone CI  /  SCA Test on Ubuntu/x86
1m 47s
Matrixone CI / SCA Test on Ubuntu/x86
Matrixone Upgrade CI  /  Compatibility Test With Target on Linux/x64(LAUNCH)
1m 50s
Matrixone Upgrade CI / Compatibility Test With Target on Linux/x64(LAUNCH)
Matrixone Upgrade CI  /  Compatibility Test With Release on Linux/x64(LAUNCH)
1m 50s
Matrixone Upgrade CI / Compatibility Test With Release on Linux/x64(LAUNCH)
Matrixone Compose CI  /  multi cn e2e bvt test docker compose(Optimistic/PUSH)
2m 5s
Matrixone Compose CI / multi cn e2e bvt test docker compose(Optimistic/PUSH)
Matrixone Compose CI  /  multi cn e2e bvt test docker compose(PESSIMISTIC)
2m 5s
Matrixone Compose CI / multi cn e2e bvt test docker compose(PESSIMISTIC)
Matrixone Standlone CI  /  e2e BVT Test on Linux/x64(LAUNCH,Optimistic)
1m 48s
Matrixone Standlone CI / e2e BVT Test on Linux/x64(LAUNCH,Optimistic)
Matrixone CI (3.0)  /  SCA Test on Ubuntu/x86
Matrixone CI (3.0) / SCA Test on Ubuntu/x86
Matrixone CI (3.0)  /  UT Test on Darwin/x86
Matrixone CI (3.0) / UT Test on Darwin/x86
Matrixone CI (3.0)  /  UT Test on Ubuntu/x86
Matrixone CI (3.0) / UT Test on Ubuntu/x86
Matrixone Compose CI (3.0)  /  multi cn e2e bvt test docker compose(Optimistic/PUSH)
Matrixone Compose CI (3.0) / multi cn e2e bvt test docker compose(Optimistic/PUSH)
Matrixone Compose CI (3.0)  /  multi cn e2e bvt test docker compose(PESSIMISTIC)
Matrixone Compose CI (3.0) / multi cn e2e bvt test docker compose(PESSIMISTIC)
Matrixone Standlone CI (3.0)  /  e2e BVT Test on Linux/x64(LAUNCH,Optimistic)
Matrixone Standlone CI (3.0) / e2e BVT Test on Linux/x64(LAUNCH,Optimistic)
Matrixone Upgrade CI (3.0)  /  Compatibility Test With Release on Linux/x64(LAUNCH)
Matrixone Upgrade CI (3.0) / Compatibility Test With Release on Linux/x64(LAUNCH)
Matrixone Upgrade CI (3.0)  /  Compatibility Test With Target on Linux/x64(LAUNCH)
Matrixone Upgrade CI (3.0) / Compatibility Test With Target on Linux/x64(LAUNCH)
Matrixone Utils CI (3.0)  /  Coverage
Matrixone Utils CI (3.0) / Coverage
Matrixone Utils CI (3.0)  /  Pull Request Basic Benchmark Test
Matrixone Utils CI (3.0) / Pull Request Basic Benchmark Test
Matrixone Utils CI (3.0)  /  pr-size-label
Matrixone Utils CI (3.0) / pr-size-label
Matrixone Utils CI  /  Coverage
0s
Matrixone Utils CI / Coverage
Matrixone Utils CI  /  pr-size-label
3s
Matrixone Utils CI / pr-size-label
Matrixone Utils CI  /  Pull Request Basic Benchmark Test
0s
Matrixone Utils CI / Pull Request Basic Benchmark Test
Fit to window
Zoom out
Zoom in

Annotations

39 errors and 11 warnings
Matrixone Utils CI / Coverage
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
Matrixone Utils CI / Pull Request Basic Benchmark Test
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
Matrixone CI / UT Test on Ubuntu/x86
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
Matrixone CI / UT Test on Ubuntu/x86
Process completed with exit code 1.
Matrixone CI / UT Test on Ubuntu/x86
Process completed with exit code 1.
Matrixone CI / UT Test on Ubuntu/x86
Process completed with exit code 1.
Matrixone CI / UT Test on Ubuntu/x86
Process completed with exit code 1.
Matrixone CI / UT Test on Ubuntu/x86
The operation was canceled.
Matrixone Standlone CI / e2e BVT Test on Linux/x64(LAUNCH, PESSIMISTIC)
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
Matrixone Standlone CI / e2e BVT Test on Linux/x64(LAUNCH, PESSIMISTIC)
Process completed with exit code 1.
Matrixone Standlone CI / e2e BVT Test on Linux/x64(LAUNCH,Optimistic)
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
Matrixone Standlone CI / e2e BVT Test on Linux/x64(LAUNCH,Optimistic)
Process completed with exit code 1.
Matrixone Standlone CI / e2e BVT Test on Linux/x64(LAUNCH,Optimistic)
The operation was canceled.
Matrixone CI / SCA Test on Ubuntu/x86
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
Matrixone CI / SCA Test on Ubuntu/x86
The operation was canceled.
Matrixone Standlone CI / Multi-CN e2e BVT Test on Linux/x64(LAUNCH, PROXY)
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
Matrixone Standlone CI / Multi-CN e2e BVT Test on Linux/x64(LAUNCH, PROXY)
Process completed with exit code 1.
Matrixone Upgrade CI / Compatibility Test With Target on Linux/x64(LAUNCH)
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
Matrixone Upgrade CI / Compatibility Test With Target on Linux/x64(LAUNCH)
Process completed with exit code 1.
Matrixone Upgrade CI / Compatibility Test With Release on Linux/x64(LAUNCH)
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
Matrixone Upgrade CI / Compatibility Test With Release on Linux/x64(LAUNCH)
Process completed with exit code 1.
Matrixone Compose CI / multi cn e2e bvt test docker compose(Optimistic/PUSH)
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
Matrixone Compose CI / multi cn e2e bvt test docker compose(Optimistic/PUSH)
Process completed with exit code 1.
Matrixone Compose CI / multi cn e2e bvt test docker compose(Optimistic/PUSH)
Process completed with exit code 7.
Matrixone Compose CI / multi cn e2e bvt test docker compose(PESSIMISTIC)
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
Matrixone Compose CI / multi cn e2e bvt test docker compose(PESSIMISTIC)
Process completed with exit code 1.
Matrixone Compose CI / multi cn e2e bvt test docker compose(PESSIMISTIC)
Process completed with exit code 7.
MatrixOne ALL CI
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
MatrixOne ALL CI
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
MatrixOne ALL CI
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
MatrixOne ALL CI
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
MatrixOne ALL CI
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
MatrixOne ALL CI
Canceling since a higher priority waiting request for XuPeng-SH/matrixone/fix-rpc-lock-contention/MatrixOne ALL CI exists
Matrixone CI / UT Test on Ubuntu/x86
WARNING: /opt/hostedtoolcache/hdfs/3.4.1/x64/logs does not exist. Creating. 2026-01-03 16:02:46,467 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = runnervmdwttx/10.1.0.165 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 3.4.1 STARTUP_MSG: classpath = /opt/hostedtoolcache/hdfs/3.4.1/x64/etc/hadoop:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/checker-qual-2.5.2.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jersey-servlet-1.19.4.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-native-epoll-4.1.100.Final-linux-aarch_64.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/audience-annotations-0.12.0.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/curator-client-5.2.0.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-resolver-dns-native-macos-4.1.100.Final-osx-aarch_64.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/commons-net-3.9.0.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-codec-mqtt-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/avro-1.9.2.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/commons-compress-1.26.1.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/hadoop-annotations-3.4.1.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-codec-stomp-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jetty-webapp-9.4.53.v20231009.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/snappy-java-1.1.10.4.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/guava-27.0-jre.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/woodstox-core-5.4.0.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-handler-ssl-ocsp-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/j2objc-annotations-1.1.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jettison-1.5.4.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-udt-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jetty-security-9.4.53.v20231009.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-classes-kqueue-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/reload4j-1.2.22.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-codec-http-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/slf4j-api-1.7.36.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/httpclient-4.5.13.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jakarta.activation-api-1.2.1.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/httpcore-4.4.13.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-native-epoll-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-native-epoll-4.1.100.Final-linux-x86_64.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jackson-annotations-2.12.7.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/nimbus-jose-jwt-9.37.2.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/netty-transport-classes-epoll-4.1.100.Final.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/kerby-pkix-2.0.3.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/commons-daemon-1.0.13.jar:/opt/hostedtoolcache/hdfs/3.4.1/x64/share/hadoop/common/lib/jetty-util-ajax-9.4.53.v20231009.jar:/opt/hostedtoolcac
Matrixone CI / UT Test on Ubuntu/x86
+ chmod g-w /home/runner + chmod o-w /home/runner + ssh-keygen -t rsa -P -f /home/runner/.ssh/id_rsa Created directory '/home/runner/.ssh'. + cat /home/runner/.ssh/id_rsa.pub + chmod 0600 /home/runner/.ssh/authorized_keys + ssh-keyscan -H localhost # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.13 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.13 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.13 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.13 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.13 + chmod 0600 /home/runner/.ssh/known_hosts + ssh-agent + eval SSH_AUTH_SOCK=/tmp/ssh-XXXXXXTjnM9d/agent.2318; export SSH_AUTH_SOCK; SSH_AGENT_PID=2319; export SSH_AGENT_PID; echo Agent pid 2319; + SSH_AUTH_SOCK=/tmp/ssh-XXXXXXTjnM9d/agent.2318 + export SSH_AUTH_SOCK + SSH_AGENT_PID=2319 + export SSH_AGENT_PID + echo Agent pid 2319 + ssh-add /home/runner/.ssh/id_rsa Identity added: /home/runner/.ssh/id_rsa (runner@runnervmdwttx)
Matrixone Standlone CI / e2e BVT Test on Linux/x64(LAUNCH, PESSIMISTIC)
No files were found with the provided path: /home/runner/work/matrixone/matrixone/upload. No artifacts will be uploaded.
Matrixone Standlone CI / e2e BVT Test on Linux/x64(LAUNCH,Optimistic)
No files were found with the provided path: /home/runner/work/matrixone/matrixone/upload. No artifacts will be uploaded.
Matrixone Standlone CI / Multi-CN e2e BVT Test on Linux/x64(LAUNCH, PROXY)
No files were found with the provided path: /home/runner/work/matrixone/matrixone/upload. No artifacts will be uploaded.
Matrixone Upgrade CI / Compatibility Test With Target on Linux/x64(LAUNCH)
No files were found with the provided path: /home/runner/work/matrixone/matrixone/upload-2. No artifacts will be uploaded.
Matrixone Upgrade CI / Compatibility Test With Target on Linux/x64(LAUNCH)
No files were found with the provided path: /home/runner/work/matrixone/matrixone/upload-1. No artifacts will be uploaded.
Matrixone Upgrade CI / Compatibility Test With Release on Linux/x64(LAUNCH)
No files were found with the provided path: /home/runner/work/matrixone/matrixone/upload-2. No artifacts will be uploaded.
Matrixone Upgrade CI / Compatibility Test With Release on Linux/x64(LAUNCH)
No files were found with the provided path: /home/runner/work/matrixone/matrixone/upload-1. No artifacts will be uploaded.
Matrixone Compose CI / multi cn e2e bvt test docker compose(Optimistic/PUSH)
No files were found with the provided path: /home/runner/work/matrixone/matrixone/docker-compose-log. No artifacts will be uploaded.
Matrixone Compose CI / multi cn e2e bvt test docker compose(PESSIMISTIC)
No files were found with the provided path: /home/runner/work/matrixone/matrixone/docker-compose-log. No artifacts will be uploaded.