!!!canal.instance.parser.parallelThreadSize

[dyrnq]

## concurrent thread number, default 60% available processors, suggest not to exceed Runtime.getRuntime().availableProcessors()
#canal.instance.parser.parallelThreadSize = 16

相关代码

• https://github.com/alibaba/canal/blob/canal-1.1.8-alpha-3/parse/src/main/java/com/alibaba/otter/canal/parse/inbound/AbstractEventParser.java#L94
• https://github.com/alibaba/canal/blob/canal-1.1.8-alpha-3/parse/src/main/java/com/alibaba/otter/canal/parse/inbound/mysql/MysqlMultiStageCoprocessor.java#L87

        int tc = parserThreadCount > 0 ? parserThreadCount : 1;
        this.parserExecutor = Executors.newFixedThreadPool(tc, new NamedThreadFactory("MultiStageCoprocessor-Parser-"
                                                                                      + destination));

        this.stageExecutor = Executors.newFixedThreadPool(2, new NamedThreadFactory("MultiStageCoprocessor-other-"
                                                                                    + destination));

假如 canal.instance.parser.parallelThreadSize = 4 如下

docker compose exec -it cs1 bash -c "ps -T -p 1 |grep MultiStage"
      1     292 ?        00:00:00 MultiStageCopro
      1     293 ?        00:00:00 MultiStageCopro
      1     294 ?        00:00:00 MultiStageCopro
      1     295 ?        00:00:00 MultiStageCopro
      1     296 ?        00:00:00 MultiStageCopro
      1     297 ?        00:00:00 MultiStageCopro

 docker compose exec -it cs1 bash -c "pstree -lspat | grep MultiStage"
  |-{MultiStageCopro},292
  |-{MultiStageCopro},293
  |-{MultiStageCopro},294
  |-{MultiStageCopro},295
  |-{MultiStageCopro},296
  |-{MultiStageCopro},297