Support for additional hardware configurations and newer models in Hisim simulation

[CarelTian]

Hi,

I've been using HiSim for LLM inference performance simulation, and I noticed that it currently seems to support only the H20 accelerator. Are there plans to add support for defining models or hardware configurations through a dictionary or configuration file?

regards.

[CarelTian]

Well, I found that the config directory is at tair-kvcache/hisim/src/hisim/spec

[littlefatfat]

Thanks for your interest in HiSim.

HiSim is not limited to H20 support. We used H20 simply as an example to demonstrate how to use the simulator, while also providing relatively accurate performance estimates.

In the current open-source version, HiSim uses AIConfigurator (AIC) as the backend time predictor. As a result, HiSim can simulate the hardware platforms and models supported by AIC. If you would like to simulate additional hardware or models, you can profile your own datasets by following the AIC documentation, and then modify the configuration by referring to the example config provided in the README.

We are continuously improving the generalization capability of HiSim, and we plan to deliver more accurate simulation results for a broader range of models and hardware platforms in future updates.