Freeze the ViT during the fifth stage training process of LongVILA #267
Description
May I ask if you have ever tried freezing the ViT during the S5 training stage at LongVILA? Would the effect be much worse than not freezing it?
{{ message }}
May I ask if you have ever tried freezing the ViT during the S5 training stage at LongVILA? Would the effect be much worse than not freezing it?