All issues

Search results

I have a question regarding the VRAM requirements for fine-tuning a 7B model.

Status: Open.

#322 In tatsu-lab/stanford_alpaca;

· mangyeong opened on Jan 15, 2025

why dose my finetuned model repeat the given prompt before generating its response

Status: Open.

#320 In tatsu-lab/stanford_alpaca;

· starrlee356 opened on Dec 5, 2024

ValueError: Trying to set a tensor of shape torch.Size([32769536]) in "weight" (which has shape torch.Size([32001, 4096])), this looks incorrect.

Status: Open.

#319 In tatsu-lab/stanford_alpaca;

· daidaiershidi opened on Sep 26, 2024

SFT Mistral；

Status: Open.

#317 In tatsu-lab/stanford_alpaca;

· feiying12343 opened on Jun 6, 2024

RuntimeError: The size of tensor a (65539072) must match the size of tensor b (262156288) at non-singleton dimension 0

Status: Open.

#316 In tatsu-lab/stanford_alpaca;

· YuyangJ0 opened on Apr 16, 2024

Tensors of the same index must be on the same device and the same dtype except step tensors that can be CPU and float32 notwithstanding

Status: Open.

#315 In tatsu-lab/stanford_alpaca;

· wurevvc opened on Mar 18, 2024

train.py fails with TypeError: Object of type Tensor is not JSON serializable

Status: Open.

#314 In tatsu-lab/stanford_alpaca;

· khayamgondal opened on Mar 8, 2024

Keyword arguments {'add_special_tokens': False} not recognized.

Status: Open.

#313 In tatsu-lab/stanford_alpaca;

· cswangxiaowei opened on Mar 2, 2024

Cuda OOM during training

Status: Open.

#308 In tatsu-lab/stanford_alpaca;

· hychaochao opened on Jan 31, 2024

The arugment order of Rouge score might be wrong.

Status: Open.

#307 In tatsu-lab/stanford_alpaca;

· zhaowei-wang-nlp opened on Dec 28, 2023

NotImplementedError: offload_to_cpu=True and NO_SHARD is not supported yet

Status: Open.

#306 In tatsu-lab/stanford_alpaca;

· mechigonft opened on Nov 28, 2023

weight_diff.py state_dict_recovered[key].add_(state_dict_raw[key]) RuntimeError: The size of tensor a (32001) must match the size of tensor b (32000) at non-singleton dimension 0

Status: Open.

#304 In tatsu-lab/stanford_alpaca;

· gaodexiaozheng opened on Nov 22, 2023