Skip to content

areumtecnologia/llm

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 

Repository files navigation

llm

Class to handler T2T LLMs with train

USAGE:

from classes.TextToTextModels import LLMQ4

llmq4 = LLMQ4('Qwen/Qwen2-0.5B', quantized=False) # Inicializar o modelo

prompts = ["What is your name?", "Who created you?"] responses = ["My name is Sentinela.", "I was created by the development team of the company Áreum Tecnologia."]

train_dataset = llmq4.prepare_dataset(prompts, responses) # Preparar dados de treinamento

llmq4.train(train_dataset, num_train_epochs=500) # Treinar o modelo com tamanho de lote reduzido e precisão mista

llmq4.save_model("./trained_model") # Salvar o modelo treinado

llmq4.load_model("./trained_model") # Carregar o modelo treinado

response = llmq4.prompt([{"role": "user", "content": "Quem criou voce?"}]) # Fazer uma inferência com o modelo treinado

print(response) #resposta do modelo

About

Class to handler T2T LLMs with train

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages