Melvin Vivas PRO

wow. that's so fast. what gpu are you using?

Hi, I was trying this in Google Colab and I got a memory issue. How much vram does this need? Sorry just new to this

Is there an easy way to know how much vram is required to train a model from the HF model card?

Thanks

from trl import SFTTrainer
from datasets import load_dataset

trainer = SFTTrainer(
    model="Qwen/Qwen3-0.6B",
    train_dataset=load_dataset("trl-lib/Capybara", split="train"),
)
trainer.train()```

yeah I tried llama.cpp. was curious how to running the model from transformers code. i also tried llama-cpp-python which can do an inference of the model from your own code

what is this flag for? --mmproj

thank you. i agree. since i have my gpu in windows, that took time to setup too. yeah it’s a small model which works locally. trying to do more tests

thank you. what’s the best way to start fine-tuning?

thanks a lot. will check these out!

thank you!

can this be trained with a custom voice?

thanks fr sharing!

thanks, I just thought this is a simple tool everyone might need

been using this! thanks for sharing!