Training budget?

[ifsheldon]

Hi! Thank you very much for the opensource implementation. Can you tell me what is the training budget that one needs to train a LSLM model? Like how many GPU hours did you use? I am a solo developer but I really want to see this live by finetuning existing models into a LSLM.

[sanowl]

Hello @ifsheldon,
Thank you for your interest in my LSLM implementation. To address your question about the training budget and GPU hours:
I appreciate your enthusiasm, but I actually don't have specific information about the training budget or GPU hours used for this model. My repository is an open-source implementation of the LSLM architecture described in the paper, but I haven't trained the model myself.

[kadirnar]

@sanowl Thanks for the code support. I want to train using this library. Have you ever tested the trainer? Does the code work? What should the dataset be like? Can you give some information?

[LemonHX]

+1 @sanowl I am also wondering how does the dataset looks like