Train experts on a custom dataset

[vietanh125]

Hi,

I want to train several experts on my own QA dataset. How can I extend the code to work with such a custom dataset?

Thank you.

[sordonia]

Hi,

Try to follow the notebook here, mbc_arrow_tutorial

instead of get_datamodule() you can just create your on datamodule (with train_dataloader(), val_dataloader(), etc.) and pass it to the train_model() function?

[vietanh125]

Thank you for your response. I have looked at the code, my plan is

• Implementing CustomDataModule extending DataModule
• Implementing CustomConfig extending DatasetConfig
• Implementing CustomEvaluator extending EMEvaluator (I evaluate based on exact match)

Do you think it's enough? If not, what else should I do? Thank you!