Default configuration for training

[FahadEbrahim]

Hi,

Just a quick question, for training an adapter, what are the default adapter configurations (Method or type)?

Thanks.

[calpt]

Hey, the default adapter configuration used when none is explicitly specified is defined in DEFAULT_ADAPTER_CONFIG. It's a bottleneck adapter (BnConfig() class) with one bottleneck layer per Transformer block, as proposed in this paper.

[hSterz]

Hello @FahadEbrahim , the default configuration that is used if you call add_adapterwithout specifying the config parameter is the seq_bn config (previously named pfeifferconfig). To use a different configuration just pass the corresponding string as the config parameter (docs).

[FahadEbrahim]

Thank you both @calpt and @hSterz for your assistance.