Pretrained Language Model AutoTinyBERT: Automatic Hyper-param | Data Science by ODS.ai 🦜

Pretrained Language Model

AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models

Github: https://github.com/huawei-noah/Pretrained-Language-Model

Paper: https://arxiv.org/abs/2107.13686v1

AutoTinyBERT: https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/AutoTinyBERT

@ai_machinelearning_big_data