view article Article UltraBERT: One Encoder for Classification and Retrieval dmis-lab • 9 days ago • 61
ModernBERT with Obfuscated Pre-Training Collection ModernBERT pre-trained from scratch on various obfuscated representations of the same 10B tokens. • 11 items • Updated 15 days ago