modernbert-german-134m-ud-embeds

Model Description

This is a ModernBERT model pre-trained with UD_German-HDT for POS-tagging and dependency-parsing, derived from ModernGBERT_134M.

How to Use

from transformers import pipeline
nlp=pipeline("universal-dependencies","KoichiYasuoka/modernbert-german-134m-ud-embeds",trust_remote_code=True)
print(nlp("Im Krankenzimmer sah er krank aus aber wollte gut aussehen"))

Reference

Koichi Yasuoka: Dependency-Parsing upon ModernBERT with Upper Triangular Adjacency Matrix, IPSJ Symposium Series, Vol.2025, No.1 (December 2025), pp.153-158.