While promising, the marriage of WALS and RoBERTa is not perfect.
: Researchers often map WALS features (like word order or case systems) to specific languages that RoBERTa was pre-trained on. Training Sets wals roberta sets
For two decades, Aris had argued that the sets were a hoax, a mathematical fever dream. But then his colleague, Lena, had sent him a single page of handwritten numbers before vanishing from her locked, third-floor lab. The note read only: “The walrus is me. 7-19-3-88-41.” While promising, the marriage of WALS and RoBERTa
: Whether a language has case marking and how many cases it uses. wals roberta sets