European Languages Datasets

adontz wrote: post #2

I absolutely do not understand purpose of the folowing https://live.european-language-grid.eu/catalogue/#/resource/... https://live.european-language-grid.eu/catalogue/#/resource/... Since when strict eBNF grammars are useful for natural language processing?

"Finance English" may not be a natural language

Re: European Languages Datasets

#5

Post by gumby » Thu, Nov 12, 2020, 8:08 PM UTC

Though this is an .eu domain, the languages covered are more than just the official EU ones (A quick glance showed entries for Basque (somewhat politically controversial) and Turkish (not part of the EU, though partially in continental Europe).

Re: European Languages Datasets

#6

Post by qayxc » Thu, Nov 12, 2020, 8:47 PM UTC

visarga wrote: post #3

There's also "The Big Bad NLP Database", a much larger resource. https://datasets.quantumstat.com/

I get eye cancer from the date format they use...

Re: European Languages Datasets

#7

Post by maze-le » Thu, Nov 12, 2020, 9:02 PM UTC

gumby wrote: post #5

Though this is an .eu domain, the languages covered are more than just the official EU ones (A quick glance showed entries for Basque (somewhat politically controversial) and Turkish (not part of the EU, though partially in continental Europe).

How is Basque "politically controversial"? It is an official language in the Basque Autonomous Community of Spain. Turkish is also a minority language in Greece. It doesn't have official status, but they have their own government mandated Turkish-language schools.

Re: European Languages Datasets

#8

Post by gumby » Thu, Nov 12, 2020, 9:16 PM UTC

maze-le wrote: post #7

gumby wrote: post #5

Though this is an .eu domain, the languages covered are more than just the official EU ones (A quick glance showed entries for Basque (somewhat politically controversial) and Turkish (not part of the EU, though partially in continental Europe).

How is Basque "politically controversial"? It is an official language in the Basque Autonomous Community of Spain. Turkish is also a minority language in Greece. It doesn't have official status, but they have their own government mandated Turkish-language schools.

I was not aware that Turkish-language schools were in place in Greece. That's great!

Admittedly I don't know the current state of the politics of Basque but when I lived in France its use was not encouraged in the Basque region.

Re: European Languages Datasets

#9

Post by disown » Thu, Nov 12, 2020, 9:21 PM UTC

maze-le wrote: post #7

gumby wrote: post #5

Though this is an .eu domain, the languages covered are more than just the official EU ones (A quick glance showed entries for Basque (somewhat politically controversial) and Turkish (not part of the EU, though partially in continental Europe).

How is Basque "politically controversial"? It is an official language in the Basque Autonomous Community of Spain. Turkish is also a minority language in Greece. It doesn't have official status, but they have their own government mandated Turkish-language schools.

Which brings up an interesting point. What makes a language european? English, French, etc are official languages in many african and asian colonies due to conquest. Does it make french and english asian or african language? Is russian an asian language or a european language?

Re: European Languages Datasets

#10

Post by AnimalMuppet » Thu, Nov 12, 2020, 9:22 PM UTC

gumby wrote: post #8

maze-le wrote: post #7

Earlier quoted context omitted.

How is Basque "politically controversial"? It is an official language in the Basque Autonomous Community of Spain. Turkish is also a minority language in Greece. It doesn't have official status, but they have their own government mandated Turkish-language schools.

I was not aware that Turkish-language schools were in place in Greece. That's great! Admittedly I don't know the current state of the politics of Basque but when I lived in France its use was not encouraged in the Basque region.

For these purposes, I'm not sure that its political status is relevant. It's a language; there are a significant number of people in Europe who speak it. So it belongs on a list of European languages.