Should not be a problem in the EU. Article 3 and 4 of the „ Copyright in the Digital Single Market“ Directive already regulate this. Summary by Wolters Kluwer: […] Everyone else (including commercial ML developers) can only use works that are lawfully accessible and where the rightholders have not explicitly reserved use for text and data mining purposes. AFAIK they are discussing something like a robot.txt to flag s…
> Summary by Wolters Kluwer: […] Everyone else (including commercial ML developers) can only use That is a weird (wishful?) interpretation. Doesn't article 4 give the exception to everybody for the purposes of text and data mining, including commercial ML developers? https://eur-lex.europa.eu/eli/dir/2019/790/oj
> The exception or limitation provided for in paragraph 1 shall apply on condition that the use of works and other subject matter referred to in that paragraph has not been expressly reserved by their rightholders in an appropriate manner, such as machine-readable means in the case of content made publicly available online.