The search engine's dilemma: implied licence to crawl and cache?

摘要

A German court rules that web publishers who choose not to use widely available technical protection measures, such as the robot exclusion protocol (robot.txt), grant an implied licence to search engines to crawl and cache for the purpose of indexing content on the internet.