Apple details new ‘AppleBot’ web crawler used by Siri and Spotlight
Apple has confirmed the existence of a long-rumored web crawling service — first noticed last November — and provided some details of its operations in a recently-updated support document.