Search Results

    ArticlesSee all articles results »

    From journals and magazines

    1. Exploring Dark Web Crawlers: A systematic literature review of dark web crawlers (...)

      by Bergman, Jesper and Popov, Oliver B.

      Ieee Access, Volume 11, p. 1

      Journal Article : Full Text Online

    2. TS-Finder: privacy enhanced web crawler detection model using temporal–spatial access (...)

      by Chen, Rui; Fan, Pengcheng and Zhao, Jing

      The Journal Of Supercomputing, Volume 80, Issue 12, pp. 17400 - 17422

      Journal Article : Full Text Online

    3. Research on college students’ psychological crisis intervention based on web crawler (...)

      by Wang, Longzong; Lai, Lianfeng and Liang, Fu

      Journal Of Computational Methods In Sciences And Engineering, Volume 23, Issue 3, pp. 1439 - 1450

      Journal Article : Full Text Online

    See all 3,734 Articles results

    Back to results navigation

    Books & MediaSee all books & media results »

    Books, music, movies and more

    1. Getting structured data from the internet : running web crawlers/scrapers on a Big Data (...)

      Jay M. Patel.

      Book : View Online

    2. Python web scraping : fetching data from the web

      Katharine Jarmul, Richard Lawson.

      Book : View Online

    3. Web Searching and Mining

      edited by Debajyoti Mukhopadhyay.

      Book : View Online

    See all 100 Books & Media results

    Back to results navigation


    Our WebsiteSee all website results »

    Guides, policies, news more

    1. Sometimes You Feel Like a Nutch: The Un-Googlification of a Library Search Service - Bitstreams: The

      Apache Nutch is open source web crawler software written in Java. It’s been around for nearly 20 years–almost as long as Google.

    2. New Framework for Search Results Page - Duke University Libraries Blogs

      We have switched to a website search based on two open source tools, Nutch (a web crawler) and Solr (a search platform). Using (...)

    3. Archiving Social Media about Duke Activism - The Devil's Tale

      We used three tools to primarily collect web materials, each with its own strengths. The Rubenstein Library subscribes to the Internet (...)

    See all 7 website results

    Back to results navigation


    Manuscript Collections

    Find books, manuscripts, and archive materials from Rubenstein Library


    Collection Guides

    Detailed inventories of archival collections

    No Collection Guides results found for Web crawler

    Try another search »

    Try another search »

    Archival Materials

    Manuscripts and archival materials

    No Archival Materials results found for Web crawler

    Try another search »

    Try another search »


    Some materials and descriptions may include offensive content. More info

    More Search Options