A Soft Computing Prefetcher to Mitigate Cache Degradation by Web Robots

Ning Xie, Kyle Brown, Nathan Rude, Derek Doran

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper investigates the feasibility of a resource prefetcher able to predict future requests made by web robots, which are software programs rapidly overtaking human users as the dominant source of web server traffic. Such a prefetcher is a crucial first line of defense for web caches and content management systems that must service many requests while maintaining good performance. Our prefetcher marries a deep recurrent neural network with a Bayesian network to combine prior global data with local data about specific robots. Experiments with traffic logs from web servers across two universities demonstrate improved predictions over a traditional dependency graph approach. Finally, preliminary evaluation of a hypothetical caching system that incorporates our prefetching scheme is discussed.

Original languageEnglish
Title of host publicationAdvances in Neural Networks
EditorsAndrew Leung, Fengyu Cong, Qinglai Wei
PublisherSpringer Verlag
Pages536-546
Number of pages11
Volume10261
ISBN (Electronic)978-3-319-59072-1
ISBN (Print)9783319590714
DOIs
StatePublished - 2017
Externally publishedYes
Event14th International Symposium on Neural Networks, ISNN 2017 - Sapporo, Hakodate, and Muroran, Hokkaido, Japan
Duration: Jun 21 2017Jun 26 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10261 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th International Symposium on Neural Networks, ISNN 2017
Country/TerritoryJapan
CitySapporo, Hakodate, and Muroran, Hokkaido
Period6/21/176/26/17

ASJC Scopus Subject Areas

  • Theoretical Computer Science
  • General Computer Science

Keywords

  • Bayesian model
  • Deep learning
  • LSTM
  • Resource prediction
  • Web caching

Disciplines

  • Bioinformatics
  • Communication
  • Communication Technology and New Media
  • Computer Sciences
  • Databases and Information Systems
  • Life Sciences
  • OS and Networks
  • Physical Sciences and Mathematics
  • Science and Technology Studies
  • Social and Behavioral Sciences

Cite this