Discovering New Trends in Web Robot Traffic through Functional Classification

Derek Doran; Swapna S. Gokhale

doi:10.1109/NCA.2008.47

Discovering New Trends in Web Robot Traffic through Functional Classification

Derek Doran, Swapna S. Gokhale

Wright State University

Research output: Contribution to conference › Presentation

Abstract

This paper proposes a novel functional classification scheme to understand and analyze web robot traffic. The scheme is rooted in the recognition that the crawling behavior of a robot on a site is primarily governed by its intended purpose or functionality. We apply the classification rules to analyze web server access logs from the University of Connecticut School of Engineering domain. The analysis results indicate how the classification scheme can provide insights into the robot traffic based on their functionality.

Original language	American English
DOIs	https://doi.org/10.1109/NCA.2008.47
State	Published - Jul 1 2008
Event	Proceedings of the Seventh IEEE International Symposium on Network Computing and Applications - Duration: Jul 1 2008 → …

Conference

Conference	Proceedings of the Seventh IEEE International Symposium on Network Computing and Applications
Period	7/1/08 → …

Disciplines

Computer Sciences
Engineering

Access to Document

10.1109/NCA.2008.47License: Unspecified

Cite this

@conference{158b51eb4cbd4146aa15ce84b6e1c0ee,

title = "Discovering New Trends in Web Robot Traffic through Functional Classification",

abstract = " This paper proposes a novel functional classification scheme to understand and analyze web robot traffic. The scheme is rooted in the recognition that the crawling behavior of a robot on a site is primarily governed by its intended purpose or functionality. We apply the classification rules to analyze web server access logs from the University of Connecticut School of Engineering domain. The analysis results indicate how the classification scheme can provide insights into the robot traffic based on their functionality.",

author = "Derek Doran and Gokhale, {Swapna S.}",

year = "2008",

month = jul,

day = "1",

doi = "10.1109/NCA.2008.47",

language = "American English",

note = "Proceedings of the Seventh IEEE International Symposium on Network Computing and Applications ; Conference date: 01-07-2008",

}

TY - CONF

T1 - Discovering New Trends in Web Robot Traffic through Functional Classification

AU - Doran, Derek

AU - Gokhale, Swapna S.

PY - 2008/7/1

Y1 - 2008/7/1

N2 - This paper proposes a novel functional classification scheme to understand and analyze web robot traffic. The scheme is rooted in the recognition that the crawling behavior of a robot on a site is primarily governed by its intended purpose or functionality. We apply the classification rules to analyze web server access logs from the University of Connecticut School of Engineering domain. The analysis results indicate how the classification scheme can provide insights into the robot traffic based on their functionality.

AB - This paper proposes a novel functional classification scheme to understand and analyze web robot traffic. The scheme is rooted in the recognition that the crawling behavior of a robot on a site is primarily governed by its intended purpose or functionality. We apply the classification rules to analyze web server access logs from the University of Connecticut School of Engineering domain. The analysis results indicate how the classification scheme can provide insights into the robot traffic based on their functionality.

UR - https://corescholar.libraries.wright.edu/cse/257

U2 - 10.1109/NCA.2008.47

DO - 10.1109/NCA.2008.47

M3 - Presentation

T2 - Proceedings of the Seventh IEEE International Symposium on Network Computing and Applications

Y2 - 1 July 2008

ER -

Discovering New Trends in Web Robot Traffic through Functional Classification

Abstract

Conference

Disciplines

Access to Document

Other files and links

Cite this