主题爬虫URL分析模型与高度技术研究.pdf

主题爬虫URL分析模型与调度技术研究 II l, 1奠—皇—_|__—_i—l_宣置i曩 Abstract the ontheInternet withthefast of Amountofinformation along development surges toFmdtheinformationneed isall forusers Intemet．It problem they quickly, important to userstofind inthe ofwhichsearch isinvented and round，because engine help accurately theinformationresource interestedin．Buttraditional search they[fie all-purposeengine resourcebecauseof rate andoftenreturnsresult wastes pursuinghighcoverageblindly query unrelatedweb totheusers．Tosolvethese search engine including pages problems,vertical asthetimes collectstheweb relatedtothe inwhich emerges require，whichonly pages topics theusersareinterested．Focusedcrawleran intheverticalsearch playsimportantpart engine andtakes of whetheraweb isrelatedtothe andconcrete chargeanalyzing page topic process of web gettingpages． are inthefocusedcrawlerfield：howto whethera Theretwo judge importantproblems tothe and schedule atthesetwo web tobe isrelat