FIELD: information technology.
SUBSTANCE: invention relates to means of planning Web-crawlers in accordance with keyword search. This result is achieved by applying a method that includes steps of: the scheduling party receives a task request command, sent by the traversal node, gets the secondary download link from the priority memory segment, generates tasks, adds tasks to the job list, receives the addresses of the keywords links from the dynamic memory segment, displays the derived links addresses of the number of pages corresponding to the addresses of the keywords links, generates job page amounts in accordance with the derived links addresses of the number of pages, adds jobs of page amounts to the job list, receives the address of the keyword reference from the base memory segment, generates tasks, adds the generated tasks to the job list, and returns a list of jobs to the crawling node.
EFFECT: technical result consists in expanding the arsenal of planning tools for web-crawlers in accordance with keyword search.
16 cl, 5 dwg
| Title | Year | Author | Number |
|---|---|---|---|
| SERVICE PACKAGE INQUIRIES LIMITATION METHOD AND DEVICE | 2016 |
|
RU2678643C1 |
| SYSTEM AND METHOD FOR ACCESS REQUEST LIMITS | 2016 |
|
RU2666289C1 |
| METHOD AND DEVICE FOR NETWORK DATA DISPLAYING | 2015 |
|
RU2679729C2 |
| METHOD AND DEVICE FOR COMPARING SIMILAR ELEMENTS OF HIGH-DIMENSIONAL IMAGE FEATURES | 2016 |
|
RU2686590C1 |
| METHOD AND SYSTEM FOR INCREASING PAGE LOADING SPEED | 2016 |
|
RU2691838C2 |
| METHOD AND DEVICE FOR DISPLAYING INTERFACE | 2018 |
|
RU2754720C1 |
| METHOD AND LOADING SYSTEM OF WEB PAGES | 2015 |
|
RU2668734C1 |
| METHOD AND DEVICE FOR STORAGE OF DATA WITH HIGH LEVEL OF MULTITHREADING | 2016 |
|
RU2666245C1 |
| SIMILARITY DETECTION METHOD AND DEVICE | 2017 |
|
RU2700191C1 |
| METHOD AND DEVICE FOR FAST ORDER PROCESSING | 2018 |
|
RU2753450C1 |
