Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology

Hugo Vega-Huerta; Ronald Cardeña-Ccahuata; Percy De La Cruz Velez de Villa; Ernesto Cancho-Rodriguez; Gisella Luisa Elena Maquen-Niño

doi:10.1007/978-3-031-66961-3_52

Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology

Hugo Vega-Huerta, Ronald Cardeña-Ccahuata, Percy De La Cruz Velez de Villa, Ernesto Cancho-Rodriguez, Gisella Luisa Elena Maquen-Niño

Computer and Informatics Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

The Digital Platform of the Peruvian State is mainly composed of seven websites. To obtain complete information about a citizen, information must be extracted from each website and integrated manually, which can take more than 3 min. The objective is to centralize the public information coming from the seven websites through a single web platform by applying web scraping. The methodology to implement the web scraping technique, the Selenium tool was used to simulate the information query process by a user entering an ID number, and the web platform was developed based on the Scrum methodology divided into three Sprints. As a result, users can visualize with a simple query the public information of a citizen stored and available on different websites, and the average time of information search of the citizen was reduced from 136 to 24 s. In conclusion, it can be affirmed that the use of web scraping can extract from different governmental websites the information of a citizen with a simple query in a fast and complete way.

Original language	English
Title of host publication	Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology
Editors	Yuzo Iano, Rangel Arthur, Osamu Saotome, Guillermo Leopoldo Kemper Vásquez, Maria Thereza de Moraes Gomes Rosa, Gabriel Gomes de Oliveira
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	558-567
Number of pages	10
ISBN (Print)	9783031669606
DOIs	https://doi.org/10.1007/978-3-031-66961-3_52
State	Published - 2024
Event	9th Brazilian Technology Symposium on Emerging Trends and Challenges in Technology, BTSym 2023 - Campinas, Brazil Duration: 24 Oct 2023 → 26 Oct 2023

Publication series

Name	Smart Innovation, Systems and Technologies
Volume	402 SIST
ISSN (Print)	2190-3018
ISSN (Electronic)	2190-3026

Conference

Conference	9th Brazilian Technology Symposium on Emerging Trends and Challenges in Technology, BTSym 2023
Country/Territory	Brazil
City	Campinas
Period	24/10/23 → 26/10/23

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

Keywords

Government websites
Information integration
Selenium
Tesseract
Web scraping

Access to Document

10.1007/978-3-031-66961-3_52

Cite this

Vega-Huerta, H., Cardeña-Ccahuata, R., Villa, P. D. L. C. V. D., Cancho-Rodriguez, E., & Maquen-Niño, G. L. E. (2024). Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology. In Y. Iano, R. Arthur, O. Saotome, G. L. Kemper Vásquez, M. T. de Moraes Gomes Rosa, & G. Gomes de Oliveira (Eds.), Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology (pp. 558-567). (Smart Innovation, Systems and Technologies; Vol. 402 SIST). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-66961-3_52

Vega-Huerta, Hugo ; Cardeña-Ccahuata, Ronald ; Villa, Percy De La Cruz Velez de et al. / Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology. Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology. editor / Yuzo Iano ; Rangel Arthur ; Osamu Saotome ; Guillermo Leopoldo Kemper Vásquez ; Maria Thereza de Moraes Gomes Rosa ; Gabriel Gomes de Oliveira. Springer Science and Business Media Deutschland GmbH, 2024. pp. 558-567 (Smart Innovation, Systems and Technologies).

@inproceedings{b8060c7284f144668c36a4f2f6ec2408,

title = "Integration of the Peruvian Citizen{\textquoteright}s Public Information by Applying Web Scraping Under SCRUM Methodology",

abstract = "The Digital Platform of the Peruvian State is mainly composed of seven websites. To obtain complete information about a citizen, information must be extracted from each website and integrated manually, which can take more than 3 min. The objective is to centralize the public information coming from the seven websites through a single web platform by applying web scraping. The methodology to implement the web scraping technique, the Selenium tool was used to simulate the information query process by a user entering an ID number, and the web platform was developed based on the Scrum methodology divided into three Sprints. As a result, users can visualize with a simple query the public information of a citizen stored and available on different websites, and the average time of information search of the citizen was reduced from 136 to 24 s. In conclusion, it can be affirmed that the use of web scraping can extract from different governmental websites the information of a citizen with a simple query in a fast and complete way.",

keywords = "Government websites, Information integration, Selenium, Tesseract, Web scraping",

author = "Hugo Vega-Huerta and Ronald Carde{\~n}a-Ccahuata and Villa, {Percy De La Cruz Velez de} and Ernesto Cancho-Rodriguez and Maquen-Ni{\~n}o, {Gisella Luisa Elena}",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.; 9th Brazilian Technology Symposium on Emerging Trends and Challenges in Technology, BTSym 2023 ; Conference date: 24-10-2023 Through 26-10-2023",

year = "2024",

doi = "10.1007/978-3-031-66961-3_52",

language = "English",

isbn = "9783031669606",

series = "Smart Innovation, Systems and Technologies",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "558--567",

editor = "Yuzo Iano and Rangel Arthur and Osamu Saotome and {Kemper V{\'a}squez}, {Guillermo Leopoldo} and {de Moraes Gomes Rosa}, {Maria Thereza} and {Gomes de Oliveira}, Gabriel",

booktitle = "Proceedings of the 9th Brazilian Technology Symposium (BTSym{\textquoteright}23) - Emerging Trends and Challenges in Technology",

}

Vega-Huerta, H, Cardeña-Ccahuata, R, Villa, PDLCVD, Cancho-Rodriguez, E & Maquen-Niño, GLE 2024, Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology. in Y Iano, R Arthur, O Saotome, GL Kemper Vásquez, MT de Moraes Gomes Rosa & G Gomes de Oliveira (eds), Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology. Smart Innovation, Systems and Technologies, vol. 402 SIST, Springer Science and Business Media Deutschland GmbH, pp. 558-567, 9th Brazilian Technology Symposium on Emerging Trends and Challenges in Technology, BTSym 2023, Campinas, Brazil, 24/10/23. https://doi.org/10.1007/978-3-031-66961-3_52

Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology. / Vega-Huerta, Hugo; Cardeña-Ccahuata, Ronald; Villa, Percy De La Cruz Velez de et al.
Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology. ed. / Yuzo Iano; Rangel Arthur; Osamu Saotome; Guillermo Leopoldo Kemper Vásquez; Maria Thereza de Moraes Gomes Rosa; Gabriel Gomes de Oliveira. Springer Science and Business Media Deutschland GmbH, 2024. p. 558-567 (Smart Innovation, Systems and Technologies; Vol. 402 SIST).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology

AU - Vega-Huerta, Hugo

AU - Cardeña-Ccahuata, Ronald

AU - Villa, Percy De La Cruz Velez de

AU - Cancho-Rodriguez, Ernesto

AU - Maquen-Niño, Gisella Luisa Elena

N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

PY - 2024

Y1 - 2024

N2 - The Digital Platform of the Peruvian State is mainly composed of seven websites. To obtain complete information about a citizen, information must be extracted from each website and integrated manually, which can take more than 3 min. The objective is to centralize the public information coming from the seven websites through a single web platform by applying web scraping. The methodology to implement the web scraping technique, the Selenium tool was used to simulate the information query process by a user entering an ID number, and the web platform was developed based on the Scrum methodology divided into three Sprints. As a result, users can visualize with a simple query the public information of a citizen stored and available on different websites, and the average time of information search of the citizen was reduced from 136 to 24 s. In conclusion, it can be affirmed that the use of web scraping can extract from different governmental websites the information of a citizen with a simple query in a fast and complete way.

AB - The Digital Platform of the Peruvian State is mainly composed of seven websites. To obtain complete information about a citizen, information must be extracted from each website and integrated manually, which can take more than 3 min. The objective is to centralize the public information coming from the seven websites through a single web platform by applying web scraping. The methodology to implement the web scraping technique, the Selenium tool was used to simulate the information query process by a user entering an ID number, and the web platform was developed based on the Scrum methodology divided into three Sprints. As a result, users can visualize with a simple query the public information of a citizen stored and available on different websites, and the average time of information search of the citizen was reduced from 136 to 24 s. In conclusion, it can be affirmed that the use of web scraping can extract from different governmental websites the information of a citizen with a simple query in a fast and complete way.

KW - Government websites

KW - Information integration

KW - Selenium

KW - Tesseract

KW - Web scraping

UR - http://www.scopus.com/inward/record.url?scp=85202613146&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-66961-3_52

DO - 10.1007/978-3-031-66961-3_52

M3 - Conference contribution

AN - SCOPUS:85202613146

SN - 9783031669606

T3 - Smart Innovation, Systems and Technologies

SP - 558

EP - 567

BT - Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology

A2 - Iano, Yuzo

A2 - Arthur, Rangel

A2 - Saotome, Osamu

A2 - Kemper Vásquez, Guillermo Leopoldo

A2 - de Moraes Gomes Rosa, Maria Thereza

A2 - Gomes de Oliveira, Gabriel

PB - Springer Science and Business Media Deutschland GmbH

T2 - 9th Brazilian Technology Symposium on Emerging Trends and Challenges in Technology, BTSym 2023

Y2 - 24 October 2023 through 26 October 2023

ER -

Vega-Huerta H, Cardeña-Ccahuata R, Villa PDLCVD, Cancho-Rodriguez E, Maquen-Niño GLE. Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology. In Iano Y, Arthur R, Saotome O, Kemper Vásquez GL, de Moraes Gomes Rosa MT, Gomes de Oliveira G, editors, Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology. Springer Science and Business Media Deutschland GmbH. 2024. p. 558-567. (Smart Innovation, Systems and Technologies). doi: 10.1007/978-3-031-66961-3_52