Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology

Hugo Vega-Huerta; Ronald Cardeña-Ccahuata; Percy De La Cruz Velez de Villa; Ernesto Cancho-Rodriguez; Gisella Luisa Elena Maquen-Niño

doi:10.1007/978-3-031-66961-3_52

Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology

Hugo Vega-Huerta, Ronald Cardeña-Ccahuata, Percy De La Cruz Velez de Villa, Ernesto Cancho-Rodriguez, Gisella Luisa Elena Maquen-Niño

Ingeniería en Computación e Informática

Producción científica: Capítulo del libro/informe/acta de congreso › Contribución a la conferencia › revisión exhaustiva

Resumen

The Digital Platform of the Peruvian State is mainly composed of seven websites. To obtain complete information about a citizen, information must be extracted from each website and integrated manually, which can take more than 3 min. The objective is to centralize the public information coming from the seven websites through a single web platform by applying web scraping. The methodology to implement the web scraping technique, the Selenium tool was used to simulate the information query process by a user entering an ID number, and the web platform was developed based on the Scrum methodology divided into three Sprints. As a result, users can visualize with a simple query the public information of a citizen stored and available on different websites, and the average time of information search of the citizen was reduced from 136 to 24 s. In conclusion, it can be affirmed that the use of web scraping can extract from different governmental websites the information of a citizen with a simple query in a fast and complete way.

Idioma original	Inglés
Título de la publicación alojada	Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology
Editores	Yuzo Iano, Rangel Arthur, Osamu Saotome, Guillermo Leopoldo Kemper Vásquez, Maria Thereza de Moraes Gomes Rosa, Gabriel Gomes de Oliveira
Editorial	Springer Science and Business Media Deutschland GmbH
Páginas	558-567
Número de páginas	10
ISBN (versión impresa)	9783031669606
DOI	https://doi.org/10.1007/978-3-031-66961-3_52
Estado	Publicada - 2024
Evento	9th Brazilian Technology Symposium on Emerging Trends and Challenges in Technology, BTSym 2023 - Campinas, Brasil Duración: 24 oct. 2023 → 26 oct. 2023

Serie de la publicación

Nombre	Smart Innovation, Systems and Technologies
Volumen	402 SIST
ISSN (versión impresa)	2190-3018
ISSN (versión digital)	2190-3026

Conferencia

Conferencia	9th Brazilian Technology Symposium on Emerging Trends and Challenges in Technology, BTSym 2023
País/Territorio	Brasil
Ciudad	Campinas
Período	24/10/23 → 26/10/23

Nota bibliográfica

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

Acceder al documento

10.1007/978-3-031-66961-3_52

Otros archivos y enlaces

Enlace a la publicación en Scopus

Citar esto

Vega-Huerta, H., Cardeña-Ccahuata, R., Villa, P. D. L. C. V. D., Cancho-Rodriguez, E., & Maquen-Niño, G. L. E. (2024). Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology. En Y. Iano, R. Arthur, O. Saotome, G. L. Kemper Vásquez, M. T. de Moraes Gomes Rosa, & G. Gomes de Oliveira (Eds.), Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology (pp. 558-567). (Smart Innovation, Systems and Technologies; Vol. 402 SIST). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-66961-3_52

Vega-Huerta, Hugo ; Cardeña-Ccahuata, Ronald ; Villa, Percy De La Cruz Velez de et al. / Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology. Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology. editor / Yuzo Iano ; Rangel Arthur ; Osamu Saotome ; Guillermo Leopoldo Kemper Vásquez ; Maria Thereza de Moraes Gomes Rosa ; Gabriel Gomes de Oliveira. Springer Science and Business Media Deutschland GmbH, 2024. pp. 558-567 (Smart Innovation, Systems and Technologies).

@inproceedings{b8060c7284f144668c36a4f2f6ec2408,

title = "Integration of the Peruvian Citizen{\textquoteright}s Public Information by Applying Web Scraping Under SCRUM Methodology",

abstract = "The Digital Platform of the Peruvian State is mainly composed of seven websites. To obtain complete information about a citizen, information must be extracted from each website and integrated manually, which can take more than 3 min. The objective is to centralize the public information coming from the seven websites through a single web platform by applying web scraping. The methodology to implement the web scraping technique, the Selenium tool was used to simulate the information query process by a user entering an ID number, and the web platform was developed based on the Scrum methodology divided into three Sprints. As a result, users can visualize with a simple query the public information of a citizen stored and available on different websites, and the average time of information search of the citizen was reduced from 136 to 24 s. In conclusion, it can be affirmed that the use of web scraping can extract from different governmental websites the information of a citizen with a simple query in a fast and complete way.",

keywords = "Government websites, Information integration, Selenium, Tesseract, Web scraping",

author = "Hugo Vega-Huerta and Ronald Carde{\~n}a-Ccahuata and Villa, {Percy De La Cruz Velez de} and Ernesto Cancho-Rodriguez and Maquen-Ni{\~n}o, {Gisella Luisa Elena}",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.; 9th Brazilian Technology Symposium on Emerging Trends and Challenges in Technology, BTSym 2023 ; Conference date: 24-10-2023 Through 26-10-2023",

year = "2024",

doi = "10.1007/978-3-031-66961-3_52",

language = "English",

isbn = "9783031669606",

series = "Smart Innovation, Systems and Technologies",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "558--567",

editor = "Yuzo Iano and Rangel Arthur and Osamu Saotome and {Kemper V{\'a}squez}, {Guillermo Leopoldo} and {de Moraes Gomes Rosa}, {Maria Thereza} and {Gomes de Oliveira}, Gabriel",

booktitle = "Proceedings of the 9th Brazilian Technology Symposium (BTSym{\textquoteright}23) - Emerging Trends and Challenges in Technology",

}

Vega-Huerta, H, Cardeña-Ccahuata, R, Villa, PDLCVD, Cancho-Rodriguez, E & Maquen-Niño, GLE 2024, Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology. En Y Iano, R Arthur, O Saotome, GL Kemper Vásquez, MT de Moraes Gomes Rosa & G Gomes de Oliveira (eds.), Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology. Smart Innovation, Systems and Technologies, vol. 402 SIST, Springer Science and Business Media Deutschland GmbH, pp. 558-567, 9th Brazilian Technology Symposium on Emerging Trends and Challenges in Technology, BTSym 2023, Campinas, Brasil, 24/10/23. https://doi.org/10.1007/978-3-031-66961-3_52

Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology. / Vega-Huerta, Hugo; Cardeña-Ccahuata, Ronald; Villa, Percy De La Cruz Velez de et al.
Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology. ed. / Yuzo Iano; Rangel Arthur; Osamu Saotome; Guillermo Leopoldo Kemper Vásquez; Maria Thereza de Moraes Gomes Rosa; Gabriel Gomes de Oliveira. Springer Science and Business Media Deutschland GmbH, 2024. p. 558-567 (Smart Innovation, Systems and Technologies; Vol. 402 SIST).

Producción científica: Capítulo del libro/informe/acta de congreso › Contribución a la conferencia › revisión exhaustiva

TY - GEN

T1 - Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology

AU - Vega-Huerta, Hugo

AU - Cardeña-Ccahuata, Ronald

AU - Villa, Percy De La Cruz Velez de

AU - Cancho-Rodriguez, Ernesto

AU - Maquen-Niño, Gisella Luisa Elena

N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

PY - 2024

Y1 - 2024

N2 - The Digital Platform of the Peruvian State is mainly composed of seven websites. To obtain complete information about a citizen, information must be extracted from each website and integrated manually, which can take more than 3 min. The objective is to centralize the public information coming from the seven websites through a single web platform by applying web scraping. The methodology to implement the web scraping technique, the Selenium tool was used to simulate the information query process by a user entering an ID number, and the web platform was developed based on the Scrum methodology divided into three Sprints. As a result, users can visualize with a simple query the public information of a citizen stored and available on different websites, and the average time of information search of the citizen was reduced from 136 to 24 s. In conclusion, it can be affirmed that the use of web scraping can extract from different governmental websites the information of a citizen with a simple query in a fast and complete way.

AB - The Digital Platform of the Peruvian State is mainly composed of seven websites. To obtain complete information about a citizen, information must be extracted from each website and integrated manually, which can take more than 3 min. The objective is to centralize the public information coming from the seven websites through a single web platform by applying web scraping. The methodology to implement the web scraping technique, the Selenium tool was used to simulate the information query process by a user entering an ID number, and the web platform was developed based on the Scrum methodology divided into three Sprints. As a result, users can visualize with a simple query the public information of a citizen stored and available on different websites, and the average time of information search of the citizen was reduced from 136 to 24 s. In conclusion, it can be affirmed that the use of web scraping can extract from different governmental websites the information of a citizen with a simple query in a fast and complete way.

KW - Government websites

KW - Information integration

KW - Selenium

KW - Tesseract

KW - Web scraping

UR - http://www.scopus.com/inward/record.url?scp=85202613146&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-66961-3_52

DO - 10.1007/978-3-031-66961-3_52

M3 - Conference contribution

AN - SCOPUS:85202613146

SN - 9783031669606

T3 - Smart Innovation, Systems and Technologies

SP - 558

EP - 567

BT - Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology

A2 - Iano, Yuzo

A2 - Arthur, Rangel

A2 - Saotome, Osamu

A2 - Kemper Vásquez, Guillermo Leopoldo

A2 - de Moraes Gomes Rosa, Maria Thereza

A2 - Gomes de Oliveira, Gabriel

PB - Springer Science and Business Media Deutschland GmbH

T2 - 9th Brazilian Technology Symposium on Emerging Trends and Challenges in Technology, BTSym 2023

Y2 - 24 October 2023 through 26 October 2023

ER -

Vega-Huerta H, Cardeña-Ccahuata R, Villa PDLCVD, Cancho-Rodriguez E, Maquen-Niño GLE. Integration of the Peruvian Citizen’s Public Information by Applying Web Scraping Under SCRUM Methodology. En Iano Y, Arthur R, Saotome O, Kemper Vásquez GL, de Moraes Gomes Rosa MT, Gomes de Oliveira G, editores, Proceedings of the 9th Brazilian Technology Symposium (BTSym’23) - Emerging Trends and Challenges in Technology. Springer Science and Business Media Deutschland GmbH. 2024. p. 558-567. (Smart Innovation, Systems and Technologies). doi: 10.1007/978-3-031-66961-3_52