Dynamics of Modern Web Scraping: Client Expectations Vs Technical Reality

Keywords:
Web Scraping, Data Extraction, Client Expectations, Automation, Anti-Bot Systems, Technical Challenges

Abstract:
The emergence of the World Wide Web has increased the amount of information that is easily accessible on the Internet. This information could be copied manually or scraped by using automated tools. Web scraping also known as web mining, data extraction, or web harvesting refers to extracting raw data from different websites and converting it into useful information. This information can be used by researchers, business organizations, social scientists, and health care professionals for data analysis, understanding the specific market, finding potential clients, people, or market sentiments, or health care wide spectrum studies. This paper focuses on an overview of the changing dynamics of web scraping, a never-ending marathon of web scraping developers and anti-scraping service providers later this article discusses the lack of understanding among clients who still view web scraping as merely a simple process automation to copy data, overlooks the growing complexities involved in navigating the evolving landscape of AI-driven websites and anti-scraping measures.

CITATION:

IEEE format

Copy to clipboard

U. Khalid, A. Shahid, “Dynamics of Modern Web Scraping: Client Expectations Vs Technical Reality,” in Sinteza 2025 - International Scientific Conference on Information Technology, Computer Science, and Data Science, Belgrade, Singidunum University, Serbia, 2025, pp. 158-163. doi:10.15308/Sinteza-2025-158-163

APA format

Copy to clipboard

Khalid, U., Shahid, A. (2025). Dynamics of Modern Web Scraping: Client Expectations Vs Technical Reality. Paper presented at Sinteza 2025 - International Scientific Conference on Information Technology, Computer Science, and Data Science. doi:10.15308/Sinteza-2025-158-163

BibTeX format
Download

RefWorks Tagged format
Download