The price statistics team at ESCWA conducted an online national workshop to Jordan for complementing price statistics with big data tools using web scraping.
The price statistics team at ESCWA has been exploring innovative methods to leverage price statistics in the Arab Region by using technology to complement traditional data collection methods. This initiative aims at accelerating data collection frequency, ensuring steady supply of data, while also bringing work efficiency by reducing the burden on physical outlets.
A training workshop on price web scraping from major online outlets was conducted for the Department of Statistics (DOS) - Jordan to train the national team and develop their skills in web scraping to be utilized in conjunction with the traditional data collection process for CPI and ICP purposes.
The training was attended by 9 participants from the Department of Statistics (DOS) - Jordan and focused on:
- Introducing the potential uses, benefits, and the challenges of Big Data and non-traditional data collection methods such as scanner data and web scraping.
- Demonstrating web scraping of price data from national online outlets for various products categories.
- Introducing the participants on coding and writing the web scraping scripts in Python language to maintain the scripts according to the nature of each online outlet.