The system for collecting, processing and promptly providing macroeconomic data on Moscow, Russia and other Russian regions.
Problems were: 1. Time costs for data collection and processing from multiple data sources (Rosstat, EMISS, The Central Bank of Russian Federation, etc.) 2. Outdated information due to insufficiently prompt updating of certain data sources (e.g. data on EMISS are not always up-to-date). 3. Inability to obtain statistical information from certain sources: • Rosstat data showcase - loss of data, long time for updating, problems with connection to the service; • EMISS - long waiting time for loading, periodically some indicators are blocked for a long time for updating. 4. The need to promptly obtain up-to-date statistical information on the regional economy. For this purpose, the management made enquiries to analysts, which could take considerable time. Solution: Moscow Department for Economic policy and Development created the SQL database, including more than 35 detailed key indicators of economic development of Moscow, Russia and other Russian regions. The database is formed from multiple sources: The Central Bank of Russian Federation, EMISS, Rosstat. − As of 14.08.2024, the total volume of the database is about 27.7 million records, and it is constantly growing by parsing new data. − Statistical data is collected and updated automatically. − Computer vision technologies are used for processing of some statistical documents (in particular in PDF format) to recognize statistical tables and to retrieve the data stored in them. Moscow Department for Economic policy and Development created the system of automatic receipt of operational data on request (Telegram-bot) “DEPR – statistics” for 16 most frequently used indicators. This system was created on the basis of the SQL database.
Artificial Intelligence And Digital Services
Big data storage and analysis
The project is open-ended. It requires periodic maintenance due to human factors on the part of data sources (e.g. if data upload formats change, Telegram-bot cannot upload it automatically).
Moscow City
1. Preparation of standard analytical reports is now automated with time costs reduced from 3-4 hours to 5 minutes. 2. Telegram-bot was developed for Moscow Department for Economic Policy and Development management for quick search of required data. Any required indicator is shown in just 3 clicks and 5 seconds (instead of manual search taking 10-15 minutes). Three modes of the system's operation were introduced: operational (it includes information on the latest data, as well as a graph of the indicator change dynamics); full (it includes information as of the required date in a certain region); slide prompt (it includes a summary slide with the latest data on several indicators).
N.A.
N.A.
