Multithread ideascube on catalog processing
Created by: swbsf
Process of installing ZIM, basically unzipping, is a long process . CPU is the bottleneck, as all HDD are now SSD. Performance could be greatly improved by multi-threading this operation.
# iotop -o -P -b
Total DISK READ : 26.06 M/s | Total DISK WRITE : 26.56 M/s
Actual DISK READ: 26.06 M/s | Actual DISK WRITE: 0.00 B/s
PID PRIO USER **DISK READ DISK WRITE** SWAPIN IO COMMAND
25003 be/4 ideascub **26.06 M/s 26.56 M/s** 0.00 % 0.00 % python /usr/share/python/ideascube/bin/django-admin catalog install gutenberg.en
`
`Tasks: 190 total, 3 running, 187 sleeping, 0 stopped, 0 zombie
%Cpu(s): 3.0 us, 1.1 sy, 0.0 ni, **95.1 id**, 0.6 wa, 0.0 hi, 0.1 si, 0.0 st
KiB Mem: 4041324 total, 3927496 used, 113828 free, 183016 buffers
KiB Swap: 8350716 total, 0 used, 8350716 free. 3064320 cached Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
25003 ideascu+ 20 0 137780 51396 12144 R **95.6** 1.3 35:08.96 **django-admin**
22160 root 20 0 183068 50156 8408 R 11.9 1.2 4:07.84 ansible-playb+