Recoll completely failes to index more than a few files. Than crashes again and again
Hello, my system is Debian 12, Recoll 1.34.3 + Xapian 1.4.22.
After upgrading from Debian 11 where everythin worked okay, now I get constant errors and interruptions of the index. Missing Helpers are: "catdvi (application/x-dvi) lyx (application/x-lyx)" but I think, I don't have those file formats. Sometime all my RAM is being filled until it reaches 99% or so and then recoll quits.
So I'l liste some of the errors form the log:
:4:internfile/internfile.cpp:173::FileInterner::init fn [/media/Daten1/Temp/Gewichtung_Berechnen_Heuristiken-GESAMT-10.ods] mime [(null)] preview 0 :4:internfile/mimehandler.cpp:263::getMimeHandler: mtype [application/vnd.sun.xml.calc] filtertypes 1 :4:internfile/mimehandler.cpp:66::getMimeHandlerFromCache: 7da3eeb0a01b157ff0fcb5f03cb0a171 cache size 59 :4:internfile/mimehandler.cpp:83::getMimeHandlerFromCache: 7da3eeb0a01b157ff0fcb5f03cb0a171 not found :4:internfile/mh_xslt.cpp:158::MimeHandlerXslt: params: xsltproc meta meta.xml opendoc-meta.xsl body content.xml opendoc-body.xsl :4:internfile/internfile.cpp:658::collectIpath..: fbytes->41761938 :2:internfile/internfile.cpp:798::FileInterner::internfile: next_document error [/media/Daten1/projekte/EEE-Potentiale/arbeitskarte-durchschnittl-wind-minima-maxima.pdf] application/pdf :4:internfile/mimehandler.cpp:100::returnMimeHandler: returning filter for application/pdf cache size 59 :4:internfile/internfile.cpp:919::FileInterner::internfile: conversion ended with no doc [...] :4:internfile/internfile.cpp:173::FileInterner::init fn [/media/Daten1/Temp/Gewichtung_Berechnen_Heuristiken-GESAMT-11.ods] mime [(null)] preview 0 :4:internfile/mimehandler.cpp:263::getMimeHandler: mtype [application/vnd.sun.xml.calc] filtertypes 1 :4:internfile/mimehandler.cpp:66::getMimeHandlerFromCache: 7da3eeb0a01b157ff0fcb5f03cb0a171 cache size 60 :4:internfile/mimehandler.cpp:83::getMimeHandlerFromCache: 7da3eeb0a01b157ff0fcb5f03cb0a171 not found :4:internfile/mh_xslt.cpp:158::MimeHandlerXslt: params: xsltproc meta meta.xml opendoc-meta.xsl body content.xml opendoc-body.xsl :4:index/recollindex.cpp:152::Got signal 15, registering stop request
as well as this. In thiscase. My whole memory (32GB installed) was filled until it almost reached 100%
:4:index/fsindexer.cpp:676::processone: needupdate 1 noretry 0 existing 495479 oldsig [] :4:internfile/internfile.cpp:173::FileInterner::init fn [/media/Daten1/datensicherung/USB Speicher/16GB-Verschl-Vera/veracrypt2/Geplante Immigration/GIS und Statistiken/Archiv-Erledigt/Geodaten-BKG/vg250_2019-01-01.utm32s.shape.ebenen/dokumentation/struktur_und_attribute.xls] mime [(null)] preview 0 :4:internfile/mimehandler.cpp:263::getMimeHandler: mtype [application/vnd.ms-excel] filtertypes 1 :4:internfile/mimehandler.cpp:66::getMimeHandlerFromCache: 6bfe6b1de188eff6836029001755ff75 cache size 50 :4:internfile/mimehandler.cpp:79::getMimeHandlerFromCache: 6bfe6b1de188eff6836029001755ff75 found size 49 :4:internfile/internfile.cpp:259::FileInterner:: init ok application/vnd.ms-excel [/media/Daten1/datensicherung/USB Speicher/16GB-Verschl-Vera/veracrypt2/Geplante Immigration/GIS und Statistiken/Archiv-Erledigt/Geodaten-BKG/vg250_2019-01-01.utm32s.shape.ebenen/dokumentation/struktur_und_attribute.xls] :4:internfile/internfile.cpp:805::FileInterner::internfile. ipath [] :4:internfile/mh_execm.cpp:168::MimeHandlerExecMultiple::next_document(): [/media/Daten1/datensicherung/USB Speicher/16GB-Verschl-Vera/veracrypt2/Geplante Immigration/GIS und Statistiken/Archiv-Erledigt/Geodaten-BKG/vg250_2019-01-01.utm32s.shape.ebenen/dokumentation/struktur_und_attribute.xls] :4:rcldb/rcldb.cpp:193::DbUpdWorker: got add/update task, ql 1 :3:rcldb/rcldb.cpp:769::Db::add: docid 3076638 added [/media/Daten1/datensicherung/USB Speicher/16GB-Verschl-Vera/veracrypt2/Geplante Immigration/GIS und Statistiken/Archiv-Erledigt/CoAxXTmCDqlfqVjySw8Wzw] :4:index/recollindex.cpp:152::Got signal 15, registering stop request :3:internfile/mh_execm.cpp:245::MHExecMultiple: interrupt :4:utils/execmd.cpp:284::ExecCmd: pid 294041 killpg(294041, SIGTERM) :4:internfile/internfile.cpp:658::collectIpath..: fbytes->8460288 :2:internfile/internfile.cpp:798::FileInterner::internfile: next_document error [/media/Daten1/datensicherung/USB Speicher/16GB-Verschl-Vera/veracrypt2/Geplante Immigration/GIS und Statistiken/Archiv-Erledigt/Geodaten-BKG/vg250_2019-01-01.utm32s.shape.ebenen/dokumentation/struktur_und_attribute.xls] application/vnd.ms-excel :4:internfile/mimehandler.cpp:100::returnMimeHandler: returning filter for application/vnd.ms-excel cache size 49 :4:internfile/internfile.cpp:919::FileInterner::internfile: conversion ended with no doc :4:rcldb/rcldb.cpp:1519::Db::add: udi [/media/Daten1/datensicherung/USB Speicher/16GB-Verschl-Vera/veracrypt2/Geplante Immigration/GIS und Statistiken/Archiv-Erledigt/Oa5Cz6/yjKZ1bg1qrcTAPg] parent [] :4:rcldb/rcldb.cpp:193::DbUpdWorker: got add/update task, ql 1 :4:rcldb/rcldb.cpp:744::Db::add: checking file system usage :2:index/fsindexer.cpp:557::FsIndexerInternfileWorker: processone failed :4:./utils/workqueue.h:320::workerExit:Internfile :4:./utils/workqueue.h:336::WorkQueue:ok:Internfile: not ok m_ok 0 m_workers_exited 1 m_worker_threads size 5 :2:index/fsindexer.cpp:231::FsIndexer::index: error while indexing /media/Daten1: :3:rcldb/rcldb.cpp:767::Db::add: docid 495479 updated [/media/Daten1/datensicherung/USB Speicher/16GB-Verschl-Vera/veracrypt2/Geplante Immigration/GIS und Statistiken/Archiv-Erledigt/Oa5Cz6/yjKZ1bg1qrcTAPg]