<html><head> <meta content="text/html; charset=windows-1252" http-equiv="Content-Type"> </head><body bgcolor="#FFFFFF" text="#000000">Thanks for pointing me to the flag and the issue! Dan Michael On 06.12.2016, 10.20, Patrick Hochstenbach wrote: <blockquote cite="mid:A3C80404-6CE6-4CA2-ACE8-4A4C8D10F58B@UGent.be" type="cite"> <pre wrap="">Hi, there is also a resumptionToken you can provide on the command line, to restart at harvest. E.g. $ catmandu convert —url <a class="moz-txt-link-freetext" href="http://somewhere">http://somewhere</a> —resumptionToken=189eDa01 (my email eats up hyphens..alle options need double hyphens). Be aware that an OAI-PMH server can decide for itself how long a resumptionToken is valid. This trick might not work on all servers. Patrick </pre> <blockquote type="cite"><pre wrap="">On 6 Dec 2016, at 09:39, Vitali Peil <a class="moz-txt-link-rfc2396E" href="mailto:vitali.peil@uni-bielefeld.de"><vitali.peil@uni-bielefeld.de></a> wrote: Hi Dan Michael, you are hitting a wound point here: There exists an issue which adresses the problems you are running into: <a class="moz-txt-link-freetext" href="https://github.com/LibreCat/Catmandu-OAI/issues/7">https://github.com/LibreCat/Catmandu-OAI/issues/7</a> We welcome contributions! We can discuss strategies to keep this importer stable while running for hours. Cheers, Vitali Am 05.12.2016 um 14:49 schrieb "Dan Michael O. Heggų": </pre><blockquote type="cite"><pre wrap="">Hi, Do you have any tips on handling intermittent server errors occuring in long running harvests? For a harvest of mine I got around 800.000 records before hitting an error: ERROR: <a class="moz-txt-link-freetext" href="http://bibsys-k.alma.exlibrisgroup.com/view/oai/47BIBSYS_UBO/request">http://bibsys-k.alma.exlibrisgroup.com/view/oai/47BIBSYS_UBO/request</a> : all@all@oai_komplett@marc21@3535592670002204 : Server closed connection without sending any data back Eliminating random server errors doesn't seem realistic, so I'm wondering if Catmandu bails out immediately or does multiple retries, and if this is something that can be configured? If not, is the best way to handle it to write a small Perl script that catches certain exceptions? Also, is it possible to pass in the continuation token to the OAI importer as a flag or something to resume the harvest from where it stopped? Thanks alot for your feedback! Dan Michael _______________________________________________ librecat-dev mailing list - send list mails to <a class="moz-txt-link-abbreviated" href="mailto:librecat-dev@lists.uni-bielefeld.de">librecat-dev@lists.uni-bielefeld.de</a> - to unsubscribe or change options, visit <a class="moz-txt-link-freetext" href="https://lists.uni-bielefeld.de/mailman2/cgi/unibi/listinfo/librecat-dev">https://lists.uni-bielefeld.de/mailman2/cgi/unibi/listinfo/librecat-dev</a> - project website: <a class="moz-txt-link-freetext" href="http://librecat.org/">http://librecat.org/</a> </pre></blockquote><pre wrap="">-- Vitali Peil Office U3-200/E1-144, Tel. +49521-106-4010/6125 Bielefeld University Library _______________________________________________ librecat-dev mailing list - send list mails to <a class="moz-txt-link-abbreviated" href="mailto:librecat-dev@lists.uni-bielefeld.de">librecat-dev@lists.uni-bielefeld.de</a> - to unsubscribe or change options, visit <a class="moz-txt-link-freetext" href="https://lists.uni-bielefeld.de/mailman2/cgi/unibi/listinfo/librecat-dev">https://lists.uni-bielefeld.de/mailman2/cgi/unibi/listinfo/librecat-dev</a> - project website: <a class="moz-txt-link-freetext" href="http://librecat.org/">http://librecat.org/</a> </pre></blockquote> <pre wrap=""> Patrick Hochstenbach - digital architect University Library Ghent Sint-Hubertusstraat 8 - 9000 Ghent - Belgium <a class="moz-txt-link-abbreviated" href="mailto:patrick.hochstenbach@ugent.be">patrick.hochstenbach@ugent.be</a> +32 (0)9 264 7980 _______________________________________________ librecat-dev mailing list - send list mails to <a class="moz-txt-link-abbreviated" href="mailto:librecat-dev@lists.uni-bielefeld.de">librecat-dev@lists.uni-bielefeld.de</a> - to unsubscribe or change options, visit <a class="moz-txt-link-freetext" href="https://lists.uni-bielefeld.de/mailman2/cgi/unibi/listinfo/librecat-dev">https://lists.uni-bielefeld.de/mailman2/cgi/unibi/listinfo/librecat-dev</a> - project website: <a class="moz-txt-link-freetext" href="http://librecat.org/">http://librecat.org/</a> </pre> </blockquote> </body></html>