<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style></style></head><body lang=DE link=blue vlink=purple style='word-wrap: break-word;-webkit-nbsp-mode: space;line-break:after-white-space'><div class=WordSection1>Thanks, I’ll try it.<o:p></o:p><o:p> </o:p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm'>Von: Nicolas Franck [mailto:Nicolas.Franck@UGent.be] Gesendet: Freitag, 13. Juli 2018 14:39 An: Hauschke, Christian Cc: librecat-dev@lists.uni-bielefeld.de Betreff: Re: [librecat-dev] Use of uninitialized value $\ in concatenation(.)or string<o:p></o:p></div></div><o:p> </o:p><o:p> </o:p><div> <o:p></o:p><div>On 13 Jul 2018, at 14:29, Hauschke, Christian <<a href="mailto:christian.hauschke@tib.eu">christian.hauschke@tib.eu</a>> wrote:<o:p></o:p></div><o:p> </o:p><div><div>Hi,<o:p></o:p></div><div> <o:p></o:p></div><div>Thanks for your help, the query worked! Now I have two follow-up questions:<o:p></o:p></div><div> <o:p></o:p></div><div style='margin-left:36.0pt'>1. The query doesn’t seem to make use of the resumption tokens, at least the file output.xml contains only 10 entries. From what I understand from <a href="https://metacpan.org/pod/release/HOCHSTEN/Catmandu-OAI-0.16/lib/Catmandu/Importer/OAI.pm">https://metacpan.org/pod/release/HOCHSTEN/Catmandu-OAI-0.16/lib/Catmandu/Importer/OAI.pm</a>, there is no parameter to turn this on. The parameter resumptiontoken seems to serve only as a starting point. How do I get all records I queried?<o:p></o:p></div><div style='margin-left:36.0pt'>2. Is there a way to harvest only the 336.835 records from <a href="https://www.tib.eu/oai/public/repository/open?verb=ListRecords&metadataPrefix=marc_xml&set=collection%7Etibkat_solr%7EdocumentType:r">https://www.tib.eu/oai/public/repository/open?verb=ListRecords&metadataPrefix=marc_xml&set=collection~tibkat_solr~documentType:r</a> without using sets? The set containing the records I’m interested in would be significantly larger (<a href="https://www.tib.eu/oai/public/repository/open?verb=ListRecords&metadataPrefix=oai_dc&set=tibkat">https://www.tib.eu/oai/public/repository/open?verb=ListRecords&metadataPrefix=oai_dc&set=tibkat</a> with 3.612.946 records)<o:p></o:p></div></div><div><o:p> </o:p></div><div>Not from the command line interface. But every importer is also an Catmandu::Iterable, you in perl you can apply:<o:p></o:p></div><div><o:p> </o:p></div><div> my $importer = Catmandu::Importer::OAI->new( .. );<o:p></o:p></div><div> $importer->slice( $start, $limit )->each(sub{<o:p></o:p></div><div> ..<o:p></o:p></div><div> });<o:p></o:p></div><div><o:p> </o:p></div><div>That doesn't mean although that only $limit records will be fetched in the background (the oai repo determines the size of each page).<o:p></o:p></div> <o:p></o:p><div><div> <o:p></o:p></div><div>Best,<o:p></o:p></div><div>Christian<o:p></o:p></div><div> <o:p></o:p></div><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm'><div>Von: <a href="mailto:librecat-dev-bounces@lists.uni-bielefeld.de">librecat-dev-bounces@lists.uni-bielefeld.de</a> [<a href="mailto:librecat-dev-bounces@lists.uni-bielefeld.de">mailto:librecat-dev-bounces@lists.uni-bielefeld.de</a>] Im Auftrag von Vitali Peil Gesendet: Freitag, 13. Juli 2018 11:50 An: <a href="mailto:librecat-dev@lists.uni-bielefeld.de">librecat-dev@lists.uni-bielefeld.de</a> Betreff: Re: [librecat-dev] Use of uninitialized value $\ in concatenation (.)or string<o:p></o:p></div></div></div><div> <o:p></o:p></div>Hi,<o:p></o:p>easy answer here: your selected set "collection~tibcat_solr~documentType:r" does not exist (according to <a href="https://www.tib.eu/oai/public/repository/open?verb=ListSets">https://www.tib.eu/oai/public/repository/open?verb=ListSets</a>).<o:p></o:p>Without the set parameter it works well<o:p></o:p>catmandu convert OAI --url <a href="https://www.tib.eu/oai/public/repository/open">https://www.tib.eu/oai/public/repository/open</a> --metadataPrefix marc_xml --handler marcxml to MARC > output.xml <o:p></o:p>(but it doesn't provide an XML ;-) you have to specify a type).<o:p></o:p>So, one looks ok: catmandu convert OAI --url <a href="https://www.tib.eu/oai/public/repository/open">https://www.tib.eu/oai/public/repository/open</a> --metadataPrefix marc_xml --handler marcxml to MARC --type XML > output.xml <o:p></o:p>Best,<o:p></o:p>Vitali<o:p></o:p><div> <o:p></o:p></div><div><div>Am 13.07.2018 um 11:31 schrieb Hauschke, Christian:<o:p></o:p></div></div><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><div>Dear all,<o:p></o:p></div><div> <o:p></o:p></div><div>in the mailing list archive it looks like my mail from yesterday wasn’t sent out to the list members. Please excuse me, if you receive this a second time now.<o:p></o:p></div><div> <o:p></o:p></div><div>Despite the support of Patrick Hochstenbach (<a href="https://twitter.com/hochstenbach/status/1017087798132736002">https://twitter.com/hochstenbach/status/1017087798132736002</a>, thanks a lot!) I cannot achieve my desired result.<o:p></o:p></div><div> <o:p></o:p></div><div>I want to write the following set as MARC/XML into a file (or many files): <a href="https://www.tib.eu/oai/public/repository/open?verb=ListRecords&metadataPrefix=marc_xml&set=collection%7Etibkat_solr%7EdocumentType:r">https://www.tib.eu/oai/public/repository/open?verb=ListRecords&metadataPrefix=marc_xml&set=collection~tibkat_solr~documentType:r</a><o:p></o:p></div><div>My approach, following the advice I received:<o:p></o:p></div><div>catmandu convert OAI --url <a href="https://www.tib.eu/oai/public/repository/open">https://www.tib.eu/oai/public/repository/open</a> --set collection~tibcat_solr~documentType:r --metadataPrefix marc_xml --handler marcxml to MARC > output.xml<o:p></o:p></div><div> <o:p></o:p></div><div>This leads to the following error message:<o:p></o:p></div><div>Use of uninitialized value $\ in concatenation (.) or string at /usr/local/share/perl/5.22.1/HTTP/OAI/Repository.pm line 169.<o:p></o:p></div><div> <o:p></o:p></div><div>I use Catmandu 1.09 on Ubuntu. Any advice on how to proceed is very welcome.<o:p></o:p></div><div> <o:p></o:p></div><div>Best,<o:p></o:p></div><div>Christian<o:p></o:p></div><div> <o:p></o:p></div><div> <o:p></o:p></div><div>-- <o:p></o:p></div><div>Christian Hauschke<o:p></o:p></div><div>Technische Informationsbibliothek (TIB)<o:p></o:p></div><div>German National Library of Science and Technology<o:p></o:p></div><div>Open Science Lab<o:p></o:p></div><div>Welfengarten 1 B // 30167 Hannover, Germany<o:p></o:p></div><div>T +49 511 762-14642 <o:p></o:p></div><div><a href="mailto:christian.hauschke@tib.eu">christian.hauschke@tib.eu</a><o:p></o:p></div><div><a href="http://www.tib.eu/">www.tib.eu</a><o:p></o:p></div><div> <o:p></o:p></div><div> <o:p></o:p></div><pre style='background:white'>_______________________________________________<o:p></o:p></pre><pre style='background:white'>librecat-dev mailing list<o:p></o:p></pre><pre style='background:white'>- send list mails to <a href="mailto:librecat-dev@lists.uni-bielefeld.de">librecat-dev@lists.uni-bielefeld.de</a><o:p></o:p></pre><pre style='background:white'>- to unsubscribe or change options, visit <a href="https://lists.uni-bielefeld.de/mailman2/cgi/unibi/listinfo/librecat-dev">https://lists.uni-bielefeld.de/mailman2/cgi/unibi/listinfo/librecat-dev</a><o:p></o:p></pre><pre style='background:white'>- project website: <a href="http://librecat.org/">http://librecat.org/</a><o:p></o:p></pre></blockquote><div> <o:p></o:p></div><pre style='background:white'>-- <o:p></o:p></pre><pre style='background:white'>Vitali Peil<o:p></o:p></pre><pre style='background:white'>Deputy Head Acquisitions Department<o:p></o:p></pre><pre style='background:white'>Subject Librarian<o:p></o:p></pre><pre style='background:white'>Office U3-200/E1-144, Tel. +49521-106-4010/6125<o:p></o:p></pre><pre style='background:white'>Bielefeld University Library<o:p></o:p></pre>_______________________________________________ librecat-dev mailing list - send list mails to <a href="mailto:librecat-dev@lists.uni-bielefeld.de">librecat-dev@lists.uni-bielefeld.de</a> - to unsubscribe or change options, visit <a href="https://lists.uni-bielefeld.de/mailman2/cgi/unibi/listinfo/librecat-dev">https://lists.uni-bielefeld.de/mailman2/cgi/unibi/listinfo/librecat-dev</a> - project website: <a href="http://librecat.org/">http://librecat.org/</a><o:p></o:p></div></div><o:p> </o:p></div></body></html>