Article View: pl.comp.lang.java
Article #153080Re: crawler www
From: Marcin Czech
Date: Tue, 15 Nov 2011 11:44
Date: Tue, 15 Nov 2011 11:44
20 lines
3046 bytes
3046 bytes
On 15 Lis, 09:46, Hollow Quincy <hollow.qui...@gmail.com> wrote: > On 14 Lis, 14:14, Tomek Kańka <t...@tomkan.eu.org> wrote: > [...] > > > > Probowałem otworzyć za pomoca Luke'a _wszystkie_ pliki stworzone przez > > > Nutch'a. Niestety albo Nutch domyslanie nie tworzy indexu lucene (moze > > > trzeba dodać jakąś opcję?), albo coś innego robię źle. > > > No nie mam pomysłu jak dobrać się do scrawlowanych przez Nutcha stron. > > > Czy Luke otwiera indeksy w standardzie Lucene 3.x? > > Rzeczywiście Luke obsluguje index lucene do 3.0.x. Chyba Nutch > zapisuje pliki w nowszej wersji indexu lucene. Napiszę program > otwierający index z javy i dam znać jak sprawa wygląda. Dla testow sprobuj najpierw przeniesc dane do Solr poleceniem bin/ nutch solrindex http://127.0.0.1:8983/solr/ crawldb crawldb/segments/ * crawldb/linkdb testowa wersje solr uruchomisz w ciagu kilku minut tutaj masz tutorial http://wiki.apache.org/nutch/NutchTutorial#A6._Integrate_Solr_with_Nutch indeks obejrzysz z konsoli administarcyjnej http://localhost:8983/solr/admin/
Technical Details
Message-ID:
<c49f81a1-8ced-4c9e-b76d-eb87ff78c055@w7g2000yqc.googlegroups.com>Path:
mbox-mo1.pugleaf.net!news-archive.icm.edu.pl!agh.edu.pl!news.agh.edu.pl!newsfeed2.atman.pl!newsfeed.atman.pl!goblin2!goblin.stu.neva.ru!xlned.com!feeder7.xlned.com!news2.euro.net!209.197.12.246.MISMATCH!nx02.iad01.newshosting.com!newshosting.com!news-out.readnews.com!transit3.readnews.com!postnews.google.com!w7g2000yqc.googlegroups.com!not-for-mailReferences:
<d1b53944-ad2d-4670-8a37-7fb29bd1446a@gy7g2000vbb.googlegroups.com> <c766b518-5bb5-4301-bf78-8fb332c36f43@r2g2000vbj.googlegroups.com> <1272a09c-e6f9-41ee-a0e3-89aab6b251cb@w1g2000vba.googlegroups.com> <9bee795b-d0f8-437c-a11f-7f4fdb9095f8@l24g2000yqm.googlegroups.com> <cb12499f-4010-41fb-9cdd-6c618a45a109@i6g2000vbe.googlegroups.com> <7f4e5b4b-73a2-4a60-a873-a7dcc6445712@y7g2000vbe.googlegroups.com> <28f8130b-d289-4a30-bf96-0b8f6c9e9edf@l24g2000yqm.googlegroups.com> <8528b397-f7a5-4970-983f-0be893a09f47@d17g2000yql.googlegroups.com> <slrnjc250s.pk9.tom@tv2.dom.local> <966d07df-13e2-4150-8699-f5cfde4a7842@w7g2000yqc.googlegroups.com>Show Full Headers
Complete Article Headers
Path: mbox-mo1.pugleaf.net!news-archive.icm.edu.pl!agh.edu.pl!news.agh.edu.pl!newsfeed2.atman.pl!newsfeed.atman.pl!goblin2!goblin.stu.neva.ru!xlned.com!feeder7.xlned.com!news2.euro.net!209.197.12.246.MISMATCH!nx02.iad01.newshosting.com!newshosting.com!news-out.readnews.com!transit3.readnews.com!postnews.google.com!w7g2000yqc.googlegroups.com!not-for-mail From: Marcin Czech <maczech@gmail.com> Newsgroups: pl.comp.lang.java Subject: Re: crawler www Date: Tue, 15 Nov 2011 03:44:42 -0800 (PST) Organization: http://groups.google.com Lines: 25 Message-ID: <c49f81a1-8ced-4c9e-b76d-eb87ff78c055@w7g2000yqc.googlegroups.com> References: <d1b53944-ad2d-4670-8a37-7fb29bd1446a@gy7g2000vbb.googlegroups.com> <c766b518-5bb5-4301-bf78-8fb332c36f43@r2g2000vbj.googlegroups.com> <1272a09c-e6f9-41ee-a0e3-89aab6b251cb@w1g2000vba.googlegroups.com> <9bee795b-d0f8-437c-a11f-7f4fdb9095f8@l24g2000yqm.googlegroups.com> <cb12499f-4010-41fb-9cdd-6c618a45a109@i6g2000vbe.googlegroups.com> <7f4e5b4b-73a2-4a60-a873-a7dcc6445712@y7g2000vbe.googlegroups.com> <28f8130b-d289-4a30-bf96-0b8f6c9e9edf@l24g2000yqm.googlegroups.com> <8528b397-f7a5-4970-983f-0be893a09f47@d17g2000yql.googlegroups.com> <slrnjc250s.pk9.tom@tv2.dom.local> <966d07df-13e2-4150-8699-f5cfde4a7842@w7g2000yqc.googlegroups.com> NNTP-Posting-Host: 193.111.41.127 Mime-Version: 1.0 X-Trace: posting.google.com 1321357607 12495 127.0.0.1 (15 Nov 2011 11:46:47 GMT) X-Complaints-To: groups-abuse@google.com NNTP-Posting-Date: Tue, 15 Nov 2011 11:46:47 +0000 (UTC) Complaints-To: groups-abuse@google.com Injection-Info: w7g2000yqc.googlegroups.com; posting-host=193.111.41.127; posting-account=vDOB2goAAABb-AGoKimeAv3LiOZ8tpBw User-Agent: G2/1.0 X-Google-Web-Client: true X-Google-Header-Order: ASELCHRU X-HTTP-UserAgent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.8 (KHTML, like Gecko) Chrome/17.0.932.0 Safari/535.8,gzip(gfe) Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit