Biblio-Z3950.git
13 years agocorrectly pass usemap to all render calls
Dobrica Pavlinusic [Sat, 23 Oct 2010 21:58:19 +0000 (23:58 +0200)]
correctly pass usemap to all render calls

13 years agorename all $this to $self to be more perl-like
Dobrica Pavlinusic [Sat, 23 Oct 2010 21:55:04 +0000 (23:55 +0200)]
rename all $this to $self to be more perl-like

instead of JavaScript I guress?!

13 years agosome more debug
Dobrica Pavlinusic [Sat, 23 Oct 2010 21:54:00 +0000 (23:54 +0200)]
some more debug

13 years agobetter mapping to Aleph search syntax
Dobrica Pavlinusic [Sat, 23 Oct 2010 21:20:57 +0000 (23:20 +0200)]
better mapping to Aleph search syntax

13 years agoand cleanup code to load correct format
Dobrica Pavlinusic [Sat, 23 Oct 2010 20:49:29 +0000 (22:49 +0200)]
and cleanup code to load correct format

13 years agocollect results to support offset in fetch record
Dobrica Pavlinusic [Sat, 23 Oct 2010 20:19:16 +0000 (22:19 +0200)]
collect results to support offset in fetch record

13 years agostrip spaces from end of value
Dobrica Pavlinusic [Sat, 23 Oct 2010 20:11:48 +0000 (22:11 +0200)]
strip spaces from end of value

13 years agofix and cleanup database selection from link
Dobrica Pavlinusic [Sat, 23 Oct 2010 19:30:08 +0000 (21:30 +0200)]
fix and cleanup database selection from link

13 years agostop at last record
Dobrica Pavlinusic [Sat, 23 Oct 2010 16:57:49 +0000 (18:57 +0200)]
stop at last record

13 years agotry to select our database from link
Dobrica Pavlinusic [Sat, 23 Oct 2010 16:48:48 +0000 (18:48 +0200)]
try to select our database from link

Aleph returns database unavailable if we switch to advanced form and
default database isn't there. Now we try to follow link with database
in which we are interested.

13 years agoallocate session just once
Dobrica Pavlinusic [Sat, 23 Oct 2010 16:46:55 +0000 (18:46 +0200)]
allocate session just once

this will prevent our denial of service against Aleph if we get
too many requests (and since it's random number, I might as well used
42 for it)

13 years agoadded save_content for debugging
Dobrica Pavlinusic [Sat, 23 Oct 2010 16:27:26 +0000 (18:27 +0200)]
added save_content for debugging

13 years agocleanup unimarc/marc parsing
Dobrica Pavlinusic [Sat, 23 Oct 2010 14:17:32 +0000 (16:17 +0200)]
cleanup unimarc/marc parsing

13 years agofix number of tests
Dobrica Pavlinusic [Sat, 23 Oct 2010 13:52:59 +0000 (15:52 +0200)]
fix number of tests

13 years agofix warnings
Dobrica Pavlinusic [Sat, 23 Oct 2010 13:52:03 +0000 (15:52 +0200)]
fix warnings

13 years agostore hits and don't try to download more records
Dobrica Pavlinusic [Sat, 23 Oct 2010 13:44:31 +0000 (15:44 +0200)]
store hits and don't try to download more records

13 years agoblurb
Dobrica Pavlinusic [Sat, 23 Oct 2010 13:24:02 +0000 (15:24 +0200)]
blurb

13 years agoselect database
Dobrica Pavlinusic [Sat, 23 Oct 2010 12:53:02 +0000 (14:53 +0200)]
select database

this allows us to search in different Aleph databases in single
web interface

13 years agouse module name for database if missing
Dobrica Pavlinusic [Sat, 23 Oct 2010 12:51:04 +0000 (14:51 +0200)]
use module name for database if missing

13 years agosession should be integer
Dobrica Pavlinusic [Sat, 23 Oct 2010 12:46:30 +0000 (14:46 +0200)]
session should be integer

13 years agosave in correct database named directory
Dobrica Pavlinusic [Sat, 23 Oct 2010 12:45:59 +0000 (14:45 +0200)]
save in correct database named directory

13 years agosupport fields without subfields
Dobrica Pavlinusic [Sat, 23 Oct 2010 12:29:02 +0000 (14:29 +0200)]
support fields without subfields

13 years agotest both providers
Dobrica Pavlinusic [Sat, 23 Oct 2010 12:11:12 +0000 (14:11 +0200)]
test both providers

13 years agojoin multi-line fields
Dobrica Pavlinusic [Sat, 23 Oct 2010 12:08:43 +0000 (14:08 +0200)]
join multi-line fields

13 years agotest with new API
Dobrica Pavlinusic [Sat, 23 Oct 2010 11:58:46 +0000 (13:58 +0200)]
test with new API

13 years agouse save_marc
Dobrica Pavlinusic [Sat, 23 Oct 2010 11:58:37 +0000 (13:58 +0200)]
use save_marc

13 years agocleanup output
Dobrica Pavlinusic [Sat, 23 Oct 2010 11:56:34 +0000 (13:56 +0200)]
cleanup output

13 years agomove save_marc to Scraper
Dobrica Pavlinusic [Sat, 23 Oct 2010 11:47:35 +0000 (13:47 +0200)]
move save_marc to Scraper

13 years agocleanup field extraction
Dobrica Pavlinusic [Sat, 23 Oct 2010 11:31:36 +0000 (13:31 +0200)]
cleanup field extraction

13 years agofix number of fix extraction
Dobrica Pavlinusic [Sat, 23 Oct 2010 11:21:59 +0000 (13:21 +0200)]
fix number of fix extraction

13 years agoremove debug
Dobrica Pavlinusic [Fri, 22 Oct 2010 23:33:59 +0000 (01:33 +0200)]
remove debug

13 years agoload Aleph
Dobrica Pavlinusic [Fri, 22 Oct 2010 23:23:34 +0000 (01:23 +0200)]
load Aleph

13 years agoand test it
Dobrica Pavlinusic [Fri, 22 Oct 2010 23:23:20 +0000 (01:23 +0200)]
and test it

13 years agofix Aleph scraper
Dobrica Pavlinusic [Fri, 22 Oct 2010 23:23:08 +0000 (01:23 +0200)]
fix Aleph scraper

13 years agoreport invalid databases
Dobrica Pavlinusic [Fri, 22 Oct 2010 23:18:08 +0000 (01:18 +0200)]
report invalid databases

13 years agoextract common code into Scraper package
Dobrica Pavlinusic [Fri, 22 Oct 2010 23:09:55 +0000 (01:09 +0200)]
extract common code into Scraper package

13 years agorewrite COBISS into perl object
Dobrica Pavlinusic [Fri, 22 Oct 2010 22:57:58 +0000 (00:57 +0200)]
rewrite COBISS into perl object

and modify server to use it

13 years agorename to Biblio Z39.50
Dobrica Pavlinusic [Fri, 22 Oct 2010 22:10:51 +0000 (00:10 +0200)]
rename to Biblio Z39.50

13 years agogive render module to pull usemap from
Dobrica Pavlinusic [Fri, 22 Oct 2010 22:09:02 +0000 (00:09 +0200)]
give render module to pull usemap from

13 years agoand make eval for usemap work
Dobrica Pavlinusic [Fri, 22 Oct 2010 22:05:21 +0000 (00:05 +0200)]
and make eval for usemap work

13 years agobetter error reporting
Dobrica Pavlinusic [Fri, 22 Oct 2010 22:03:49 +0000 (00:03 +0200)]
better error reporting

13 years agocommand to test with yaz-client
Dobrica Pavlinusic [Fri, 22 Oct 2010 21:52:07 +0000 (23:52 +0200)]
command to test with yaz-client

13 years agomake usemap configurable
dpavlin [Fri, 22 Oct 2010 21:31:08 +0000 (21:31 +0000)]
make usemap configurable

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@14 ae73d1a6-5fa4-44a9-8f13-f281fb455051

13 years agomore debug output and some cleanup
dpavlin [Fri, 22 Oct 2010 21:12:46 +0000 (21:12 +0000)]
more debug output and some cleanup

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@13 ae73d1a6-5fa4-44a9-8f13-f281fb455051

13 years agogenerate marc record
dpavlin [Fri, 22 Oct 2010 20:49:16 +0000 (20:49 +0000)]
generate marc record

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@12 ae73d1a6-5fa4-44a9-8f13-f281fb455051

13 years agobasic parser for Aleph html at NSK
dpavlin [Fri, 22 Oct 2010 20:25:51 +0000 (20:25 +0000)]
basic parser for Aleph html at NSK

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@11 ae73d1a6-5fa4-44a9-8f13-f281fb455051

14 years agofix mapping for 210 -> 260
dpavlin [Fri, 26 Mar 2010 16:26:59 +0000 (16:26 +0000)]
fix mapping for 210 -> 260

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@10 ae73d1a6-5fa4-44a9-8f13-f281fb455051

14 years agoproduce unimarc (without conversion) of usmarc (with conversion)
dpavlin [Sun, 21 Jun 2009 08:16:41 +0000 (08:16 +0000)]
produce unimarc (without conversion) of usmarc (with conversion)

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@9 ae73d1a6-5fa4-44a9-8f13-f281fb455051

14 years agosupport multiple results
dpavlin [Sat, 20 Jun 2009 22:09:33 +0000 (22:09 +0000)]
support multiple results

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@8 ae73d1a6-5fa4-44a9-8f13-f281fb455051

14 years agocleanup output
dpavlin [Sat, 20 Jun 2009 20:19:49 +0000 (20:19 +0000)]
cleanup output

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@7 ae73d1a6-5fa4-44a9-8f13-f281fb455051

14 years agosimple server based on Net::Z3950::SimpleServer
dpavlin [Sat, 20 Jun 2009 19:42:32 +0000 (19:42 +0000)]
simple server based on Net::Z3950::SimpleServer
which serve out UNIMARC records

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@6 ae73d1a6-5fa4-44a9-8f13-f281fb455051

14 years agoremove debugging content output
dpavlin [Sat, 20 Jun 2009 19:42:00 +0000 (19:42 +0000)]
remove debugging content output

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@5 ae73d1a6-5fa4-44a9-8f13-f281fb455051

14 years agosplit COBISS into search (from advanced form) and fetch_rec,
dpavlin [Sat, 20 Jun 2009 19:28:04 +0000 (19:28 +0000)]
split COBISS into search (from advanced form) and fetch_rec,
create rewriter from Z39.50 to COBISS syntax,
added diag for output

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@4 ae73d1a6-5fa4-44a9-8f13-f281fb455051

14 years agoModule::Build builder
dpavlin [Fri, 19 Jun 2009 21:51:56 +0000 (21:51 +0000)]
Module::Build builder

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@3 ae73d1a6-5fa4-44a9-8f13-f281fb455051

14 years agocreate MARC record
dpavlin [Fri, 19 Jun 2009 21:51:28 +0000 (21:51 +0000)]
create MARC record

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@2 ae73d1a6-5fa4-44a9-8f13-f281fb455051

14 years agoscrape COBISS
dpavlin [Fri, 19 Jun 2009 17:50:34 +0000 (17:50 +0000)]
scrape COBISS

git-svn-id: svn+ssh://llin.lib/home/dpavlin/private/svn/Z3950-HTML-Scraper@1 ae73d1a6-5fa4-44a9-8f13-f281fb455051