Dobrica Pavlinusic [Sun, 20 May 2007 16:19:17 +0000 (16:19 +0000)]
r1213@llin: dpavlin | 2007-05-20 18:16:02 +0200
and fix to actually count right templates :-)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@828
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 20 May 2007 16:19:16 +0000 (16:19 +0000)]
r1212@llin: dpavlin | 2007-05-20 17:39:01 +0200
first try at implementation of delimiters validation
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@827
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 20 May 2007 16:19:13 +0000 (16:19 +0000)]
r1211@llin: dpavlin | 2007-05-20 14:48:37 +0200
Removed debugging output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@826
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 18 May 2007 21:41:19 +0000 (21:41 +0000)]
request Biblio::Isis 0.24 to ignore empty subfields
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@825
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 18 May 2007 20:27:21 +0000 (20:27 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@824
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 12:22:37 +0000 (12:22 +0000)]
r1203@llin: dpavlin | 2007-04-11 14:22:28 +0200
spacial handling for empty subfields [0.18]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@823
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 12:22:35 +0000 (12:22 +0000)]
r1202@llin: dpavlin | 2007-04-11 14:00:20 +0200
remove empty subfield test data
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@822
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 12:22:33 +0000 (12:22 +0000)]
r1201@llin: dpavlin | 2007-04-11 13:54:24 +0200
refactor filter tests
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@821
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 12:22:31 +0000 (12:22 +0000)]
r1200@llin: dpavlin | 2007-04-11 13:38:57 +0200
cleanup test (call patch /fake/ because they are),
added test which fails because of empty subfield modify bug
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@820
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 10:09:34 +0000 (10:09 +0000)]
r1198@llin: dpavlin | 2007-04-11 12:09:29 +0200
prefix, suffix and surround now work correcty with empty strings and zeros
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@819
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 5 Apr 2007 21:53:52 +0000 (21:53 +0000)]
fix warning
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@818
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 5 Apr 2007 21:50:14 +0000 (21:50 +0000)]
use debug level to, well, display debug
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@817
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 5 Apr 2007 21:48:41 +0000 (21:48 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@816
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Mon, 2 Apr 2007 17:20:01 +0000 (17:20 +0000)]
r1192@llin: dpavlin | 2007-04-02 19:20:01 +0200
added support for fix-length fields using marc_fixed [2.29]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@815
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:48 +0000 (21:47 +0000)]
r1185@llin: dpavlin | 2007-04-01 23:47:05 +0200
r1183@llin: dpavlin | 2007-04-01 23:47:01 +0200
propagate changes through documentation and actuall running code :-)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@814
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:47 +0000 (21:47 +0000)]
r1184@llin: dpavlin | 2007-04-01 23:47:04 +0200
r1182@llin: dpavlin | 2007-04-01 23:44:03 +0200
marc_duplicate now correctly duplicates leader data, new _get_marc_leader to
return leader corresponding to last _get_marc_fields call, added marc_count
which returns number of created MARC records
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@813
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:42 +0000 (21:47 +0000)]
r1181@llin: dpavlin | 2007-04-01 22:47:56 +0200
r1180@llin: dpavlin | 2007-04-01 22:47:43 +0200
renamed $leader to $marc_leader to be consistent with other vars
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@812
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:40 +0000 (21:47 +0000)]
r1179@llin: dpavlin | 2007-04-01 22:42:35 +0200
hush test without --debug
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@811
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:38 +0000 (21:47 +0000)]
r1178@llin: dpavlin | 2007-04-01 22:39:11 +0200
cleanup debug output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@810
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:36 +0000 (21:47 +0000)]
r1176@llin: dpavlin | 2007-04-01 16:20:40 +0200
add _database:database_name so we can search for it using full-text as opposed to atribute
search (this might handy when emulating number of results for each database
from single merged index)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@809
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 14:15:08 +0000 (14:15 +0000)]
added test modify rules
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@808
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 12:26:25 +0000 (12:26 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@807
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Mar 2007 13:03:11 +0000 (13:03 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@806
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 2 Mar 2007 00:34:22 +0000 (00:34 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@805
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 2 Mar 2007 00:32:50 +0000 (00:32 +0000)]
argh. I run into inode problem: too many files on ext3 fs
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@804
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 2 Mar 2007 00:32:21 +0000 (00:32 +0000)]
added --[no-]marc-generate
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@803
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 15 Feb 2007 22:43:03 +0000 (22:43 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@802
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 15 Feb 2007 22:42:51 +0000 (22:42 +0000)]
more things
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@801
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 23:10:18 +0000 (23:10 +0000)]
decorate output from regexp modify with filename and line
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@800
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 15:09:01 +0000 (15:09 +0000)]
minor tweaks to test modify_file
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@799
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 13:31:38 +0000 (13:31 +0000)]
store filter (no tests for it, though!)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@798
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 13:28:30 +0000 (13:28 +0000)]
finish tweaking mock framework, test and fix problem with slashes in modify_record
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@797
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 12:42:43 +0000 (12:42 +0000)]
a try at mocking of inputs in WebPAC::Input::Test
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@796
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 12:37:42 +0000 (12:37 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@795
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 12:20:54 +0000 (12:20 +0000)]
modify record test which fails (with slash /), tweaks
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@794
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 12:19:51 +0000 (12:19 +0000)]
small tweaks on seek
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@793
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 30 Jan 2007 18:23:53 +0000 (18:23 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@792
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 30 Jan 2007 18:21:17 +0000 (18:21 +0000)]
added count
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@791
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 13 Dec 2006 10:08:27 +0000 (10:08 +0000)]
r1154@llin: dpavlin | 2006-12-13 11:13:28 +0100
added -h option using Pod::Usage
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@790
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 10 Dec 2006 12:57:16 +0000 (12:57 +0000)]
mark new things implemented
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@789
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 10 Dec 2006 12:56:59 +0000 (12:56 +0000)]
better logging
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@788
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 10 Dec 2006 12:56:05 +0000 (12:56 +0000)]
test marc_remove('*')
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@787
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 10 Dec 2006 12:45:11 +0000 (12:45 +0000)]
added support for marc_remove('*') to clean whole
marc record after marc_dumplicate
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@786
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 6 Dec 2006 23:44:36 +0000 (23:44 +0000)]
added get and set to create in-memory hash
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@785
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 6 Dec 2006 23:43:45 +0000 (23:43 +0000)]
added regex: to modify_records
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@784
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 6 Dec 2006 23:42:20 +0000 (23:42 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@783
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 16:51:49 +0000 (16:51 +0000)]
r1144@llin: dpavlin | 2006-11-05 17:51:38 +0100
report error message on errors
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@782
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 15:03:59 +0000 (15:03 +0000)]
r1141@llin: dpavlin | 2006-11-05 16:03:48 +0100
subset of Project Gutenberg catalog.rdf for testing
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@781
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 15:03:54 +0000 (15:03 +0000)]
r1140@llin: dpavlin | 2006-11-05 16:03:25 +0100
WebPAC::Input::Gutenberg needs XML::LibXML
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@780
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 14:52:04 +0000 (14:52 +0000)]
r1137@llin: dpavlin | 2006-11-05 15:51:19 +0100
no need to have MFN twice in record (it is also added by _to_hash)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@779
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 14:51:59 +0000 (14:51 +0000)]
r1136@llin: dpavlin | 2006-11-05 15:49:50 +0100
debug shouldn't auto-vivify all fields!
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@778
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 14:48:12 +0000 (14:48 +0000)]
r1133@llin: dpavlin | 2006-11-05 15:48:00 +0100
first cut at getting Project Gutenberg's RDF as input format for WebPAC
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@777
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 14:48:06 +0000 (14:48 +0000)]
r1132@llin: dpavlin | 2006-11-05 14:58:01 +0100
cleanup
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@776
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 12:28:37 +0000 (12:28 +0000)]
r1130@llin: dpavlin | 2006-11-05 13:29:36 +0100
rotate log file on startup
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@775
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:56:21 +0000 (20:56 +0000)]
another swiping API change: input->dump is gone, replaced
with input->dump_ascii which is more understandable.
If you want to override default behaviour
(which is to use Data::Dump's dump in input->fetch_rec)
define dump_ascii in low-level WebPAC::Input:: API
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@774
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:41:12 +0000 (20:41 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@773
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:40:38 +0000 (20:40 +0000)]
r1124@llin: dpavlin | 2006-11-03 21:39:00 +0100
use MARC::Fast 0.05 to_ascii to implement dump_rec
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@772
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:40:33 +0000 (20:40 +0000)]
r1123@llin: dpavlin | 2006-11-03 21:38:14 +0100
implement fallback dump if low-level API isn't exposing dump_rec [0.15]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@771
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:21:14 +0000 (20:21 +0000)]
r1120@llin: dpavlin | 2006-11-03 21:22:05 +0100
pod fix
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@770
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:21:09 +0000 (20:21 +0000)]
r1119@llin: dpavlin | 2006-11-03 21:21:35 +0100
--validate will automatically turn on --stats and won't produce
any output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@769
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 19:41:28 +0000 (19:41 +0000)]
r1117@llin: dpavlin | 2006-11-03 20:42:24 +0100
cleanup API a bit. validate_errors in now validate_rec [0.10]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@768
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 31 Oct 2006 13:44:42 +0000 (13:44 +0000)]
r1115@llin: dpavlin | 2006-10-31 14:45:15 +0100
fix unit test by removing old lookup code (but, it's missing new one now)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@767
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 31 Oct 2006 13:19:47 +0000 (13:19 +0000)]
r1113@llin: dpavlin | 2006-10-31 14:17:02 +0100
cleanup normalization error message for lookups and modify tests so they don't fail anymore
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@766
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 21:01:51 +0000 (21:01 +0000)]
moved two more dump()s to closure, saving 2/3rd of memory and some CPU time on
output which is not needed without debug level
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@765
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 20:53:48 +0000 (20:53 +0000)]
report time needed to store lookup to disk
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@764
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 20:53:14 +0000 (20:53 +0000)]
refresh progress bar at least every 2 seconds (helps on huge databases where
percentages increase too slowly)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@763
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 18:54:45 +0000 (18:54 +0000)]
use save_row and load_row to share data between lookups
and input->fetch, added some timing for loading of lookups
which revealed a big performance impact of one debug(dump())
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@762
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 17:10:08 +0000 (17:10 +0000)]
implemented load_row and save_row closures to serialize
input databases (using WebPAC::Store probably).
This will allow lookups to share on-disk storage with
low_mem option of WebPAC::Input, which is now gone
(under pressure of 600000+ record database which we
are now testing on)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@761
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 15:56:44 +0000 (15:56 +0000)]
Turn on option low_mem (which need rewrite to use db/row) if there
are more than 10000 rows (hardcoded, but should go away).
This prevents webpac from running out of memory with databases
of about 300000 records on 4Gb of (virtual) memory.
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@760
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 11:03:45 +0000 (11:03 +0000)]
status update
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@759
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 11:02:36 +0000 (11:02 +0000)]
local config
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@758
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 10 Oct 2006 10:57:59 +0000 (10:57 +0000)]
fix dump (ugly, needs re-visiting)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@757
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Mon, 9 Oct 2006 13:37:34 +0000 (13:37 +0000)]
r1099@llin: dpavlin | 2006-10-09 15:34:12 +0200
one more thing done for lookups
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@756
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 20:28:17 +0000 (20:28 +0000)]
r1097@llin: dpavlin | 2006-10-08 22:24:54 +0200
replaced generate_marc with universal have_rules [0.08]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@755
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 18:44:42 +0000 (18:44 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@754
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 18:43:58 +0000 (18:43 +0000)]
sort marc fields in output [0.04]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@753
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 18:21:26 +0000 (18:21 +0000)]
move warns to debug level
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@752
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 13:25:11 +0000 (13:25 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@751
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 13:24:46 +0000 (13:24 +0000)]
make rec() a bit more clever about returning values [0.23]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@750
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 13:00:04 +0000 (13:00 +0000)]
emit error instead of warning and offer hint
(it should be automatic, but currently isn't)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@749
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 12:45:50 +0000 (12:45 +0000)]
more...
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@748
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 12:45:39 +0000 (12:45 +0000)]
cleanup
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@747
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 12:43:39 +0000 (12:43 +0000)]
r1085@llin: dpavlin | 2006-10-08 14:40:26 +0200
added files needed for tests, quitet log
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@746
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 12:41:59 +0000 (12:41 +0000)]
add PPI to dependencies
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@745
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 00:38:20 +0000 (00:38 +0000)]
r1078@llin: dpavlin | 2006-10-08 02:34:55 +0200
[2.28]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@744
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 00:38:15 +0000 (00:38 +0000)]
r1077@llin: dpavlin | 2006-10-08 02:32:39 +0200
remove old lookup code
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@743
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 00:38:10 +0000 (00:38 +0000)]
r1076@llin: dpavlin | 2006-10-08 02:31:04 +0200
don't dump undef data_structure in debug log
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@742
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 00:38:04 +0000 (00:38 +0000)]
r1075@llin: dpavlin | 2006-10-08 02:30:42 +0200
don't polute data_structure with leader (data_structure will now
return undef as it should if matched rules didn't have any search
or display directives)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@741
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sat, 7 Oct 2006 16:33:37 +0000 (16:33 +0000)]
r1073@llin: dpavlin | 2006-10-07 18:30:24 +0200
if there is only one value, lookups will return scalar and not array
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@740
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 5 Oct 2006 14:46:50 +0000 (14:46 +0000)]
r1070@llin: dpavlin | 2006-10-05 16:43:36 +0200
few more things todo
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@739
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 5 Oct 2006 14:46:38 +0000 (14:46 +0000)]
r1069@llin: dpavlin | 2006-10-05 16:43:16 +0200
remove --marc-normalize and --marc-output and generate marc output only
if normalize rules have marc directives
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@738
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 5 Oct 2006 14:38:45 +0000 (14:38 +0000)]
r1067@llin: dpavlin | 2006-10-05 16:35:45 +0200
added generate_marc to find out if normalization rules have marc* directives
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@737
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 5 Oct 2006 12:57:51 +0000 (12:57 +0000)]
r1065@llin: dpavlin | 2006-10-05 14:54:48 +0200
actually we don't need *_load_ds, but _load_row for lookups
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@736
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Mon, 2 Oct 2006 09:31:25 +0000 (09:31 +0000)]
r1063@llin: dpavlin | 2006-10-02 11:28:37 +0200
added load_row and save_row needed for lookups [0.14]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@735
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Oct 2006 20:14:14 +0000 (20:14 +0000)]
r1060@llin: dpavlin | 2006-10-01 15:53:50 +0200
incompatible change: data_structure files are not created inside
'ds' directory in cache dir [0.13]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@734
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Oct 2006 20:14:09 +0000 (20:14 +0000)]
r1059@llin: dpavlin | 2006-10-01 15:52:48 +0200
don't cleanup temp cache directory if in debug mode
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@733
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 29 Sep 2006 20:25:34 +0000 (20:25 +0000)]
r1057@llin: dpavlin | 2006-09-29 22:23:05 +0200
less chatty
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@732
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 29 Sep 2006 20:18:39 +0000 (20:18 +0000)]
r1053@llin: dpavlin | 2006-09-29 22:16:01 +0200
moving to final peace of puzzle: run.pl which use new APIs
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@731
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 29 Sep 2006 20:18:34 +0000 (20:18 +0000)]
r1052@llin: dpavlin | 2006-09-29 22:15:12 +0200
don't reset lookup and config on each data_structure call
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@730
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 29 Sep 2006 20:18:30 +0000 (20:18 +0000)]
r1051@llin: dpavlin | 2006-09-29 21:58:49 +0200
make it less chatty without debug level
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@729
07558da8-63fa-0310-ba24-
9fe276d99e06
projects / webpac2 / log