Dobrica Pavlinusic [Sun, 27 May 2007 10:50:37 +0000 (10:50 +0000)]
r1253@llin: dpavlin | 2007-05-27 12:49:54 +0200
added accumulated delimiters templates to hold all templates which are
found in this run (and thus saved to --validate-delimiters file) while
generating correct stats for each input
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@849
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 10:45:40 +0000 (10:45 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@848
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 09:53:54 +0000 (09:53 +0000)]
r1250@llin: dpavlin | 2007-05-27 11:54:28 +0200
test creation of new file, hush debugging output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@847
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 09:53:52 +0000 (09:53 +0000)]
r1249@llin: dpavlin | 2007-05-27 11:49:30 +0200
fix temp file handling
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@846
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 09:39:44 +0000 (09:39 +0000)]
bug fix
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@845
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sat, 26 May 2007 10:40:01 +0000 (10:40 +0000)]
work with fields which have number 0 (as opposed to 000) which has been
noticed in the wild (invalid, but --stats shouldn't really die)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@844
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 25 May 2007 19:49:39 +0000 (19:49 +0000)]
different wording: potentially invalid combination
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@843
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 25 May 2007 19:48:02 +0000 (19:48 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@842
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 25 May 2007 19:47:43 +0000 (19:47 +0000)]
hush warning
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@841
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 14:42:40 +0000 (14:42 +0000)]
r1237@llin: dpavlin | 2007-05-24 16:42:47 +0200
if validate file exists, it will create file with .new extension
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@840
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 14:42:38 +0000 (14:42 +0000)]
r1236@llin: dpavlin | 2007-05-24 16:38:02 +0200
require path or delimiters_path
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@839
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 14:42:35 +0000 (14:42 +0000)]
r1235@llin: dpavlin | 2007-05-24 16:34:31 +0200
and make it really work :-)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@838
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 12:44:45 +0000 (12:44 +0000)]
r1232@llin: dpavlin | 2007-05-24 14:44:53 +0200
added storing and retriving of delimiters templates to file and some basic tests
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@837
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 12:44:43 +0000 (12:44 +0000)]
r1231@llin: dpavlin | 2007-05-24 13:00:25 +0200
tidy machine readable output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@836
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 10:53:50 +0000 (10:53 +0000)]
r1228@llin: dpavlin | 2007-05-24 12:53:57 +0200
report invalid delimiter combinations
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@835
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 10:53:48 +0000 (10:53 +0000)]
r1227@llin: dpavlin | 2007-05-24 10:26:01 +0200
generate humanly readable report or machine readable
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@834
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 23 May 2007 20:04:13 +0000 (20:04 +0000)]
r1225@llin: dpavlin | 2007-05-23 22:04:17 +0200
use delimiters from config.yml file and dump report to file
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@833
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 23 May 2007 20:03:16 +0000 (20:03 +0000)]
r1221@llin: dpavlin | 2007-05-20 22:43:38 +0200
added delimiters_templates report
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@832
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 23 May 2007 20:03:14 +0000 (20:03 +0000)]
r1220@llin: dpavlin | 2007-05-20 19:29:36 +0200
can be called for fields without subfields now...
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@831
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 23 May 2007 20:03:12 +0000 (20:03 +0000)]
r1219@llin: dpavlin | 2007-05-20 19:28:41 +0200
cleanup debugging output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@830
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 20 May 2007 16:19:19 +0000 (16:19 +0000)]
r1214@llin: dpavlin | 2007-05-20 18:19:12 +0200
more sample data
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@829
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 20 May 2007 16:19:17 +0000 (16:19 +0000)]
r1213@llin: dpavlin | 2007-05-20 18:16:02 +0200
and fix to actually count right templates :-)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@828
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 20 May 2007 16:19:16 +0000 (16:19 +0000)]
r1212@llin: dpavlin | 2007-05-20 17:39:01 +0200
first try at implementation of delimiters validation
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@827
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 20 May 2007 16:19:13 +0000 (16:19 +0000)]
r1211@llin: dpavlin | 2007-05-20 14:48:37 +0200
Removed debugging output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@826
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 18 May 2007 21:41:19 +0000 (21:41 +0000)]
request Biblio::Isis 0.24 to ignore empty subfields
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@825
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 18 May 2007 20:27:21 +0000 (20:27 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@824
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 12:22:37 +0000 (12:22 +0000)]
r1203@llin: dpavlin | 2007-04-11 14:22:28 +0200
spacial handling for empty subfields [0.18]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@823
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 12:22:35 +0000 (12:22 +0000)]
r1202@llin: dpavlin | 2007-04-11 14:00:20 +0200
remove empty subfield test data
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@822
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 12:22:33 +0000 (12:22 +0000)]
r1201@llin: dpavlin | 2007-04-11 13:54:24 +0200
refactor filter tests
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@821
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 12:22:31 +0000 (12:22 +0000)]
r1200@llin: dpavlin | 2007-04-11 13:38:57 +0200
cleanup test (call patch /fake/ because they are),
added test which fails because of empty subfield modify bug
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@820
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 10:09:34 +0000 (10:09 +0000)]
r1198@llin: dpavlin | 2007-04-11 12:09:29 +0200
prefix, suffix and surround now work correcty with empty strings and zeros
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@819
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 5 Apr 2007 21:53:52 +0000 (21:53 +0000)]
fix warning
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@818
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 5 Apr 2007 21:50:14 +0000 (21:50 +0000)]
use debug level to, well, display debug
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@817
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 5 Apr 2007 21:48:41 +0000 (21:48 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@816
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Mon, 2 Apr 2007 17:20:01 +0000 (17:20 +0000)]
r1192@llin: dpavlin | 2007-04-02 19:20:01 +0200
added support for fix-length fields using marc_fixed [2.29]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@815
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:48 +0000 (21:47 +0000)]
r1185@llin: dpavlin | 2007-04-01 23:47:05 +0200
r1183@llin: dpavlin | 2007-04-01 23:47:01 +0200
propagate changes through documentation and actuall running code :-)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@814
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:47 +0000 (21:47 +0000)]
r1184@llin: dpavlin | 2007-04-01 23:47:04 +0200
r1182@llin: dpavlin | 2007-04-01 23:44:03 +0200
marc_duplicate now correctly duplicates leader data, new _get_marc_leader to
return leader corresponding to last _get_marc_fields call, added marc_count
which returns number of created MARC records
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@813
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:42 +0000 (21:47 +0000)]
r1181@llin: dpavlin | 2007-04-01 22:47:56 +0200
r1180@llin: dpavlin | 2007-04-01 22:47:43 +0200
renamed $leader to $marc_leader to be consistent with other vars
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@812
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:40 +0000 (21:47 +0000)]
r1179@llin: dpavlin | 2007-04-01 22:42:35 +0200
hush test without --debug
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@811
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:38 +0000 (21:47 +0000)]
r1178@llin: dpavlin | 2007-04-01 22:39:11 +0200
cleanup debug output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@810
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:36 +0000 (21:47 +0000)]
r1176@llin: dpavlin | 2007-04-01 16:20:40 +0200
add _database:database_name so we can search for it using full-text as opposed to atribute
search (this might handy when emulating number of results for each database
from single merged index)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@809
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 14:15:08 +0000 (14:15 +0000)]
added test modify rules
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@808
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 12:26:25 +0000 (12:26 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@807
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Mar 2007 13:03:11 +0000 (13:03 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@806
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 2 Mar 2007 00:34:22 +0000 (00:34 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@805
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 2 Mar 2007 00:32:50 +0000 (00:32 +0000)]
argh. I run into inode problem: too many files on ext3 fs
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@804
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 2 Mar 2007 00:32:21 +0000 (00:32 +0000)]
added --[no-]marc-generate
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@803
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 15 Feb 2007 22:43:03 +0000 (22:43 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@802
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 15 Feb 2007 22:42:51 +0000 (22:42 +0000)]
more things
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@801
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 23:10:18 +0000 (23:10 +0000)]
decorate output from regexp modify with filename and line
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@800
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 15:09:01 +0000 (15:09 +0000)]
minor tweaks to test modify_file
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@799
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 13:31:38 +0000 (13:31 +0000)]
store filter (no tests for it, though!)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@798
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 13:28:30 +0000 (13:28 +0000)]
finish tweaking mock framework, test and fix problem with slashes in modify_record
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@797
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 12:42:43 +0000 (12:42 +0000)]
a try at mocking of inputs in WebPAC::Input::Test
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@796
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 12:37:42 +0000 (12:37 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@795
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 12:20:54 +0000 (12:20 +0000)]
modify record test which fails (with slash /), tweaks
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@794
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 12:19:51 +0000 (12:19 +0000)]
small tweaks on seek
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@793
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 30 Jan 2007 18:23:53 +0000 (18:23 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@792
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 30 Jan 2007 18:21:17 +0000 (18:21 +0000)]
added count
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@791
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 13 Dec 2006 10:08:27 +0000 (10:08 +0000)]
r1154@llin: dpavlin | 2006-12-13 11:13:28 +0100
added -h option using Pod::Usage
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@790
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 10 Dec 2006 12:57:16 +0000 (12:57 +0000)]
mark new things implemented
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@789
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 10 Dec 2006 12:56:59 +0000 (12:56 +0000)]
better logging
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@788
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 10 Dec 2006 12:56:05 +0000 (12:56 +0000)]
test marc_remove('*')
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@787
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 10 Dec 2006 12:45:11 +0000 (12:45 +0000)]
added support for marc_remove('*') to clean whole
marc record after marc_dumplicate
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@786
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 6 Dec 2006 23:44:36 +0000 (23:44 +0000)]
added get and set to create in-memory hash
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@785
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 6 Dec 2006 23:43:45 +0000 (23:43 +0000)]
added regex: to modify_records
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@784
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 6 Dec 2006 23:42:20 +0000 (23:42 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@783
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 16:51:49 +0000 (16:51 +0000)]
r1144@llin: dpavlin | 2006-11-05 17:51:38 +0100
report error message on errors
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@782
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 15:03:59 +0000 (15:03 +0000)]
r1141@llin: dpavlin | 2006-11-05 16:03:48 +0100
subset of Project Gutenberg catalog.rdf for testing
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@781
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 15:03:54 +0000 (15:03 +0000)]
r1140@llin: dpavlin | 2006-11-05 16:03:25 +0100
WebPAC::Input::Gutenberg needs XML::LibXML
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@780
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 14:52:04 +0000 (14:52 +0000)]
r1137@llin: dpavlin | 2006-11-05 15:51:19 +0100
no need to have MFN twice in record (it is also added by _to_hash)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@779
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 14:51:59 +0000 (14:51 +0000)]
r1136@llin: dpavlin | 2006-11-05 15:49:50 +0100
debug shouldn't auto-vivify all fields!
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@778
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 14:48:12 +0000 (14:48 +0000)]
r1133@llin: dpavlin | 2006-11-05 15:48:00 +0100
first cut at getting Project Gutenberg's RDF as input format for WebPAC
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@777
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 14:48:06 +0000 (14:48 +0000)]
r1132@llin: dpavlin | 2006-11-05 14:58:01 +0100
cleanup
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@776
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 12:28:37 +0000 (12:28 +0000)]
r1130@llin: dpavlin | 2006-11-05 13:29:36 +0100
rotate log file on startup
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@775
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:56:21 +0000 (20:56 +0000)]
another swiping API change: input->dump is gone, replaced
with input->dump_ascii which is more understandable.
If you want to override default behaviour
(which is to use Data::Dump's dump in input->fetch_rec)
define dump_ascii in low-level WebPAC::Input:: API
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@774
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:41:12 +0000 (20:41 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@773
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:40:38 +0000 (20:40 +0000)]
r1124@llin: dpavlin | 2006-11-03 21:39:00 +0100
use MARC::Fast 0.05 to_ascii to implement dump_rec
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@772
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:40:33 +0000 (20:40 +0000)]
r1123@llin: dpavlin | 2006-11-03 21:38:14 +0100
implement fallback dump if low-level API isn't exposing dump_rec [0.15]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@771
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:21:14 +0000 (20:21 +0000)]
r1120@llin: dpavlin | 2006-11-03 21:22:05 +0100
pod fix
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@770
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:21:09 +0000 (20:21 +0000)]
r1119@llin: dpavlin | 2006-11-03 21:21:35 +0100
--validate will automatically turn on --stats and won't produce
any output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@769
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 19:41:28 +0000 (19:41 +0000)]
r1117@llin: dpavlin | 2006-11-03 20:42:24 +0100
cleanup API a bit. validate_errors in now validate_rec [0.10]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@768
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 31 Oct 2006 13:44:42 +0000 (13:44 +0000)]
r1115@llin: dpavlin | 2006-10-31 14:45:15 +0100
fix unit test by removing old lookup code (but, it's missing new one now)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@767
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 31 Oct 2006 13:19:47 +0000 (13:19 +0000)]
r1113@llin: dpavlin | 2006-10-31 14:17:02 +0100
cleanup normalization error message for lookups and modify tests so they don't fail anymore
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@766
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 21:01:51 +0000 (21:01 +0000)]
moved two more dump()s to closure, saving 2/3rd of memory and some CPU time on
output which is not needed without debug level
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@765
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 20:53:48 +0000 (20:53 +0000)]
report time needed to store lookup to disk
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@764
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 20:53:14 +0000 (20:53 +0000)]
refresh progress bar at least every 2 seconds (helps on huge databases where
percentages increase too slowly)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@763
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 18:54:45 +0000 (18:54 +0000)]
use save_row and load_row to share data between lookups
and input->fetch, added some timing for loading of lookups
which revealed a big performance impact of one debug(dump())
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@762
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 17:10:08 +0000 (17:10 +0000)]
implemented load_row and save_row closures to serialize
input databases (using WebPAC::Store probably).
This will allow lookups to share on-disk storage with
low_mem option of WebPAC::Input, which is now gone
(under pressure of 600000+ record database which we
are now testing on)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@761
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 15:56:44 +0000 (15:56 +0000)]
Turn on option low_mem (which need rewrite to use db/row) if there
are more than 10000 rows (hardcoded, but should go away).
This prevents webpac from running out of memory with databases
of about 300000 records on 4Gb of (virtual) memory.
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@760
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 11:03:45 +0000 (11:03 +0000)]
status update
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@759
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 11:02:36 +0000 (11:02 +0000)]
local config
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@758
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 10 Oct 2006 10:57:59 +0000 (10:57 +0000)]
fix dump (ugly, needs re-visiting)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@757
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Mon, 9 Oct 2006 13:37:34 +0000 (13:37 +0000)]
r1099@llin: dpavlin | 2006-10-09 15:34:12 +0200
one more thing done for lookups
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@756
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 20:28:17 +0000 (20:28 +0000)]
r1097@llin: dpavlin | 2006-10-08 22:24:54 +0200
replaced generate_marc with universal have_rules [0.08]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@755
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 18:44:42 +0000 (18:44 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@754
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 18:43:58 +0000 (18:43 +0000)]
sort marc fields in output [0.04]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@753
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 18:21:26 +0000 (18:21 +0000)]
move warns to debug level
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@752
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 13:25:11 +0000 (13:25 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@751
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 8 Oct 2006 13:24:46 +0000 (13:24 +0000)]
make rec() a bit more clever about returning values [0.23]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@750
07558da8-63fa-0310-ba24-
9fe276d99e06
projects / webpac2 / log