Dobrica Pavlinusic [Sun, 27 May 2007 19:25:57 +0000 (19:25 +0000)]
fix must_exist name
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@861
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 19:10:43 +0000 (19:10 +0000)]
call low-level dump_ascii as it should
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@860
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 17:44:10 +0000 (17:44 +0000)]
local rename
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@859
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 17:09:47 +0000 (17:09 +0000)]
test validate with different files and hopefully correct problems about it
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@858
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 16:49:15 +0000 (16:49 +0000)]
implemented read_validate_file and read_validate_delimiters file, so you can
now change paths and data for each input (which run.pl does if you use
$database and/or $input variable substitution)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@857
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 16:00:26 +0000 (16:00 +0000)]
added fill_in to create dynamic values and some tests
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@856
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 14:44:58 +0000 (14:44 +0000)]
r1267@llin: dpavlin | 2007-05-27 16:44:54 +0200
sort fields in stats
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@855
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 14:35:48 +0000 (14:35 +0000)]
r1265@llin: dpavlin | 2007-05-27 16:15:19 +0200
more profile examples
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@854
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 14:09:30 +0000 (14:09 +0000)]
r1263@llin: dpavlin | 2007-05-27 14:36:00 +0200
one less dump in debug mode
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@853
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 11:27:12 +0000 (11:27 +0000)]
r1261@llin: dpavlin | 2007-05-27 13:27:55 +0200
profiling: add sub { dump( ) } for $log->debug
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@852
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 11:14:40 +0000 (11:14 +0000)]
r1258@llin: dpavlin | 2007-05-27 13:14:58 +0200
Changed delimiter_templates arguments to be more intuitive,
disable MARC generation when running delimiters validation
(this is just disk overhead)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@851
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 10:50:39 +0000 (10:50 +0000)]
r1254@llin: dpavlin | 2007-05-27 12:51:21 +0200
typo
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@850
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 10:50:37 +0000 (10:50 +0000)]
r1253@llin: dpavlin | 2007-05-27 12:49:54 +0200
added accumulated delimiters templates to hold all templates which are
found in this run (and thus saved to --validate-delimiters file) while
generating correct stats for each input
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@849
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 10:45:40 +0000 (10:45 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@848
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 09:53:54 +0000 (09:53 +0000)]
r1250@llin: dpavlin | 2007-05-27 11:54:28 +0200
test creation of new file, hush debugging output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@847
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 09:53:52 +0000 (09:53 +0000)]
r1249@llin: dpavlin | 2007-05-27 11:49:30 +0200
fix temp file handling
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@846
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 27 May 2007 09:39:44 +0000 (09:39 +0000)]
bug fix
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@845
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sat, 26 May 2007 10:40:01 +0000 (10:40 +0000)]
work with fields which have number 0 (as opposed to 000) which has been
noticed in the wild (invalid, but --stats shouldn't really die)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@844
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 25 May 2007 19:49:39 +0000 (19:49 +0000)]
different wording: potentially invalid combination
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@843
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 25 May 2007 19:48:02 +0000 (19:48 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@842
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 25 May 2007 19:47:43 +0000 (19:47 +0000)]
hush warning
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@841
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 14:42:40 +0000 (14:42 +0000)]
r1237@llin: dpavlin | 2007-05-24 16:42:47 +0200
if validate file exists, it will create file with .new extension
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@840
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 14:42:38 +0000 (14:42 +0000)]
r1236@llin: dpavlin | 2007-05-24 16:38:02 +0200
require path or delimiters_path
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@839
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 14:42:35 +0000 (14:42 +0000)]
r1235@llin: dpavlin | 2007-05-24 16:34:31 +0200
and make it really work :-)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@838
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 12:44:45 +0000 (12:44 +0000)]
r1232@llin: dpavlin | 2007-05-24 14:44:53 +0200
added storing and retriving of delimiters templates to file and some basic tests
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@837
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 12:44:43 +0000 (12:44 +0000)]
r1231@llin: dpavlin | 2007-05-24 13:00:25 +0200
tidy machine readable output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@836
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 10:53:50 +0000 (10:53 +0000)]
r1228@llin: dpavlin | 2007-05-24 12:53:57 +0200
report invalid delimiter combinations
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@835
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 24 May 2007 10:53:48 +0000 (10:53 +0000)]
r1227@llin: dpavlin | 2007-05-24 10:26:01 +0200
generate humanly readable report or machine readable
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@834
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 23 May 2007 20:04:13 +0000 (20:04 +0000)]
r1225@llin: dpavlin | 2007-05-23 22:04:17 +0200
use delimiters from config.yml file and dump report to file
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@833
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 23 May 2007 20:03:16 +0000 (20:03 +0000)]
r1221@llin: dpavlin | 2007-05-20 22:43:38 +0200
added delimiters_templates report
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@832
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 23 May 2007 20:03:14 +0000 (20:03 +0000)]
r1220@llin: dpavlin | 2007-05-20 19:29:36 +0200
can be called for fields without subfields now...
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@831
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 23 May 2007 20:03:12 +0000 (20:03 +0000)]
r1219@llin: dpavlin | 2007-05-20 19:28:41 +0200
cleanup debugging output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@830
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 20 May 2007 16:19:19 +0000 (16:19 +0000)]
r1214@llin: dpavlin | 2007-05-20 18:19:12 +0200
more sample data
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@829
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 20 May 2007 16:19:17 +0000 (16:19 +0000)]
r1213@llin: dpavlin | 2007-05-20 18:16:02 +0200
and fix to actually count right templates :-)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@828
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 20 May 2007 16:19:16 +0000 (16:19 +0000)]
r1212@llin: dpavlin | 2007-05-20 17:39:01 +0200
first try at implementation of delimiters validation
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@827
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 20 May 2007 16:19:13 +0000 (16:19 +0000)]
r1211@llin: dpavlin | 2007-05-20 14:48:37 +0200
Removed debugging output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@826
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 18 May 2007 21:41:19 +0000 (21:41 +0000)]
request Biblio::Isis 0.24 to ignore empty subfields
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@825
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 18 May 2007 20:27:21 +0000 (20:27 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@824
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 12:22:37 +0000 (12:22 +0000)]
r1203@llin: dpavlin | 2007-04-11 14:22:28 +0200
spacial handling for empty subfields [0.18]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@823
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 12:22:35 +0000 (12:22 +0000)]
r1202@llin: dpavlin | 2007-04-11 14:00:20 +0200
remove empty subfield test data
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@822
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 12:22:33 +0000 (12:22 +0000)]
r1201@llin: dpavlin | 2007-04-11 13:54:24 +0200
refactor filter tests
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@821
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 12:22:31 +0000 (12:22 +0000)]
r1200@llin: dpavlin | 2007-04-11 13:38:57 +0200
cleanup test (call patch /fake/ because they are),
added test which fails because of empty subfield modify bug
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@820
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 11 Apr 2007 10:09:34 +0000 (10:09 +0000)]
r1198@llin: dpavlin | 2007-04-11 12:09:29 +0200
prefix, suffix and surround now work correcty with empty strings and zeros
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@819
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 5 Apr 2007 21:53:52 +0000 (21:53 +0000)]
fix warning
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@818
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 5 Apr 2007 21:50:14 +0000 (21:50 +0000)]
use debug level to, well, display debug
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@817
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 5 Apr 2007 21:48:41 +0000 (21:48 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@816
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Mon, 2 Apr 2007 17:20:01 +0000 (17:20 +0000)]
r1192@llin: dpavlin | 2007-04-02 19:20:01 +0200
added support for fix-length fields using marc_fixed [2.29]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@815
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:48 +0000 (21:47 +0000)]
r1185@llin: dpavlin | 2007-04-01 23:47:05 +0200
r1183@llin: dpavlin | 2007-04-01 23:47:01 +0200
propagate changes through documentation and actuall running code :-)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@814
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:47 +0000 (21:47 +0000)]
r1184@llin: dpavlin | 2007-04-01 23:47:04 +0200
r1182@llin: dpavlin | 2007-04-01 23:44:03 +0200
marc_duplicate now correctly duplicates leader data, new _get_marc_leader to
return leader corresponding to last _get_marc_fields call, added marc_count
which returns number of created MARC records
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@813
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:42 +0000 (21:47 +0000)]
r1181@llin: dpavlin | 2007-04-01 22:47:56 +0200
r1180@llin: dpavlin | 2007-04-01 22:47:43 +0200
renamed $leader to $marc_leader to be consistent with other vars
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@812
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:40 +0000 (21:47 +0000)]
r1179@llin: dpavlin | 2007-04-01 22:42:35 +0200
hush test without --debug
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@811
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:38 +0000 (21:47 +0000)]
r1178@llin: dpavlin | 2007-04-01 22:39:11 +0200
cleanup debug output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@810
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 21:47:36 +0000 (21:47 +0000)]
r1176@llin: dpavlin | 2007-04-01 16:20:40 +0200
add _database:database_name so we can search for it using full-text as opposed to atribute
search (this might handy when emulating number of results for each database
from single merged index)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@809
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 14:15:08 +0000 (14:15 +0000)]
added test modify rules
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@808
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 1 Apr 2007 12:26:25 +0000 (12:26 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@807
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Mar 2007 13:03:11 +0000 (13:03 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@806
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 2 Mar 2007 00:34:22 +0000 (00:34 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@805
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 2 Mar 2007 00:32:50 +0000 (00:32 +0000)]
argh. I run into inode problem: too many files on ext3 fs
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@804
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 2 Mar 2007 00:32:21 +0000 (00:32 +0000)]
added --[no-]marc-generate
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@803
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 15 Feb 2007 22:43:03 +0000 (22:43 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@802
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Thu, 15 Feb 2007 22:42:51 +0000 (22:42 +0000)]
more things
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@801
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 23:10:18 +0000 (23:10 +0000)]
decorate output from regexp modify with filename and line
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@800
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 15:09:01 +0000 (15:09 +0000)]
minor tweaks to test modify_file
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@799
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 13:31:38 +0000 (13:31 +0000)]
store filter (no tests for it, though!)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@798
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 13:28:30 +0000 (13:28 +0000)]
finish tweaking mock framework, test and fix problem with slashes in modify_record
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@797
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 12:42:43 +0000 (12:42 +0000)]
a try at mocking of inputs in WebPAC::Input::Test
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@796
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 12:37:42 +0000 (12:37 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@795
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 12:20:54 +0000 (12:20 +0000)]
modify record test which fails (with slash /), tweaks
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@794
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 4 Feb 2007 12:19:51 +0000 (12:19 +0000)]
small tweaks on seek
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@793
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 30 Jan 2007 18:23:53 +0000 (18:23 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@792
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 30 Jan 2007 18:21:17 +0000 (18:21 +0000)]
added count
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@791
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 13 Dec 2006 10:08:27 +0000 (10:08 +0000)]
r1154@llin: dpavlin | 2006-12-13 11:13:28 +0100
added -h option using Pod::Usage
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@790
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 10 Dec 2006 12:57:16 +0000 (12:57 +0000)]
mark new things implemented
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@789
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 10 Dec 2006 12:56:59 +0000 (12:56 +0000)]
better logging
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@788
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 10 Dec 2006 12:56:05 +0000 (12:56 +0000)]
test marc_remove('*')
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@787
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 10 Dec 2006 12:45:11 +0000 (12:45 +0000)]
added support for marc_remove('*') to clean whole
marc record after marc_dumplicate
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@786
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 6 Dec 2006 23:44:36 +0000 (23:44 +0000)]
added get and set to create in-memory hash
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@785
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 6 Dec 2006 23:43:45 +0000 (23:43 +0000)]
added regex: to modify_records
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@784
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 6 Dec 2006 23:42:20 +0000 (23:42 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@783
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 16:51:49 +0000 (16:51 +0000)]
r1144@llin: dpavlin | 2006-11-05 17:51:38 +0100
report error message on errors
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@782
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 15:03:59 +0000 (15:03 +0000)]
r1141@llin: dpavlin | 2006-11-05 16:03:48 +0100
subset of Project Gutenberg catalog.rdf for testing
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@781
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 15:03:54 +0000 (15:03 +0000)]
r1140@llin: dpavlin | 2006-11-05 16:03:25 +0100
WebPAC::Input::Gutenberg needs XML::LibXML
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@780
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 14:52:04 +0000 (14:52 +0000)]
r1137@llin: dpavlin | 2006-11-05 15:51:19 +0100
no need to have MFN twice in record (it is also added by _to_hash)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@779
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 14:51:59 +0000 (14:51 +0000)]
r1136@llin: dpavlin | 2006-11-05 15:49:50 +0100
debug shouldn't auto-vivify all fields!
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@778
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 14:48:12 +0000 (14:48 +0000)]
r1133@llin: dpavlin | 2006-11-05 15:48:00 +0100
first cut at getting Project Gutenberg's RDF as input format for WebPAC
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@777
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 14:48:06 +0000 (14:48 +0000)]
r1132@llin: dpavlin | 2006-11-05 14:58:01 +0100
cleanup
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@776
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Sun, 5 Nov 2006 12:28:37 +0000 (12:28 +0000)]
r1130@llin: dpavlin | 2006-11-05 13:29:36 +0100
rotate log file on startup
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@775
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:56:21 +0000 (20:56 +0000)]
another swiping API change: input->dump is gone, replaced
with input->dump_ascii which is more understandable.
If you want to override default behaviour
(which is to use Data::Dump's dump in input->fetch_rec)
define dump_ascii in low-level WebPAC::Input:: API
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@774
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:41:12 +0000 (20:41 +0000)]
local
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@773
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:40:38 +0000 (20:40 +0000)]
r1124@llin: dpavlin | 2006-11-03 21:39:00 +0100
use MARC::Fast 0.05 to_ascii to implement dump_rec
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@772
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:40:33 +0000 (20:40 +0000)]
r1123@llin: dpavlin | 2006-11-03 21:38:14 +0100
implement fallback dump if low-level API isn't exposing dump_rec [0.15]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@771
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:21:14 +0000 (20:21 +0000)]
r1120@llin: dpavlin | 2006-11-03 21:22:05 +0100
pod fix
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@770
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 20:21:09 +0000 (20:21 +0000)]
r1119@llin: dpavlin | 2006-11-03 21:21:35 +0100
--validate will automatically turn on --stats and won't produce
any output
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@769
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Fri, 3 Nov 2006 19:41:28 +0000 (19:41 +0000)]
r1117@llin: dpavlin | 2006-11-03 20:42:24 +0100
cleanup API a bit. validate_errors in now validate_rec [0.10]
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@768
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 31 Oct 2006 13:44:42 +0000 (13:44 +0000)]
r1115@llin: dpavlin | 2006-10-31 14:45:15 +0100
fix unit test by removing old lookup code (but, it's missing new one now)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@767
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Tue, 31 Oct 2006 13:19:47 +0000 (13:19 +0000)]
r1113@llin: dpavlin | 2006-10-31 14:17:02 +0100
cleanup normalization error message for lookups and modify tests so they don't fail anymore
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@766
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 21:01:51 +0000 (21:01 +0000)]
moved two more dump()s to closure, saving 2/3rd of memory and some CPU time on
output which is not needed without debug level
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@765
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 20:53:48 +0000 (20:53 +0000)]
report time needed to store lookup to disk
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@764
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 20:53:14 +0000 (20:53 +0000)]
refresh progress bar at least every 2 seconds (helps on huge databases where
percentages increase too slowly)
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@763
07558da8-63fa-0310-ba24-
9fe276d99e06
Dobrica Pavlinusic [Wed, 25 Oct 2006 18:54:45 +0000 (18:54 +0000)]
use save_row and load_row to share data between lookups
and input->fetch, added some timing for loading of lookups
which revealed a big performance impact of one debug(dump())
git-svn-id: svn+ssh://mjesec/home/dpavlin/svn/webpac2/trunk@762
07558da8-63fa-0310-ba24-
9fe276d99e06
projects / webpac2 / log