MojoFacets.git
12 years agomore perl modules availabe in debian packages
Dobrica Pavlinusic [Thu, 22 Sep 2011 08:03:19 +0000 (10:03 +0200)]
more perl modules availabe in debian packages

12 years agocreate lable from pool name (for bonnie)
Dobrica Pavlinusic [Mon, 19 Sep 2011 13:32:26 +0000 (15:32 +0200)]
create lable from pool name (for bonnie)

12 years agooffer reload instead of remove for changed files
Dobrica Pavlinusic [Sun, 18 Sep 2011 20:49:49 +0000 (22:49 +0200)]
offer reload instead of remove for changed files

12 years agoconfigure with gnuplot style via parameter
Dobrica Pavlinusic [Sun, 18 Sep 2011 19:23:21 +0000 (21:23 +0200)]
configure with gnuplot style via parameter

12 years agoextract number of drives, cache and log from pool name
Dobrica Pavlinusic [Sun, 18 Sep 2011 13:24:30 +0000 (15:24 +0200)]
extract number of drives, cache and log from pool name

12 years agoreformat bonnie++ latency into ms
Dobrica Pavlinusic [Sun, 18 Sep 2011 12:41:48 +0000 (14:41 +0200)]
reformat bonnie++ latency into ms

12 years agoMerge branch 'master' of github.com:dpavlin/MojoFacets
Dobrica Pavlinusic [Sun, 18 Sep 2011 11:20:07 +0000 (13:20 +0200)]
Merge branch 'master' of github.com:dpavlin/MojoFacets

12 years agorefactor save_action to save only params
Dobrica Pavlinusic [Fri, 8 Jul 2011 12:23:17 +0000 (14:23 +0200)]
refactor save_action to save only params

12 years agouse Mojo::UserAgent instead of Mojo::Client
Dobrica Pavlinusic [Fri, 8 Jul 2011 10:00:35 +0000 (12:00 +0200)]
use Mojo::UserAgent instead of Mojo::Client

13 years agoMerge branch 'master' of git.rot13.org:/git/MojoFacets
Dobrica Pavlinusic [Thu, 26 May 2011 12:40:29 +0000 (14:40 +0200)]
Merge branch 'master' of git.rot13.org:/git/MojoFacets

13 years agouse Text::CSV for CSV files
Dobrica Pavlinusic [Thu, 26 May 2011 12:38:59 +0000 (14:38 +0200)]
use Text::CSV for CSV files

This does remove support for semicolumn separated files and special
format in which second line is header (instead of first one), but
our own CSV parser was subtly wrong in some corner cases, so
corectess wins.

13 years agowe really need Module::Install for Makefile.PL
Dobrica Pavlinusic [Thu, 26 May 2011 12:38:42 +0000 (14:38 +0200)]
we really need Module::Install for Makefile.PL

13 years agodon't die on _param_scalar without default
Dobrica Pavlinusic [Sun, 22 May 2011 20:29:40 +0000 (22:29 +0200)]
don't die on _param_scalar without default

13 years agoconvert @row->{foo} into @{$row->{foo}}
Dobrica Pavlinusic [Thu, 14 Apr 2011 16:42:13 +0000 (18:42 +0200)]
convert @row->{foo} into @{$row->{foo}}

13 years agoMerge branch 'master' of mjesec.ffzg.hr:/git/MojoFacets
Dobrica Pavlinusic [Sun, 3 Apr 2011 19:55:00 +0000 (21:55 +0200)]
Merge branch 'master' of mjesec.ffzg.hr:/git/MojoFacets

13 years agomore robust _hash_eq
Dobrica Pavlinusic [Sun, 3 Apr 2011 19:54:30 +0000 (21:54 +0200)]
more robust _hash_eq

13 years agodump lookup debug with new config option
Dobrica Pavlinusic [Fri, 1 Apr 2011 16:27:54 +0000 (18:27 +0200)]
dump lookup debug with new config option

13 years agodon't set generated on own storable files, since they are disk-based
Dobrica Pavlinusic [Thu, 31 Mar 2011 21:47:15 +0000 (23:47 +0200)]
don't set generated on own storable files, since they are disk-based

13 years agoexample for repeatable or non-repeatable values
Dobrica Pavlinusic [Thu, 31 Mar 2011 19:00:02 +0000 (21:00 +0200)]
example for repeatable or non-repeatable values

13 years agofix current dataset scalar value for lookup
Dobrica Pavlinusic [Thu, 31 Mar 2011 18:33:35 +0000 (20:33 +0200)]
fix current dataset scalar value for lookup

13 years agoprovide Statistics::Descriptive callback for repeatable values
Dobrica Pavlinusic [Thu, 31 Mar 2011 18:27:47 +0000 (20:27 +0200)]
provide Statistics::Descriptive callback for repeatable values

13 years agosimple lookup on scalar values
Dobrica Pavlinusic [Thu, 31 Mar 2011 17:47:43 +0000 (19:47 +0200)]
simple lookup on scalar values

13 years agoremove some of debug
Dobrica Pavlinusic [Thu, 31 Mar 2011 17:42:25 +0000 (19:42 +0200)]
remove some of debug

13 years agofuzzy select lookup dataset name
Dobrica Pavlinusic [Thu, 31 Mar 2011 17:40:18 +0000 (19:40 +0200)]
fuzzy select lookup dataset name

13 years agosupport scalar values in lookup
Dobrica Pavlinusic [Thu, 31 Mar 2011 17:32:31 +0000 (19:32 +0200)]
support scalar values in lookup

13 years agosupport loading of /tmp/mojofacets.*.storable
Dobrica Pavlinusic [Thu, 31 Mar 2011 16:27:30 +0000 (18:27 +0200)]
support loading of /tmp/mojofacets.*.storable

13 years agolookup into different dataset
Dobrica Pavlinusic [Thu, 31 Mar 2011 16:01:40 +0000 (18:01 +0200)]
lookup into different dataset

using syntax like:

lookup($row->{from}, 'on_path' => 'on_col', sub {
# $on is record from on_path dataset
# where $on_col matches $row->{$from}

map {
push @{$update->{on_id}} => $_;
} @{$on->{id2}}
});

13 years agotreat NULL (undef) from SQL correctly as empty or _missing
Dobrica Pavlinusic [Thu, 3 Feb 2011 15:45:53 +0000 (16:45 +0100)]
treat NULL (undef) from SQL correctly as empty or _missing

13 years agoallow spaces in $row->{'field with space'}
Dobrica Pavlinusic [Sun, 16 Jan 2011 19:46:48 +0000 (20:46 +0100)]
allow spaces in $row->{'field with space'}

13 years agowe have stub for console.debug only
Dobrica Pavlinusic [Sun, 16 Jan 2011 19:29:20 +0000 (20:29 +0100)]
we have stub for console.debug only

13 years agoonly load code
Dobrica Pavlinusic [Sat, 15 Jan 2011 14:09:10 +0000 (15:09 +0100)]
only load code

leaving dependencies and description unset

13 years agoall code just loads snippets without dependencies
Dobrica Pavlinusic [Sat, 15 Jan 2011 13:02:01 +0000 (14:02 +0100)]
all code just loads snippets without dependencies

before it also tried to test them, and transfer (non-existant) dependency
information and description both of which are (probably) wrong because
you just want to modify that code snippet to fit current dataset

13 years agoinvalidate filters on other datasets
Dobrica Pavlinusic [Fri, 14 Jan 2011 18:39:47 +0000 (19:39 +0100)]
invalidate filters on other datasets

13 years agoadded </tt> for filename
Dobrica Pavlinusic [Fri, 14 Jan 2011 18:22:50 +0000 (19:22 +0100)]
added </tt> for filename

13 years agodrop down to switch datasets loaded in items display
Dobrica Pavlinusic [Fri, 14 Jan 2011 15:51:11 +0000 (16:51 +0100)]
drop down to switch datasets loaded in items display

13 years agoignore double clicks on cells in edit mode
Dobrica Pavlinusic [Fri, 14 Jan 2011 14:27:48 +0000 (15:27 +0100)]
ignore double clicks on cells in edit mode

13 years agoMerge branch 'master' of github.com:dpavlin/MojoFacets
Dobrica Pavlinusic [Wed, 12 Jan 2011 19:42:12 +0000 (20:42 +0100)]
Merge branch 'master' of github.com:dpavlin/MojoFacets

13 years agosource-changed compares old and current value
Dobrica Pavlinusic [Wed, 12 Jan 2011 19:41:12 +0000 (20:41 +0100)]
source-changed compares old and current value

13 years agosupport multi-line "foo\nbar" CSV fields
Dobrica Pavlinusic [Wed, 12 Jan 2011 15:01:29 +0000 (16:01 +0100)]
support multi-line "foo\nbar" CSV fields

13 years agouse full_path
Dobrica Pavlinusic [Wed, 12 Jan 2011 14:39:50 +0000 (15:39 +0100)]
use full_path

13 years agouse user= and password= from *.sql file for auth
Dobrica Pavlinusic [Wed, 29 Dec 2010 10:56:39 +0000 (11:56 +0100)]
use user= and password= from *.sql file for auth

Similar to .my.cnf format, so you can just copy/paste credentials

13 years agoexample SQL file with dbi included in comment
Dobrica Pavlinusic [Tue, 28 Dec 2010 17:02:17 +0000 (18:02 +0100)]
example SQL file with dbi included in comment

13 years agofix header extraction from query
Dobrica Pavlinusic [Tue, 28 Dec 2010 16:52:22 +0000 (17:52 +0100)]
fix header extraction from query

13 years agoadded MojoFacets::Import::SQL
Dobrica Pavlinusic [Tue, 28 Dec 2010 16:50:23 +0000 (17:50 +0100)]
added MojoFacets::Import::SQL

13 years agouse full_path
Dobrica Pavlinusic [Tue, 28 Dec 2010 16:49:48 +0000 (17:49 +0100)]
use full_path

13 years agouse full_path
Dobrica Pavlinusic [Tue, 28 Dec 2010 16:48:59 +0000 (17:48 +0100)]
use full_path

13 years agoimport data from SQL database using DBI
Dobrica Pavlinusic [Tue, 28 Dec 2010 16:44:57 +0000 (17:44 +0100)]
import data from SQL database using DBI

13 years agodocument import from CouchDB
Dobrica Pavlinusic [Fri, 24 Dec 2010 15:19:26 +0000 (16:19 +0100)]
document import from CouchDB

13 years agoimport CouchDB views
Dobrica Pavlinusic [Fri, 24 Dec 2010 15:19:21 +0000 (16:19 +0100)]
import CouchDB views

13 years agoremove storable file also unloads it from memory
Dobrica Pavlinusic [Wed, 22 Dec 2010 11:12:31 +0000 (12:12 +0100)]
remove storable file also unloads it from memory

13 years agomake repeatable field uppercase
Dobrica Pavlinusic [Thu, 16 Dec 2010 17:49:13 +0000 (18:49 +0100)]
make repeatable field uppercase

13 years agostore added column in description on test of code
Dobrica Pavlinusic [Thu, 16 Dec 2010 17:46:41 +0000 (18:46 +0100)]
store added column in description on test of code

13 years agoextract dependent columns using evil regex
Dobrica Pavlinusic [Thu, 16 Dec 2010 17:44:21 +0000 (18:44 +0100)]
extract dependent columns using evil regex

13 years agouse _ as separator foo.bar.baz -> foo_bar_baz
Dobrica Pavlinusic [Thu, 16 Dec 2010 17:28:17 +0000 (18:28 +0100)]
use _ as separator foo.bar.baz -> foo_bar_baz

This allows writing of column names without quotes and doesn't
conflict with dot usage for code snippets

13 years agofix _design doc skipping
Dobrica Pavlinusic [Wed, 15 Dec 2010 18:02:32 +0000 (19:02 +0100)]
fix _design doc skipping

13 years agoskip CouchDB _design documents
Dobrica Pavlinusic [Tue, 14 Dec 2010 21:50:32 +0000 (22:50 +0100)]
skip CouchDB _design documents

13 years agoflatten CouchDB documents for MojoFacets
Dobrica Pavlinusic [Tue, 14 Dec 2010 21:30:13 +0000 (22:30 +0100)]
flatten CouchDB documents for MojoFacets

13 years agoCouchDB _all_docs importer
Dobrica Pavlinusic [Tue, 14 Dec 2010 21:24:25 +0000 (22:24 +0100)]
CouchDB _all_docs importer

13 years agoimprove CSV delimiter heuristics
Dobrica Pavlinusic [Fri, 10 Dec 2010 13:03:53 +0000 (14:03 +0100)]
improve CSV delimiter heuristics

13 years agorun with arbitrary CSV file
Dobrica Pavlinusic [Fri, 10 Dec 2010 13:01:25 +0000 (14:01 +0100)]
run with arbitrary CSV file

13 years agoredirect to /data/load without dataset
Dobrica Pavlinusic [Sun, 31 Oct 2010 09:32:32 +0000 (10:32 +0100)]
redirect to /data/load without dataset

13 years agocomment out filters which can be huge
Dobrica Pavlinusic [Fri, 29 Oct 2010 20:13:14 +0000 (22:13 +0200)]
comment out filters which can be huge

13 years agouse return $self->redirect_to all over the place
Dobrica Pavlinusic [Fri, 29 Oct 2010 19:20:39 +0000 (21:20 +0200)]
use return $self->redirect_to all over the place

this fixes redirections in newer Mojolicious and is more exact

13 years agouse local files only if available
Dobrica Pavlinusic [Fri, 29 Oct 2010 19:02:47 +0000 (21:02 +0200)]
use local files only if available

13 years agoMojo package is now in Mojolicious distribution
Dobrica Pavlinusic [Fri, 29 Oct 2010 17:28:19 +0000 (19:28 +0200)]
Mojo package is now in Mojolicious distribution

13 years agoMore dependencies on clean system
Dobrica Pavlinusic [Fri, 29 Oct 2010 17:19:51 +0000 (19:19 +0200)]
More dependencies on clean system

this makes perl Makefile.PL pass :-)

13 years agofirst install perl modules available in Debian
Dobrica Pavlinusic [Fri, 29 Oct 2010 17:15:27 +0000 (19:15 +0200)]
first install perl modules available in Debian

13 years agomove invalidation before $out processing
Dobrica Pavlinusic [Tue, 19 Oct 2010 15:35:23 +0000 (17:35 +0200)]
move invalidation before $out processing

This change allows us to write sequences like this:

$out->{eprints_id} ||= 700;
$update->{eprints_id} = $out->{eprints_id}++;

We use $out like global variable, and increment values for all
filtered fields

13 years agosplit filename into word and numeric part
Dobrica Pavlinusic [Tue, 19 Oct 2010 00:56:17 +0000 (02:56 +0200)]
split filename into word and numeric part

13 years agocleanup tabular data for eprints3 import
Dobrica Pavlinusic [Mon, 18 Oct 2010 19:47:30 +0000 (21:47 +0200)]
cleanup tabular data for eprints3 import

13 years agouse local copy of libraries
Dobrica Pavlinusic [Mon, 18 Oct 2010 19:46:44 +0000 (21:46 +0200)]
use local copy of libraries

13 years agoadded remove class on storable unlink
Dobrica Pavlinusic [Mon, 18 Oct 2010 19:46:26 +0000 (21:46 +0200)]
added remove class on storable unlink

13 years agofix quotes at begging of field
Dobrica Pavlinusic [Sat, 16 Oct 2010 19:25:56 +0000 (21:25 +0200)]
fix quotes at begging of field

13 years agoadd remove link to storable file size
Dobrica Pavlinusic [Sat, 16 Oct 2010 18:42:03 +0000 (20:42 +0200)]
add remove link to storable file size

13 years agofix quotes ("" for single quote)
Dobrica Pavlinusic [Sat, 16 Oct 2010 15:29:57 +0000 (17:29 +0200)]
fix quotes ("" for single quote)

13 years agostrip spaces around values
Dobrica Pavlinusic [Sat, 16 Oct 2010 15:13:26 +0000 (17:13 +0200)]
strip spaces around values

13 years agorewrite CSV parser to support "quoted" fiends
Dobrica Pavlinusic [Sat, 16 Oct 2010 15:06:52 +0000 (17:06 +0200)]
rewrite CSV parser to support "quoted" fiends

13 years agotest with first csv file in data dir
Dobrica Pavlinusic [Sat, 16 Oct 2010 14:57:00 +0000 (16:57 +0200)]
test with first csv file in data dir

13 years agochomp whitespaces before and after value
Dobrica Pavlinusic [Sat, 16 Oct 2010 12:58:32 +0000 (14:58 +0200)]
chomp whitespaces before and after value

13 years agostrip quotes around values with spaces
Dobrica Pavlinusic [Sat, 16 Oct 2010 12:55:01 +0000 (14:55 +0200)]
strip quotes around values with spaces

This still doesn't make us compliant CSV parser, since current code
*WILL* split csv wrongly if delimiter is inside quotes

13 years agouse utf-8 as default encoding for .cvs files
Dobrica Pavlinusic [Sat, 16 Oct 2010 12:47:42 +0000 (14:47 +0200)]
use utf-8 as default encoding for .cvs files

13 years agodocument csv file import
Dobrica Pavlinusic [Thu, 15 Jul 2010 09:56:24 +0000 (11:56 +0200)]
document csv file import

13 years agotest csv import
Dobrica Pavlinusic [Thu, 15 Jul 2010 09:28:23 +0000 (11:28 +0200)]
test csv import

13 years agouse encoding from .encoding.csv filename
Dobrica Pavlinusic [Thu, 15 Jul 2010 09:27:52 +0000 (11:27 +0200)]
use encoding from .encoding.csv filename

13 years agouse __export_path_name
Dobrica Pavlinusic [Sun, 11 Jul 2010 22:19:36 +0000 (00:19 +0200)]
use __export_path_name

This will ensure that we will get correct export path to draw

13 years agoadded __export_path_name
Dobrica Pavlinusic [Sun, 11 Jul 2010 22:18:50 +0000 (00:18 +0200)]
added __export_path_name

this allows us just to create mungled export name, shorter than
(hardcoded) 80 chars used for export files

13 years agodefault to , delimited csv
Dobrica Pavlinusic [Sun, 11 Jul 2010 21:44:47 +0000 (23:44 +0200)]
default to , delimited csv

Switch to ; delimited only if we don't have ; in first line
(which is some cruft in my file)

This allowes me to read in "normal" csv files with ease

13 years agolinks to dump loaded
Dobrica Pavlinusic [Thu, 8 Jul 2010 21:03:32 +0000 (23:03 +0200)]
links to dump loaded

13 years ago/debug/loaded/stats dumping
Dobrica Pavlinusic [Thu, 8 Jul 2010 18:00:43 +0000 (20:00 +0200)]
/debug/loaded/stats dumping

This is useful to get one more level of introspection into data
strcutures in memory

13 years agotake path from params in /data/items
Dobrica Pavlinusic [Thu, 8 Jul 2010 15:58:41 +0000 (17:58 +0200)]
take path from params in /data/items

This allows us to switch to different dataset on commit of changes, but
it DOESN'T change column definition under assumption that you are
applying changes to dataset which has more-or-less same structure

13 years agocleanup filter_regex code
Dobrica Pavlinusic [Thu, 1 Jul 2010 22:28:09 +0000 (00:28 +0200)]
cleanup filter_regex code

This makes it more readable and removes last traces of enter bug

13 years agoand really fix it
Dobrica Pavlinusic [Thu, 1 Jul 2010 20:59:36 +0000 (22:59 +0200)]
and really fix it

13 years agoforgot variable rename broke column regex
Dobrica Pavlinusic [Thu, 1 Jul 2010 20:52:02 +0000 (22:52 +0200)]
forgot variable rename broke column regex

13 years agosave selected column in views and load them
Dobrica Pavlinusic [Thu, 1 Jul 2010 20:35:33 +0000 (22:35 +0200)]
save selected column in views and load them

This allows easy switch between clusters (chunks) of columns
in similar scale for easy graphing

13 years agoremove diff output
Dobrica Pavlinusic [Thu, 1 Jul 2010 20:35:04 +0000 (22:35 +0200)]
remove diff output

it can be calculated on demand and will decrease storable size

13 years agoinsert column names in first line of export
Dobrica Pavlinusic [Wed, 30 Jun 2010 22:28:21 +0000 (00:28 +0200)]
insert column names in first line of export

commented with # in first column, and tab-delimited

13 years agotruncate export names longer than 80 chars
Dobrica Pavlinusic [Wed, 30 Jun 2010 22:26:37 +0000 (00:26 +0200)]
truncate export names longer than 80 chars

13 years agomove column_selection back to left for columns
Dobrica Pavlinusic [Wed, 30 Jun 2010 22:15:36 +0000 (00:15 +0200)]
move column_selection back to left for columns

span#column_selection doesn't need absolute positioning it doesn't have
span.count in front of it

13 years agoMerge branch 'master' of mjesec.ffzg.hr:/git/MojoFacets
Dobrica Pavlinusic [Wed, 30 Jun 2010 22:12:46 +0000 (00:12 +0200)]
Merge branch 'master' of mjesec.ffzg.hr:/git/MojoFacets

Conflicts:
templates/all_checkboxes.html.ep

13 years agodon't mess with tabindex
Dobrica Pavlinusic [Wed, 30 Jun 2010 21:58:11 +0000 (23:58 +0200)]
don't mess with tabindex

and don't trigger apply_regex on empty value