Dobrica Pavlinusic [Sun, 6 Jun 2010 16:04:45 +0000 (18:04 +0200)]
link to config to change MAX_FACETS
Dobrica Pavlinusic [Sun, 6 Jun 2010 15:59:37 +0000 (17:59 +0200)]
added config and move export to left
Dobrica Pavlinusic [Sun, 6 Jun 2010 15:52:23 +0000 (17:52 +0200)]
config MAX_FACETS
Dobrica Pavlinusic [Sun, 6 Jun 2010 15:46:20 +0000 (17:46 +0200)]
load only MAX_FACETS facets, 10000 by default
This will help in keeping memory usage in browser under 100Mb and
page load time resonable.
Dobrica Pavlinusic [Sun, 6 Jun 2010 14:54:19 +0000 (16:54 +0200)]
with empty session we don't need to die here
Dobrica Pavlinusic [Sun, 6 Jun 2010 12:17:39 +0000 (14:17 +0200)]
relax import regex
Dobrica Pavlinusic [Sun, 6 Jun 2010 12:14:02 +0000 (14:14 +0200)]
use File::Path mkpath to create export directories
Dobrica Pavlinusic [Sun, 6 Jun 2010 11:44:26 +0000 (13:44 +0200)]
import filters
Dobrica Pavlinusic [Sat, 5 Jun 2010 19:58:24 +0000 (21:58 +0200)]
fix sorting of columns with undef values
Dobrica Pavlinusic [Sat, 5 Jun 2010 19:50:51 +0000 (21:50 +0200)]
edit will just mark stats invalid by modified == 2
So, we use magic number 2 in modified to rebuild stats so we don't have
to do it for each edit. This improved speed of ajax and
actions-to-changes
Dobrica Pavlinusic [Sat, 5 Jun 2010 19:42:11 +0000 (21:42 +0200)]
show status stats for actions processed
Dobrica Pavlinusic [Sat, 5 Jun 2010 19:21:36 +0000 (21:21 +0200)]
apply actions sorted by time
Dobrica Pavlinusic [Sat, 5 Jun 2010 18:19:33 +0000 (20:19 +0200)]
display skipped changes
Dobrica Pavlinusic [Sat, 5 Jun 2010 18:12:21 +0000 (20:12 +0200)]
show number of changes
Dobrica Pavlinusic [Sat, 5 Jun 2010 18:06:37 +0000 (20:06 +0200)]
invalidate stats on data edit
Dobrica Pavlinusic [Sat, 5 Jun 2010 18:03:46 +0000 (20:03 +0200)]
document tunring actions into changes
Dobrica Pavlinusic [Sat, 5 Jun 2010 17:48:03 +0000 (19:48 +0200)]
added backward compatiblity for data migration
some time ago, I renamed changes to new_changes, but old data include
change filed, so we use it if found.
Dobrica Pavlinusic [Sat, 5 Jun 2010 17:38:51 +0000 (19:38 +0200)]
rename edits to changes
Dobrica Pavlinusic [Sat, 5 Jun 2010 17:27:58 +0000 (19:27 +0200)]
more rigourous check of edits
Dobrica Pavlinusic [Sat, 5 Jun 2010 17:21:15 +0000 (19:21 +0200)]
fix json loading
Dobrica Pavlinusic [Sat, 5 Jun 2010 15:46:21 +0000 (17:46 +0200)]
document html table format in directory.html
Dobrica Pavlinusic [Sat, 5 Jun 2010 13:54:12 +0000 (15:54 +0200)]
__normalize_header to cleanup names
Dobrica Pavlinusic [Sat, 5 Jun 2010 13:46:58 +0000 (15:46 +0200)]
produce items structure
Dobrica Pavlinusic [Sat, 5 Jun 2010 13:29:28 +0000 (15:29 +0200)]
move file import code into own package
Dobrica Pavlinusic [Sat, 5 Jun 2010 13:08:29 +0000 (15:08 +0200)]
parse table using HTML::TableExtract
This will detect header as first line, and parse all other html files
with same number of (hardcoded) columns
Dobrica Pavlinusic [Fri, 4 Jun 2010 21:34:59 +0000 (23:34 +0200)]
sort actions by time ascending
since we apply it in same order, this makes sense
Dobrica Pavlinusic [Fri, 4 Jun 2010 16:15:23 +0000 (18:15 +0200)]
rename changes to actions
Dobrica Pavlinusic [Fri, 4 Jun 2010 15:37:04 +0000 (17:37 +0200)]
simplify modified dataset tracking
now we use session variable modified, and that state is internally
stored in $loaded->{$path}->{modified}
Dobrica Pavlinusic [Fri, 4 Jun 2010 15:01:32 +0000 (17:01 +0200)]
Merge branch 'master' into save_change
Dobrica Pavlinusic [Fri, 4 Jun 2010 14:59:23 +0000 (16:59 +0200)]
don't use $content - Mojo doesn't like it
Using content variable caused last bug which caused strange
serializations of perl hash when editing previously undefined
value and replacing it with 0, so I just replaced it with
new_content all around
Dobrica Pavlinusic [Thu, 3 Jun 2010 21:55:01 +0000 (23:55 +0200)]
added commit changes
Dobrica Pavlinusic [Thu, 3 Jun 2010 21:22:51 +0000 (23:22 +0200)]
added checkbox for dump of whole edit
Dobrica Pavlinusic [Thu, 3 Jun 2010 21:03:28 +0000 (23:03 +0200)]
javascript show/hide of different statuses
Dobrica Pavlinusic [Thu, 3 Jun 2010 20:34:40 +0000 (22:34 +0200)]
reformat edits into table
Dobrica Pavlinusic [Thu, 3 Jun 2010 20:00:38 +0000 (22:00 +0200)]
somewhat nicer results of apply
Dobrica Pavlinusic [Thu, 3 Jun 2010 19:30:33 +0000 (21:30 +0200)]
apply edits on this or any other loaded dataset
This just reports found and missing elements by first unique value
Dobrica Pavlinusic [Thu, 3 Jun 2010 17:25:58 +0000 (19:25 +0200)]
Merge branch 'master' into save_change
Dobrica Pavlinusic [Thu, 3 Jun 2010 17:10:27 +0000 (19:10 +0200)]
correctly disable radio button for loaded dataset
Dobrica Pavlinusic [Thu, 3 Jun 2010 17:01:17 +0000 (19:01 +0200)]
added remove edits link
Dobrica Pavlinusic [Thu, 3 Jun 2010 16:09:41 +0000 (18:09 +0200)]
rebuild stats link on columns page
Dobrica Pavlinusic [Thu, 3 Jun 2010 15:07:13 +0000 (17:07 +0200)]
Merge branch 'master' into save_change
Dobrica Pavlinusic [Thu, 3 Jun 2010 14:12:33 +0000 (16:12 +0200)]
ignore data/ and nytprof output
Dobrica Pavlinusic [Thu, 3 Jun 2010 13:56:36 +0000 (15:56 +0200)]
added /config setup MASTER for replication
Dobrica Pavlinusic [Thu, 3 Jun 2010 13:22:13 +0000 (15:22 +0200)]
Merge branch 'master' into save_change
Dobrica Pavlinusic [Thu, 3 Jun 2010 13:09:36 +0000 (15:09 +0200)]
fix form submission
Dobrica Pavlinusic [Thu, 3 Jun 2010 12:25:51 +0000 (14:25 +0200)]
added /data/export
Dobrica Pavlinusic [Thu, 3 Jun 2010 11:55:11 +0000 (13:55 +0200)]
export filter
into simple one value per line format
Dobrica Pavlinusic [Thu, 3 Jun 2010 10:54:40 +0000 (12:54 +0200)]
Merge branch 'master' into save_change
Dobrica Pavlinusic [Thu, 3 Jun 2010 10:52:42 +0000 (12:52 +0200)]
added hide button for changes
Dobrica Pavlinusic [Thu, 3 Jun 2010 10:13:38 +0000 (12:13 +0200)]
fix sorting of edits
Dobrica Pavlinusic [Thu, 3 Jun 2010 09:41:38 +0000 (11:41 +0200)]
load last saved columns with dataset
Dobrica Pavlinusic [Wed, 2 Jun 2010 23:00:35 +0000 (01:00 +0200)]
store columns in simple text file
one selected column per line
Dobrica Pavlinusic [Wed, 2 Jun 2010 22:44:37 +0000 (00:44 +0200)]
great rename _perm -> _param
Dobrica Pavlinusic [Wed, 2 Jun 2010 22:43:19 +0000 (00:43 +0200)]
_loaded includes autoloader for a while
Dobrica Pavlinusic [Wed, 2 Jun 2010 22:39:52 +0000 (00:39 +0200)]
use _param_or_session
Dobrica Pavlinusic [Wed, 2 Jun 2010 22:35:29 +0000 (00:35 +0200)]
/data/stats for refresh
Dobrica Pavlinusic [Wed, 2 Jun 2010 22:33:46 +0000 (00:33 +0200)]
extract __stats in own sub
Dobrica Pavlinusic [Wed, 2 Jun 2010 22:11:18 +0000 (00:11 +0200)]
sync storable mtime on first dump
Dobrica Pavlinusic [Wed, 2 Jun 2010 20:44:32 +0000 (22:44 +0200)]
added faceted links
Dobrica Pavlinusic [Wed, 2 Jun 2010 20:07:52 +0000 (22:07 +0200)]
added link to edits dump
Dobrica Pavlinusic [Wed, 2 Jun 2010 20:02:26 +0000 (22:02 +0200)]
dump edits
Dobrica Pavlinusic [Wed, 2 Jun 2010 17:59:11 +0000 (19:59 +0200)]
record unique values in edit
Dobrica Pavlinusic [Wed, 2 Jun 2010 17:41:56 +0000 (19:41 +0200)]
display unique columns
Dobrica Pavlinusic [Wed, 2 Jun 2010 17:17:06 +0000 (19:17 +0200)]
check uniqeness of values in fields
This are possible primary key candidates which we would like to record
in our changes
Dobrica Pavlinusic [Wed, 2 Jun 2010 16:35:51 +0000 (18:35 +0200)]
rename structured changes to edits
changes are just http requests while edits carry enough context
data to be applied on different dataset (full values as opposed to
just which element we need to change)
Dobrica Pavlinusic [Wed, 2 Jun 2010 16:32:58 +0000 (18:32 +0200)]
display number of edits
Dobrica Pavlinusic [Tue, 1 Jun 2010 20:41:55 +0000 (22:41 +0200)]
use hash with time
Dobrica Pavlinusic [Tue, 1 Jun 2010 20:41:25 +0000 (22:41 +0200)]
added time-travel
this allows to save changes with original timestamp
Dobrica Pavlinusic [Tue, 1 Jun 2010 19:02:08 +0000 (21:02 +0200)]
extract time from filename
Dobrica Pavlinusic [Tue, 1 Jun 2010 18:38:48 +0000 (20:38 +0200)]
use changes from command-line
Dobrica Pavlinusic [Tue, 1 Jun 2010 18:30:38 +0000 (20:30 +0200)]
re-apply changes from /tmp
Dobrica Pavlinusic [Tue, 1 Jun 2010 18:27:15 +0000 (20:27 +0200)]
sync change file mtime
Dobrica Pavlinusic [Tue, 1 Jun 2010 18:26:47 +0000 (20:26 +0200)]
use path from param if no session
Dobrica Pavlinusic [Tue, 1 Jun 2010 16:36:49 +0000 (18:36 +0200)]
show uid and submit time
Dobrica Pavlinusic [Tue, 1 Jun 2010 15:36:02 +0000 (17:36 +0200)]
save changes which change data
This is real modification log (you might say diff) which should
allow loading of different data set and application of changes to it
Dobrica Pavlinusic [Tue, 1 Jun 2010 14:20:40 +0000 (16:20 +0200)]
added $changes
Dobrica Pavlinusic [Tue, 1 Jun 2010 13:34:23 +0000 (15:34 +0200)]
cleanup dump_path usage
Dobrica Pavlinusic [Thu, 27 May 2010 21:42:42 +0000 (23:42 +0200)]
move automatic loader into _loaded
Dobrica Pavlinusic [Thu, 27 May 2010 21:28:16 +0000 (23:28 +0200)]
load data for edit on demand
Dobrica Pavlinusic [Thu, 27 May 2010 20:51:37 +0000 (22:51 +0200)]
document master-slave setup
Dobrica Pavlinusic [Thu, 27 May 2010 20:13:28 +0000 (22:13 +0200)]
Merge branch 'master' into fix-empty-undef-edit
Dobrica Pavlinusic [Thu, 27 May 2010 20:12:31 +0000 (22:12 +0200)]
disable mtime sync with source file
Dobrica Pavlinusic [Thu, 27 May 2010 20:05:18 +0000 (22:05 +0200)]
empty value for previously undef fields not update
Dobrica Pavlinusic [Thu, 27 May 2010 19:19:53 +0000 (21:19 +0200)]
implement replication checkbox
use MASTER enviroment variable contains url of another instance
of mojo_facets, and user interface shows checkbox which allow
replication to master instance.
Dobrica Pavlinusic [Thu, 27 May 2010 18:02:05 +0000 (20:02 +0200)]
load change form inline using jQuery .load
Dobrica Pavlinusic [Thu, 27 May 2010 17:17:58 +0000 (19:17 +0200)]
reset save_path
Dobrica Pavlinusic [Thu, 27 May 2010 17:10:50 +0000 (19:10 +0200)]
added boolean like field
Dobrica Pavlinusic [Thu, 27 May 2010 16:44:14 +0000 (18:44 +0200)]
enable creation of non-existing fields
Dobrica Pavlinusic [Thu, 27 May 2010 16:19:05 +0000 (18:19 +0200)]
display storable size
This allows us to identify which dumps are available and how much
memory will they use when loaded (or even compare file size between
source file format and our storable serialization)
Dobrica Pavlinusic [Thu, 27 May 2010 16:05:07 +0000 (18:05 +0200)]
reload file if changed
Dobrica Pavlinusic [Thu, 27 May 2010 15:48:11 +0000 (17:48 +0200)]
insert save link only once
Dobrica Pavlinusic [Thu, 27 May 2010 15:43:40 +0000 (17:43 +0200)]
load storable dump
Dobrica Pavlinusic [Thu, 27 May 2010 14:32:41 +0000 (16:32 +0200)]
create save link
This allows us to preserve our changes in storable dump
Dobrica Pavlinusic [Thu, 27 May 2010 14:07:53 +0000 (16:07 +0200)]
return correct status codes and content
Dobrica Pavlinusic [Thu, 27 May 2010 13:34:06 +0000 (15:34 +0200)]
one more redirect to load if no path in session
Dobrica Pavlinusic [Thu, 27 May 2010 11:58:02 +0000 (13:58 +0200)]
better validate _row_id
And allow 0 for first element :-)
Dobrica Pavlinusic [Thu, 27 May 2010 11:52:35 +0000 (13:52 +0200)]
invalidate sorted and filtered values on edit
Dobrica Pavlinusic [Thu, 27 May 2010 11:40:39 +0000 (13:40 +0200)]
save edited data back to table
Dobrica Pavlinusic [Thu, 27 May 2010 10:14:24 +0000 (12:14 +0200)]
strip whitespace before and after value
This gets somehow generated when I try to access table element using
jQuery.text() on it
Dobrica Pavlinusic [Thu, 27 May 2010 10:08:28 +0000 (12:08 +0200)]
_row_id now include offset in dataset array
this allows edits to reference exact element to change