Dobrica Pavlinusic [Sun, 20 Jun 2010 16:49:48 +0000 (18:49 +0200)]
calculate new columns from stats on commit
Dobrica Pavlinusic [Sun, 20 Jun 2010 12:05:53 +0000 (14:05 +0200)]
Merge branch 'cols_changed-exact'
Dobrica Pavlinusic [Sun, 20 Jun 2010 12:04:31 +0000 (14:04 +0200)]
another $col_changed cleanup
0 denotes used column (extracted from source using regex),
while positive numbers denote added columns.
This allow allow us to color used and created columns differently
Dobrica Pavlinusic [Sun, 20 Jun 2010 11:35:38 +0000 (13:35 +0200)]
read code from disk in utf-8 encoding
Dobrica Pavlinusic [Sun, 20 Jun 2010 11:29:44 +0000 (13:29 +0200)]
dump code with utf8 encoding
Dobrica Pavlinusic [Sun, 20 Jun 2010 11:15:28 +0000 (13:15 +0200)]
track exact $cols_changed
First we parse query to find accessed columns (this is error prone), and
after each eval, we check to find all produced columns.
Dobrica Pavlinusic [Sat, 19 Jun 2010 20:18:06 +0000 (22:18 +0200)]
sort files my mtime
Dobrica Pavlinusic [Sat, 19 Jun 2010 19:29:22 +0000 (21:29 +0200)]
preserve column order in depends and description
Dobrica Pavlinusic [Sat, 19 Jun 2010 18:58:47 +0000 (20:58 +0200)]
example to produce new dataset from test.js
Dobrica Pavlinusic [Sat, 19 Jun 2010 17:04:13 +0000 (19:04 +0200)]
fix sorting for undef values
Dobrica Pavlinusic [Sat, 19 Jun 2010 16:41:21 +0000 (18:41 +0200)]
report number of items returned from sort
Dobrica Pavlinusic [Sat, 19 Jun 2010 16:33:09 +0000 (18:33 +0200)]
cleanup all_filters name generation
Dobrica Pavlinusic [Sat, 19 Jun 2010 16:13:17 +0000 (18:13 +0200)]
show unique symbol in table view
Dobrica Pavlinusic [Sat, 19 Jun 2010 16:12:16 +0000 (18:12 +0200)]
fix markup for unique span
Dobrica Pavlinusic [Sat, 19 Jun 2010 16:00:00 +0000 (18:00 +0200)]
commit $out changes into new dataset
This is quite a big deal: it allows us to create new datasets from
results of code eval into $out variable. You can think of it as
group by on steroids, since you create reports with a bit of perl
Dobrica Pavlinusic [Sat, 19 Jun 2010 14:07:41 +0000 (16:07 +0200)]
controll overflow of $out and show scroll bar
Dobrica Pavlinusic [Sat, 19 Jun 2010 13:30:02 +0000 (15:30 +0200)]
show all applicable code snippets
This required us to check if current dataset (using columns) has all
applicable columns for given dataset
Dobrica Pavlinusic [Sat, 19 Jun 2010 13:12:33 +0000 (15:12 +0200)]
insert white semicolumn to improve copy/paste
This allows us to copy/paste into gnumeric and split data on ; to get
two columns, one with value and another with numeric count
Dobrica Pavlinusic [Sat, 19 Jun 2010 12:21:43 +0000 (14:21 +0200)]
reduce using $out in code
This allows us to generate various summaries over all rows on screen.
Dobrica Pavlinusic [Sat, 19 Jun 2010 11:42:33 +0000 (13:42 +0200)]
upgrade old values in changes to array
Dobrica Pavlinusic [Fri, 18 Jun 2010 22:09:37 +0000 (00:09 +0200)]
toggle show/hide on console click
Dobrica Pavlinusic [Fri, 18 Jun 2010 22:02:11 +0000 (00:02 +0200)]
tweak columns acquision order
This allows us again just to reload table data after we restart server,
since we don't require columns (which isn't saved until user selects
save for the first time) but headers which is there.
However, if we do have columns in session, we'll use that (which is
required for code eval to add new columns).
Dobrica Pavlinusic [Fri, 18 Jun 2010 21:29:12 +0000 (23:29 +0200)]
extract meters from text data
Dobrica Pavlinusic [Fri, 18 Jun 2010 20:24:07 +0000 (22:24 +0200)]
example for in-place update
Dobrica Pavlinusic [Fri, 18 Jun 2010 20:23:03 +0000 (22:23 +0200)]
self-modifing code depends on modified columns
Dobrica Pavlinusic [Fri, 18 Jun 2010 20:15:41 +0000 (22:15 +0200)]
two code samples for pftf dataset
Dobrica Pavlinusic [Fri, 18 Jun 2010 19:56:37 +0000 (21:56 +0200)]
cleanup code depends and description generation
Dobrica Pavlinusic [Fri, 18 Jun 2010 19:48:14 +0000 (21:48 +0200)]
added console link
Dobrica Pavlinusic [Fri, 18 Jun 2010 18:27:57 +0000 (20:27 +0200)]
quote column names in regexps
Dobrica Pavlinusic [Fri, 18 Jun 2010 18:19:44 +0000 (20:19 +0200)]
added overwrite checkbox to code console
Newly generated code will always be saved, but modifications won't
witout user explicitly clicking on checkbox or renaming description.
Dobrica Pavlinusic [Fri, 18 Jun 2010 17:58:44 +0000 (19:58 +0200)]
load code depends and description
Dobrica Pavlinusic [Fri, 18 Jun 2010 17:30:22 +0000 (19:30 +0200)]
save commited code snippets
Dependent columns (part before the dot) is calculated automatically.
If there are newly created columns, they are suggested as description.
Dobrica Pavlinusic [Fri, 18 Jun 2010 17:29:44 +0000 (19:29 +0200)]
dump all log to /tmp/mojo_facets.log for debug
Dobrica Pavlinusic [Fri, 18 Jun 2010 17:03:45 +0000 (19:03 +0200)]
unload datasets from memory
if checkbox m(emory) is unchecked on load screen
Dobrica Pavlinusic [Fri, 18 Jun 2010 16:30:00 +0000 (18:30 +0200)]
hide scrollbar in textarea
Dobrica Pavlinusic [Fri, 18 Jun 2010 16:16:29 +0000 (18:16 +0200)]
we need filters for columns, not header
header is filled just once from source file, while columns is updated
with columns added from code
Dobrica Pavlinusic [Fri, 18 Jun 2010 16:14:17 +0000 (18:14 +0200)]
_data_items is unused
Dobrica Pavlinusic [Fri, 18 Jun 2010 16:07:34 +0000 (18:07 +0200)]
hide ignored files
Dobrica Pavlinusic [Fri, 18 Jun 2010 16:07:17 +0000 (18:07 +0200)]
hide changes
Dobrica Pavlinusic [Fri, 18 Jun 2010 16:06:04 +0000 (18:06 +0200)]
dump filters
Dobrica Pavlinusic [Fri, 18 Jun 2010 15:54:00 +0000 (17:54 +0200)]
mark all columns used in code
Dobrica Pavlinusic [Fri, 18 Jun 2010 15:33:28 +0000 (17:33 +0200)]
highlight added columns with changed class
Dobrica Pavlinusic [Fri, 18 Jun 2010 12:38:04 +0000 (14:38 +0200)]
we need session columns to show applicable code
Dobrica Pavlinusic [Fri, 18 Jun 2010 09:10:31 +0000 (11:10 +0200)]
fix filter creation
re-use of $i is just plain wrong, braking filters
Dobrica Pavlinusic [Fri, 18 Jun 2010 08:04:55 +0000 (10:04 +0200)]
hide code console after commit
Dobrica Pavlinusic [Fri, 18 Jun 2010 07:54:08 +0000 (09:54 +0200)]
order column must exist
If it doesn't we reset it to first columns because without it we
don't get any rows displayed
Dobrica Pavlinusic [Thu, 17 Jun 2010 19:43:56 +0000 (21:43 +0200)]
Merge branch 'master' of git.rot13.org:/git/mojo_facets
Dobrica Pavlinusic [Thu, 17 Jun 2010 19:41:57 +0000 (21:41 +0200)]
upgrade scalar values to arrays
This usally happens when you write eval code wrong, like in
$row->{something} = 1;
istead of
$row->{something} = [ 1 ];
This is probably wrong place for this, but it makes simple mistake less
fatal.
Dobrica Pavlinusic [Thu, 17 Jun 2010 19:41:40 +0000 (21:41 +0200)]
don't insert newlines in code textarea
Dobrica Pavlinusic [Thu, 17 Jun 2010 19:09:10 +0000 (21:09 +0200)]
added reload original link, hide commit on errors
Dobrica Pavlinusic [Thu, 17 Jun 2010 18:56:47 +0000 (20:56 +0200)]
change left-over $rec to $row
Dobrica Pavlinusic [Thu, 17 Jun 2010 18:56:31 +0000 (20:56 +0200)]
button to close code console
Dobrica Pavlinusic [Thu, 17 Jun 2010 18:15:58 +0000 (20:15 +0200)]
don't include code console if there is no code
Dobrica Pavlinusic [Thu, 17 Jun 2010 18:08:07 +0000 (20:08 +0200)]
load and test code snippets
Dobrica Pavlinusic [Thu, 17 Jun 2010 17:42:08 +0000 (19:42 +0200)]
browse code on disk at /code/
Dobrica Pavlinusic [Thu, 17 Jun 2010 17:15:33 +0000 (19:15 +0200)]
added code examples
Dobrica Pavlinusic [Thu, 17 Jun 2010 16:54:35 +0000 (18:54 +0200)]
better count example
Dobrica Pavlinusic [Thu, 17 Jun 2010 16:46:26 +0000 (18:46 +0200)]
Merge branch 'eval-code'
Dobrica Pavlinusic [Thu, 17 Jun 2010 16:44:13 +0000 (18:44 +0200)]
element in code eval is now called $row
This is much better name than $rec, especially when you try to
read code example or explain it to someone :-)
Dobrica Pavlinusic [Thu, 17 Jun 2010 16:43:51 +0000 (18:43 +0200)]
convert action filename back to REST url
Dobrica Pavlinusic [Thu, 17 Jun 2010 14:47:28 +0000 (16:47 +0200)]
modify existing column example
Dobrica Pavlinusic [Thu, 17 Jun 2010 14:39:55 +0000 (16:39 +0200)]
rebuild stats when new columns are added
Dobrica Pavlinusic [Thu, 17 Jun 2010 14:27:51 +0000 (16:27 +0200)]
Merge branch 'master' into eval-code
Dobrica Pavlinusic [Thu, 17 Jun 2010 14:26:30 +0000 (16:26 +0200)]
don't redirect to /data/index needlessly
This allow us to restart server and just load needed data on demand with
reload as opposed to first selecting active dataset and rest of the
stuff which we allready have in session.
Dobrica Pavlinusic [Thu, 17 Jun 2010 14:18:45 +0000 (16:18 +0200)]
fix warning for datasets without modifications
Dobrica Pavlinusic [Thu, 17 Jun 2010 14:00:57 +0000 (16:00 +0200)]
store new columns in $loaded
This allows sorting to do the right thing (e.g. work)
Dobrica Pavlinusic [Thu, 17 Jun 2010 12:53:05 +0000 (14:53 +0200)]
find columns used in code snippet and show them to user
Dobrica Pavlinusic [Thu, 17 Jun 2010 12:48:44 +0000 (14:48 +0200)]
added two examples of perl code to eval on data
Dobrica Pavlinusic [Wed, 16 Jun 2010 22:08:04 +0000 (00:08 +0200)]
default code is nothing
Dobrica Pavlinusic [Wed, 16 Jun 2010 21:18:27 +0000 (23:18 +0200)]
mock adding of single column on test or commit
Dobrica Pavlinusic [Wed, 16 Jun 2010 20:23:07 +0000 (22:23 +0200)]
commit changes only to filtered items
Dobrica Pavlinusic [Wed, 16 Jun 2010 20:15:49 +0000 (22:15 +0200)]
fixes to code eval
Since code is now persistant in session, we need to apply changes
only if test button is really pressed.
This changeset also fixes browing code textarea on reload
Dobrica Pavlinusic [Wed, 16 Jun 2010 19:51:29 +0000 (21:51 +0200)]
Merge branch 'master' into eval-code
Dobrica Pavlinusic [Wed, 16 Jun 2010 19:51:00 +0000 (21:51 +0200)]
clear all other ids from url
Dobrica Pavlinusic [Wed, 16 Jun 2010 19:40:27 +0000 (21:40 +0200)]
Merge branch 'master' into eval-code
Dobrica Pavlinusic [Wed, 16 Jun 2010 19:38:41 +0000 (21:38 +0200)]
use /data/items/:show
This allows nicer REST API and at the same time, skips recording of
action because I re-used :id as show, so request doesn't have
parameters and isn't recorderd in actions to reduce clutter
Dobrica Pavlinusic [Wed, 16 Jun 2010 19:32:29 +0000 (21:32 +0200)]
post code
Dobrica Pavlinusic [Wed, 16 Jun 2010 19:19:53 +0000 (21:19 +0200)]
keep last code in session
Dobrica Pavlinusic [Wed, 16 Jun 2010 18:54:21 +0000 (20:54 +0200)]
really commit code evals to whole data
Dobrica Pavlinusic [Wed, 16 Jun 2010 18:46:37 +0000 (20:46 +0200)]
textarea_grow jquery plugin
Dobrica Pavlinusic [Wed, 16 Jun 2010 15:08:08 +0000 (17:08 +0200)]
test code or commit changes
Dobrica Pavlinusic [Wed, 16 Jun 2010 13:58:17 +0000 (15:58 +0200)]
first working code eval
It needs a lot of work still (error reporting, examples etc), but
this proof of concept shows it's usable :-)
Code example:
map {
s/^\.+//;
} @{ $rec->{'Cited Author'} };
Dobrica Pavlinusic [Wed, 16 Jun 2010 13:19:11 +0000 (15:19 +0200)]
added code eval form
Dobrica Pavlinusic [Mon, 14 Jun 2010 18:35:53 +0000 (20:35 +0200)]
add dot before save link
Dobrica Pavlinusic [Mon, 14 Jun 2010 18:33:21 +0000 (20:33 +0200)]
added __path_modified
Use it to correctly show save link if needed
cleanup __invalidate_path_column (it doesn't need self, so double
underscore is good idea to indicate that)
Dobrica Pavlinusic [Wed, 9 Jun 2010 12:15:11 +0000 (14:15 +0200)]
added icon
Dobrica Pavlinusic [Tue, 8 Jun 2010 20:22:01 +0000 (22:22 +0200)]
don't dump huge $unique helper hash
Dobrica Pavlinusic [Tue, 8 Jun 2010 20:21:30 +0000 (22:21 +0200)]
display link to load dataset with changes applied
Dobrica Pavlinusic [Tue, 8 Jun 2010 20:11:28 +0000 (22:11 +0200)]
correctly commit change and invalidate caches
This makes changes commit actually useful, because you can reply your
changes on original data again or on differet dataset
Dobrica Pavlinusic [Tue, 8 Jun 2010 19:55:55 +0000 (21:55 +0200)]
all values must be arrays
Dobrica Pavlinusic [Mon, 7 Jun 2010 12:56:59 +0000 (14:56 +0200)]
don't rebuild stats if called from edit
This allow us to rebuild stat just once after a bunch of edits or
running ./script/actions-to-changes
Dobrica Pavlinusic [Sun, 6 Jun 2010 21:39:57 +0000 (23:39 +0200)]
shorter MAX_FACETS message to fit in the middle
Dobrica Pavlinusic [Sun, 6 Jun 2010 18:17:56 +0000 (20:17 +0200)]
reload facet with all values in single click
we also replicate alter on top bar to get better visibility
after page loaded
Dobrica Pavlinusic [Sun, 6 Jun 2010 16:32:24 +0000 (18:32 +0200)]
warn about MAX_FACETS but include rest of checked
This allows us to keep selected values on next submit
Dobrica Pavlinusic [Sun, 6 Jun 2010 16:04:45 +0000 (18:04 +0200)]
link to config to change MAX_FACETS
Dobrica Pavlinusic [Sun, 6 Jun 2010 15:59:37 +0000 (17:59 +0200)]
added config and move export to left
Dobrica Pavlinusic [Sun, 6 Jun 2010 15:52:23 +0000 (17:52 +0200)]
config MAX_FACETS
Dobrica Pavlinusic [Sun, 6 Jun 2010 15:46:20 +0000 (17:46 +0200)]
load only MAX_FACETS facets, 10000 by default
This will help in keeping memory usage in browser under 100Mb and
page load time resonable.
Dobrica Pavlinusic [Sun, 6 Jun 2010 14:54:19 +0000 (16:54 +0200)]
with empty session we don't need to die here
Dobrica Pavlinusic [Sun, 6 Jun 2010 12:17:39 +0000 (14:17 +0200)]
relax import regex