cloudstore.git
12 years agostart/stop stunnel
root [Wed, 30 Nov 2011 23:01:57 +0000 (00:01 +0100)]
start/stop stunnel

12 years agoadded init script for monit
root [Wed, 30 Nov 2011 20:22:32 +0000 (21:22 +0100)]
added init script for monit

12 years agochroot into slice dir to limit security exposure
Dobrica Pavlinusic [Wed, 30 Nov 2011 20:20:18 +0000 (21:20 +0100)]
chroot into slice dir to limit security exposure

12 years agostore send_file and delete operation in log
Dobrica Pavlinusic [Tue, 29 Nov 2011 23:02:34 +0000 (00:02 +0100)]
store send_file and delete operation in log

12 years agotest Gearman API
Dobrica Pavlinusic [Tue, 29 Nov 2011 22:58:37 +0000 (23:58 +0100)]
test Gearman API

12 years agoreport errors better in send_file
Dobrica Pavlinusic [Tue, 29 Nov 2011 21:21:03 +0000 (22:21 +0100)]
report errors better in send_file

12 years agoremote_tree for directory deletion
Dobrica Pavlinusic [Fri, 25 Nov 2011 12:58:23 +0000 (13:58 +0100)]
remote_tree for directory deletion

12 years agoadded delete gearman worker
Dobrica Pavlinusic [Thu, 24 Nov 2011 21:13:35 +0000 (22:13 +0100)]
added delete gearman worker

12 years agotest delte with spaces
Dobrica Pavlinusic [Thu, 24 Nov 2011 20:59:35 +0000 (21:59 +0100)]
test delte with spaces

12 years agoremove old shell implementation
Dobrica Pavlinusic [Wed, 23 Nov 2011 17:56:32 +0000 (18:56 +0100)]
remove old shell implementation

12 years agore-implement send_file as perl script
Dobrica Pavlinusic [Wed, 23 Nov 2011 17:47:35 +0000 (18:47 +0100)]
re-implement send_file as perl script

This allows us to correctly deal with spaces in filenames and dirnames

12 years agormdir directories
Dobrica Pavlinusic [Sun, 20 Nov 2011 21:39:59 +0000 (22:39 +0100)]
rmdir directories

12 years agotest directory delete
Dobrica Pavlinusic [Sun, 20 Nov 2011 21:37:05 +0000 (22:37 +0100)]
test directory delete

12 years agostatus of gearman workers
Dobrica Pavlinusic [Thu, 17 Nov 2011 23:42:14 +0000 (00:42 +0100)]
status of gearman workers

12 years agoscript to start worker and capture log
Dobrica Pavlinusic [Thu, 17 Nov 2011 23:41:46 +0000 (00:41 +0100)]
script to start worker and capture log

12 years agolocal IP
Dobrica Pavlinusic [Tue, 15 Nov 2011 20:57:55 +0000 (21:57 +0100)]
local IP

12 years agofix DELETED and test it
Dobrica Pavlinusic [Thu, 17 Nov 2011 20:45:30 +0000 (21:45 +0100)]
fix DELETED and test it

12 years agosend_file gearman API
Dobrica Pavlinusic [Tue, 15 Nov 2011 17:33:40 +0000 (18:33 +0100)]
send_file gearman API

12 years agocreate_user skeleton code for Gearman
Dobrica Pavlinusic [Tue, 15 Nov 2011 17:11:01 +0000 (18:11 +0100)]
create_user skeleton code for Gearman

12 years agoremove debug output
Dobrica Pavlinusic [Fri, 28 Oct 2011 09:45:38 +0000 (11:45 +0200)]
remove debug output

12 years agoset user quota
Dobrica Pavlinusic [Fri, 28 Oct 2011 09:43:10 +0000 (11:43 +0200)]
set user quota

12 years agoskip missing files for unlink
Dobrica Pavlinusic [Wed, 26 Oct 2011 10:26:59 +0000 (12:26 +0200)]
skip missing files for unlink

12 years agoadded DELETED pending log
Dobrica Pavlinusic [Tue, 25 Oct 2011 17:03:33 +0000 (19:03 +0200)]
added DELETED pending log

12 years agoshow path with open error
Dobrica Pavlinusic [Sat, 22 Oct 2011 10:50:20 +0000 (12:50 +0200)]
show path with open error

12 years agouse SLICE from env.sh
Dobrica Pavlinusic [Wed, 19 Oct 2011 21:12:34 +0000 (23:12 +0200)]
use SLICE from env.sh

12 years agoextract rsync_rebuild_config and call it for some keywords in log
root [Wed, 19 Oct 2011 18:50:53 +0000 (20:50 +0200)]
extract rsync_rebuild_config and call it for some keywords in log

12 years agouse $SLICE from env.sh
Dobrica Pavlinusic [Wed, 19 Oct 2011 18:41:41 +0000 (20:41 +0200)]
use $SLICE from env.sh

12 years agouse hostname for base slice dir
Dobrica Pavlinusic [Wed, 19 Oct 2011 18:37:38 +0000 (20:37 +0200)]
use hostname for base slice dir

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Thu, 13 Oct 2011 10:06:06 +0000 (12:06 +0200)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years ago100k quota for test user u2002
Dobrica Pavlinusic [Thu, 13 Oct 2011 10:05:54 +0000 (12:05 +0200)]
100k quota for test user u2002

12 years agodon't die on rename of non-existing file
Dobrica Pavlinusic [Thu, 13 Oct 2011 10:05:38 +0000 (12:05 +0200)]
don't die on rename of non-existing file

12 years agouse env.sh and u2002 login
Dobrica Pavlinusic [Wed, 12 Oct 2011 15:37:55 +0000 (17:37 +0200)]
use env.sh and u2002 login

12 years agouse env.sh config
Dobrica Pavlinusic [Wed, 12 Oct 2011 15:37:01 +0000 (17:37 +0200)]
use env.sh config

12 years agodon't try to rename non-existing files
Dobrica Pavlinusic [Tue, 11 Oct 2011 14:53:05 +0000 (16:53 +0200)]
don't try to rename non-existing files

12 years agomake dir prefix before .sync/(send|pending) optional (ie. work in root dir)
Dobrica Pavlinusic [Tue, 11 Oct 2011 14:52:31 +0000 (16:52 +0200)]
make dir prefix before .sync/(send|pending) optional (ie. work in root dir)

12 years agosupport MOVED or RENAMED
Dobrica Pavlinusic [Tue, 11 Oct 2011 14:35:57 +0000 (16:35 +0200)]
support MOVED or RENAMED

12 years agoinit zfs slice
Dobrica Pavlinusic [Mon, 10 Oct 2011 20:27:20 +0000 (22:27 +0200)]
init zfs slice

12 years agodump user md5sum file and use it for test
Dobrica Pavlinusic [Mon, 10 Oct 2011 20:26:36 +0000 (22:26 +0200)]
dump user md5sum file and use it for test

12 years agodelete md5 for removed files
Dobrica Pavlinusic [Mon, 10 Oct 2011 20:26:27 +0000 (22:26 +0200)]
delete md5 for removed files

12 years agotest receiving of sent files
Dobrica Pavlinusic [Mon, 10 Oct 2011 20:02:30 +0000 (22:02 +0200)]
test receiving of sent files

12 years agoadded md5 TokyoCabinet and perms note
Dobrica Pavlinusic [Mon, 10 Oct 2011 20:00:53 +0000 (22:00 +0200)]
added md5 TokyoCabinet and perms note

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Mon, 10 Oct 2011 16:45:45 +0000 (18:45 +0200)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

Conflicts:
rsync-piper.pl
test.sh

12 years agoforce sane chmod on incoming files
Dobrica Pavlinusic [Mon, 10 Oct 2011 16:13:33 +0000 (18:13 +0200)]
force sane chmod on incoming files

group read for group sharing with other users in same slice, other read
for sharing with remote slices

12 years agoforce sane chmod on incoming files
Dobrica Pavlinusic [Mon, 10 Oct 2011 16:13:33 +0000 (18:13 +0200)]
force sane chmod on incoming files

12 years agohide .md5 file from rsync
Dobrica Pavlinusic [Mon, 10 Oct 2011 15:01:34 +0000 (17:01 +0200)]
hide .md5 file from rsync

12 years agoport md5 support to TokyoCabinet
Dobrica Pavlinusic [Sun, 9 Oct 2011 21:14:48 +0000 (23:14 +0200)]
port md5 support to TokyoCabinet

12 years agoimplement and test mv from pending log
Dobrica Pavlinusic [Sun, 9 Oct 2011 12:09:26 +0000 (14:09 +0200)]
implement and test mv from pending log

12 years agoremove unused files from md5pool
Dobrica Pavlinusic [Sat, 8 Oct 2011 23:29:53 +0000 (01:29 +0200)]
remove unused files from md5pool

12 years agonew .sync/send/timestamp
Dobrica Pavlinusic [Sat, 8 Oct 2011 23:24:03 +0000 (01:24 +0200)]
new .sync/send/timestamp

12 years agodirectories don't have md5sum
Dobrica Pavlinusic [Sat, 8 Oct 2011 22:22:30 +0000 (00:22 +0200)]
directories don't have md5sum

12 years agotest md5 chown
Dobrica Pavlinusic [Sat, 8 Oct 2011 22:13:43 +0000 (00:13 +0200)]
test md5 chown

12 years agochown md5pool to md5 user for last copy to correct quota usage
Dobrica Pavlinusic [Sat, 8 Oct 2011 22:00:52 +0000 (00:00 +0200)]
chown md5pool to md5 user for last copy to correct quota usage

12 years agosplit md5sum db per user
Dobrica Pavlinusic [Sat, 8 Oct 2011 16:31:49 +0000 (18:31 +0200)]
split md5sum db per user

12 years agoworking remove-user.sh for extrausers
Dobrica Pavlinusic [Sat, 8 Oct 2011 13:53:28 +0000 (15:53 +0200)]
working remove-user.sh for extrausers

12 years agouse logins from create-user.sh
Dobrica Pavlinusic [Sat, 8 Oct 2011 13:53:10 +0000 (15:53 +0200)]
use logins from create-user.sh

12 years agomd5 user is only fixed one
Dobrica Pavlinusic [Sat, 8 Oct 2011 13:51:29 +0000 (15:51 +0200)]
md5 user is only fixed one

12 years agoreturn just login to STDOUT
Dobrica Pavlinusic [Sat, 8 Oct 2011 13:51:11 +0000 (15:51 +0200)]
return just login to STDOUT

12 years agoinit slice zfs pool
Dobrica Pavlinusic [Sat, 8 Oct 2011 13:47:34 +0000 (15:47 +0200)]
init slice zfs pool

12 years agosave md5 db in user dir
Dobrica Pavlinusic [Sat, 8 Oct 2011 12:50:00 +0000 (14:50 +0200)]
save md5 db in user dir

12 years agoconfigure zfs quota and uid/git for shares
Dobrica Pavlinusic [Fri, 7 Oct 2011 22:44:49 +0000 (00:44 +0200)]
configure zfs quota and uid/git for shares

12 years agobegin integration of zfs quota
Dobrica Pavlinusic [Fri, 7 Oct 2011 18:44:58 +0000 (20:44 +0200)]
begin integration of zfs quota

12 years agouse enviroment configuration
Dobrica Pavlinusic [Fri, 7 Oct 2011 16:49:13 +0000 (18:49 +0200)]
use enviroment configuration

12 years agopass all rsync log through Store, reload config on unknown module
Dobrica Pavlinusic [Fri, 7 Oct 2011 12:24:28 +0000 (14:24 +0200)]
pass all rsync log through Store, reload config on unknown module

12 years agogenerate BerkeleyDB md5 hash, remove dependencies
Dobrica Pavlinusic [Wed, 5 Oct 2011 20:56:22 +0000 (22:56 +0200)]
generate BerkeleyDB md5 hash, remove dependencies

12 years agoFile::Path is not part of core parl
Dobrica Pavlinusic [Wed, 5 Oct 2011 15:11:16 +0000 (17:11 +0200)]
File::Path is not part of core parl

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Tue, 4 Oct 2011 17:16:59 +0000 (17:16 +0000)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years agouse hostname.conf for local configuration
Dobrica Pavlinusic [Tue, 20 Sep 2011 19:46:48 +0000 (21:46 +0200)]
use hostname.conf for local configuration

12 years agouse local build if available
Dobrica Pavlinusic [Tue, 20 Sep 2011 19:46:23 +0000 (21:46 +0200)]
use local build if available

12 years agorename Couchbase to Store
Dobrica Pavlinusic [Tue, 20 Sep 2011 12:09:08 +0000 (12:09 +0000)]
rename Couchbase to Store

this is first step in refactoring to remove Membase as back-end store

12 years agouse libnss-extrausers to provide uids for quota
Dobrica Pavlinusic [Sun, 11 Sep 2011 15:12:53 +0000 (15:12 +0000)]
use libnss-extrausers to provide uids for quota

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Sun, 11 Sep 2011 13:29:51 +0000 (15:29 +0200)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years agoadded size_bytes
Dobrica Pavlinusic [Sun, 11 Sep 2011 13:29:47 +0000 (15:29 +0200)]
added size_bytes

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Thu, 8 Sep 2011 22:28:28 +0000 (22:28 +0000)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years agofirst working /.send/ implementation for all cases
Dobrica Pavlinusic [Thu, 8 Sep 2011 22:27:07 +0000 (22:27 +0000)]
first working /.send/ implementation for all cases

It doesn't die on non-existing files, but just on fatal errors,
create files in storage for sent file

12 years agouse blue and yellow more
Dobrica Pavlinusic [Thu, 8 Sep 2011 22:25:32 +0000 (22:25 +0000)]
use blue and yellow more

12 years agosend also file to send
Dobrica Pavlinusic [Thu, 8 Sep 2011 21:14:29 +0000 (21:14 +0000)]
send also file to send

12 years agocolor warn quotes yellow
Dobrica Pavlinusic [Thu, 8 Sep 2011 21:13:34 +0000 (21:13 +0000)]
color warn quotes yellow

12 years agocolorize server output
Dobrica Pavlinusic [Thu, 8 Sep 2011 19:00:25 +0000 (19:00 +0000)]
colorize server output

12 years agoreturn rsync xfer errors to client
Dobrica Pavlinusic [Thu, 8 Sep 2011 18:46:31 +0000 (18:46 +0000)]
return rsync xfer errors to client

by simple writing to STDOUT instead to STDERR

12 years agotest /.send/to/dir/file
Dobrica Pavlinusic [Thu, 8 Sep 2011 17:09:47 +0000 (17:09 +0000)]
test /.send/to/dir/file

12 years agoreformat output to single line per torrent
Dobrica Pavlinusic [Thu, 8 Sep 2011 14:21:28 +0000 (16:21 +0200)]
reformat output to single line per torrent

12 years agouse SOCKET from env
Dobrica Pavlinusic [Thu, 8 Sep 2011 14:01:47 +0000 (16:01 +0200)]
use SOCKET from env

12 years agoless output without DEBUG=1
Dobrica Pavlinusic [Thu, 8 Sep 2011 11:52:39 +0000 (11:52 +0000)]
less output without DEBUG=1

12 years agouse $USER for login and module
Dobrica Pavlinusic [Thu, 8 Sep 2011 11:50:19 +0000 (11:50 +0000)]
use $USER for login and module

12 years agoadopt running rsync instead of killing it
Dobrica Pavlinusic [Wed, 7 Sep 2011 21:54:17 +0000 (21:54 +0000)]
adopt running rsync instead of killing it

12 years agocreate directories in /.send/login/some/dir/file
Dobrica Pavlinusic [Wed, 7 Sep 2011 21:54:00 +0000 (21:54 +0000)]
create directories in /.send/login/some/dir/file

12 years agouse symlinks to transfer /.send/login/file informations
Dobrica Pavlinusic [Wed, 7 Sep 2011 21:26:59 +0000 (21:26 +0000)]
use symlinks to transfer /.send/login/file informations

12 years agolsyncd client
Dobrica Pavlinusic [Wed, 7 Sep 2011 19:01:25 +0000 (21:01 +0200)]
lsyncd client

12 years agorename client to more sensible name
Dobrica Pavlinusic [Wed, 7 Sep 2011 18:42:06 +0000 (20:42 +0200)]
rename client to more sensible name

12 years agosimple push once rsync client
Dobrica Pavlinusic [Wed, 7 Sep 2011 18:31:37 +0000 (20:31 +0200)]
simple push once rsync client

12 years agoconfigure default QUOTA env
Dobrica Pavlinusic [Wed, 7 Sep 2011 18:27:42 +0000 (18:27 +0000)]
configure default QUOTA env

12 years agospecify LIMIT and increase it to 10000 docs
Dobrica Pavlinusic [Mon, 5 Sep 2011 09:47:32 +0000 (09:47 +0000)]
specify LIMIT and increase it to 10000 docs

12 years agoverify that all entryies in store exists on filesystem
Dobrica Pavlinusic [Sun, 4 Sep 2011 21:50:23 +0000 (21:50 +0000)]
verify that all entryies in store exists on filesystem

12 years agocleanup and reformat status
Dobrica Pavlinusic [Sun, 4 Sep 2011 21:48:05 +0000 (21:48 +0000)]
cleanup and reformat status

12 years agoextract couchdb view call
Dobrica Pavlinusic [Sun, 4 Sep 2011 21:47:41 +0000 (21:47 +0000)]
extract couchdb view call

12 years agostore quota status in session
Dobrica Pavlinusic [Sun, 4 Sep 2011 18:00:14 +0000 (18:00 +0000)]
store quota status in session

12 years agoenforce user quota on rsync xfer hooks
Dobrica Pavlinusic [Sun, 4 Sep 2011 17:29:31 +0000 (17:29 +0000)]
enforce user quota on rsync xfer hooks

12 years agorsync server now creates user objects
Dobrica Pavlinusic [Sun, 4 Sep 2011 16:45:49 +0000 (16:45 +0000)]
rsync server now creates user objects

12 years agoadded users bucket
Dobrica Pavlinusic [Sun, 4 Sep 2011 16:09:40 +0000 (16:09 +0000)]
added users bucket

12 years agoadded usage_init from view
Dobrica Pavlinusic [Sat, 3 Sep 2011 23:12:37 +0000 (23:12 +0000)]
added usage_init from view