cloudstore.git
12 years agosomewhat auto-configure
Dobrica Pavlinusic [Mon, 12 Dec 2011 23:54:07 +0000 (00:54 +0100)]
somewhat auto-configure

12 years agorework zfs worker to new slice_quota_(get|set) naming
Dobrica Pavlinusic [Mon, 12 Dec 2011 23:53:01 +0000 (00:53 +0100)]
rework zfs worker to new slice_quota_(get|set) naming

12 years agodeduce correct quota calls from slice name
Dobrica Pavlinusic [Mon, 12 Dec 2011 23:44:42 +0000 (00:44 +0100)]
deduce correct quota calls from slice name

12 years agoported back to Gearman::Client
Dobrica Pavlinusic [Mon, 12 Dec 2011 23:21:34 +0000 (00:21 +0100)]
ported back to Gearman::Client

12 years agocleanup md5sum_close
Dobrica Pavlinusic [Mon, 12 Dec 2011 23:03:02 +0000 (00:03 +0100)]
cleanup md5sum_close

12 years agofix test
Dobrica Pavlinusic [Mon, 12 Dec 2011 22:50:01 +0000 (23:50 +0100)]
fix test

12 years agomore strictly parse login and path
Dobrica Pavlinusic [Mon, 12 Dec 2011 22:48:06 +0000 (23:48 +0100)]
more strictly parse login and path

12 years agoimplmenet md5sum for rename_file (and rename :-)
Dobrica Pavlinusic [Mon, 12 Dec 2011 22:44:08 +0000 (23:44 +0100)]
implmenet md5sum for rename_file (and rename :-)

12 years agomd5 user uses filename
Dobrica Pavlinusic [Mon, 12 Dec 2011 22:43:35 +0000 (23:43 +0100)]
md5 user uses filename

12 years agoimplement send_file md5sum handling
Dobrica Pavlinusic [Mon, 12 Dec 2011 22:33:26 +0000 (23:33 +0100)]
implement send_file md5sum handling

also return success value from link call

12 years agorewrite send_file to use new API
Dobrica Pavlinusic [Mon, 12 Dec 2011 22:05:33 +0000 (23:05 +0100)]
rewrite send_file to use new API

12 years agocreate test file only if it doesn't exist
Dobrica Pavlinusic [Mon, 12 Dec 2011 22:05:06 +0000 (23:05 +0100)]
create test file only if it doesn't exist

12 years agodie on invalid user_info
Dobrica Pavlinusic [Mon, 12 Dec 2011 22:04:24 +0000 (23:04 +0100)]
die on invalid user_info

12 years agocorrect last test and don't output to STDOUT to make prove happy
Dobrica Pavlinusic [Mon, 12 Dec 2011 20:55:51 +0000 (21:55 +0100)]
correct last test and don't output to STDOUT to make prove happy

12 years agorecord /.meta/md5sum and correct TokyoCabinet usage
Dobrica Pavlinusic [Mon, 12 Dec 2011 20:50:16 +0000 (21:50 +0100)]
record /.meta/md5sum and correct TokyoCabinet usage

12 years agodie on inter-slice send
Dobrica Pavlinusic [Mon, 12 Dec 2011 19:53:21 +0000 (20:53 +0100)]
die on inter-slice send

12 years agomake .meta path for rsync secrets file
Dobrica Pavlinusic [Mon, 12 Dec 2011 19:50:57 +0000 (20:50 +0100)]
make .meta path for rsync secrets file

This way it ends up owned by root which is a good thing.

12 years agocreate md5pool on empty slice
Dobrica Pavlinusic [Mon, 12 Dec 2011 19:50:17 +0000 (20:50 +0100)]
create md5pool on empty slice

12 years agobetter error reporting
Dobrica Pavlinusic [Mon, 12 Dec 2011 19:49:41 +0000 (20:49 +0100)]
better error reporting

12 years agomove rsync secrets file under .meta
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:59:11 +0000 (19:59 +0100)]
move rsync secrets file under .meta

12 years agorename to append_meta
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:58:56 +0000 (19:58 +0100)]
rename to append_meta

12 years agomove all users logs under .meta, and chown to user
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:54:38 +0000 (19:54 +0100)]
move all users logs under .meta, and chown to user

This allows to track size of log files and account it towards user quota

12 years agoremove unneeded user_info call
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:44:31 +0000 (19:44 +0100)]
remove unneeded user_info call

12 years agodon't steal own files
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:41:31 +0000 (19:41 +0100)]
don't steal own files

12 years agotest md5sum upload
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:16:17 +0000 (19:16 +0100)]
test md5sum upload

12 years agodon't put md5sum files into pool
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:07:34 +0000 (19:07 +0100)]
don't put md5sum files into pool

12 years agotest md5sum handling
Dobrica Pavlinusic [Mon, 12 Dec 2011 17:52:04 +0000 (18:52 +0100)]
test md5sum handling

12 years agomd5sum_dump now returns md5(space,space)path
Dobrica Pavlinusic [Mon, 12 Dec 2011 17:51:33 +0000 (18:51 +0100)]
md5sum_dump now returns md5(space,space)path

12 years agoremove file send via file API
Dobrica Pavlinusic [Mon, 12 Dec 2011 17:44:32 +0000 (18:44 +0100)]
remove file send via file API

12 years agoignore all .sync files from client
Dobrica Pavlinusic [Mon, 12 Dec 2011 17:34:52 +0000 (18:34 +0100)]
ignore all .sync files from client

12 years agodelete returns true, include md5sum
Dobrica Pavlinusic [Mon, 12 Dec 2011 00:43:38 +0000 (01:43 +0100)]
delete returns true, include md5sum

12 years agowrap append from API
Dobrica Pavlinusic [Mon, 12 Dec 2011 00:12:24 +0000 (01:12 +0100)]
wrap append from API

12 years agomore store test cleanups
Dobrica Pavlinusic [Mon, 12 Dec 2011 00:12:15 +0000 (01:12 +0100)]
more store test cleanups

12 years agocorrectly create test file
Dobrica Pavlinusic [Mon, 12 Dec 2011 00:08:54 +0000 (01:08 +0100)]
correctly create test file

12 years agomore correct (not complete) chown and usage tracking for rsync
Dobrica Pavlinusic [Mon, 12 Dec 2011 00:01:02 +0000 (01:01 +0100)]
more correct (not complete) chown and usage tracking for rsync

12 years agoextract MD5sum handling using TokyoCabinet
Dobrica Pavlinusic [Sun, 11 Dec 2011 22:56:23 +0000 (23:56 +0100)]
extract MD5sum handling using TokyoCabinet

12 years agouse slice name and get dir from group
Dobrica Pavlinusic [Sun, 11 Dec 2011 12:55:20 +0000 (13:55 +0100)]
use slice name and get dir from group

12 years agoremove obsoleted shell code
Dobrica Pavlinusic [Sat, 10 Dec 2011 21:44:05 +0000 (22:44 +0100)]
remove obsoleted shell code

12 years agocreate rsync secrets
Dobrica Pavlinusic [Sat, 10 Dec 2011 21:43:18 +0000 (22:43 +0100)]
create rsync secrets

12 years agouse CloudStore::API
Dobrica Pavlinusic [Sat, 10 Dec 2011 21:39:37 +0000 (22:39 +0100)]
use CloudStore::API

12 years agouse bytes for create_user
Dobrica Pavlinusic [Sat, 10 Dec 2011 21:39:25 +0000 (22:39 +0100)]
use bytes for create_user

12 years agopass slice group name to new
Dobrica Pavlinusic [Sat, 10 Dec 2011 21:39:06 +0000 (22:39 +0100)]
pass slice group name to new

12 years agoinclude system quota using gearman
Dobrica Pavlinusic [Sat, 10 Dec 2011 17:20:31 +0000 (18:20 +0100)]
include system quota using gearman

12 years agotweaks
Dobrica Pavlinusic [Sat, 10 Dec 2011 17:16:16 +0000 (18:16 +0100)]
tweaks

12 years agoGearman::XS client implementation
Dobrica Pavlinusic [Sat, 10 Dec 2011 17:15:39 +0000 (18:15 +0100)]
Gearman::XS client implementation

12 years agofinish quota set/get worker and test it
root [Sat, 10 Dec 2011 15:35:28 +0000 (16:35 +0100)]
finish quota set/get worker and test it

12 years agolinux get quota worker
root [Sat, 10 Dec 2011 14:38:00 +0000 (15:38 +0100)]
linux get quota worker

12 years agocalculate usage based on log files
Dobrica Pavlinusic [Sat, 10 Dec 2011 13:53:19 +0000 (14:53 +0100)]
calculate usage based on log files

12 years agoadded delete
Dobrica Pavlinusic [Sat, 10 Dec 2011 00:51:34 +0000 (01:51 +0100)]
added delete

12 years agocreate sent/received logs
Dobrica Pavlinusic [Sat, 10 Dec 2011 00:13:18 +0000 (01:13 +0100)]
create sent/received logs

12 years agouser_info($login|$uid)
Dobrica Pavlinusic [Fri, 9 Dec 2011 21:22:16 +0000 (22:22 +0100)]
user_info($login|$uid)

12 years agobegin API rewrite to expose with gearman
Dobrica Pavlinusic [Fri, 9 Dec 2011 20:36:29 +0000 (21:36 +0100)]
begin API rewrite to expose with gearman

create_user

12 years agoquery zfs quota
Dobrica Pavlinusic [Fri, 9 Dec 2011 20:29:39 +0000 (21:29 +0100)]
query zfs quota

12 years agocleanup everything from ~u2002 for test
Dobrica Pavlinusic [Thu, 8 Dec 2011 13:40:03 +0000 (14:40 +0100)]
cleanup everything from ~u2002 for test

12 years agoappend logs to existing files
Dobrica Pavlinusic [Thu, 8 Dec 2011 13:39:32 +0000 (14:39 +0100)]
append logs to existing files

12 years agorename_file Gearman API
Dobrica Pavlinusic [Wed, 7 Dec 2011 22:11:06 +0000 (23:11 +0100)]
rename_file Gearman API

12 years agoextract init and cleanup
Dobrica Pavlinusic [Wed, 7 Dec 2011 21:10:10 +0000 (22:10 +0100)]
extract init and cleanup

12 years agouse mkbasepath more
Dobrica Pavlinusic [Tue, 6 Dec 2011 14:35:28 +0000 (15:35 +0100)]
use mkbasepath more

12 years agostunnel client on rsync://localhost:12345/ for testing
root [Wed, 30 Nov 2011 23:58:01 +0000 (00:58 +0100)]
stunnel client on localhost:12345/ for testing

12 years agoturn into server
root [Wed, 30 Nov 2011 23:55:56 +0000 (00:55 +0100)]
turn into server

12 years agostart/stop stunnel
root [Wed, 30 Nov 2011 23:13:49 +0000 (00:13 +0100)]
start/stop stunnel

and refactor to make BACKGROUND optional

12 years agostart/stop stunnel
root [Wed, 30 Nov 2011 23:01:57 +0000 (00:01 +0100)]
start/stop stunnel

12 years agoadded init script for monit
root [Wed, 30 Nov 2011 20:22:32 +0000 (21:22 +0100)]
added init script for monit

12 years agochroot into slice dir to limit security exposure
Dobrica Pavlinusic [Wed, 30 Nov 2011 20:20:18 +0000 (21:20 +0100)]
chroot into slice dir to limit security exposure

12 years agostore send_file and delete operation in log
Dobrica Pavlinusic [Tue, 29 Nov 2011 23:02:34 +0000 (00:02 +0100)]
store send_file and delete operation in log

12 years agotest Gearman API
Dobrica Pavlinusic [Tue, 29 Nov 2011 22:58:37 +0000 (23:58 +0100)]
test Gearman API

12 years agoreport errors better in send_file
Dobrica Pavlinusic [Tue, 29 Nov 2011 21:21:03 +0000 (22:21 +0100)]
report errors better in send_file

12 years agoremote_tree for directory deletion
Dobrica Pavlinusic [Fri, 25 Nov 2011 12:58:23 +0000 (13:58 +0100)]
remote_tree for directory deletion

12 years agoadded delete gearman worker
Dobrica Pavlinusic [Thu, 24 Nov 2011 21:13:35 +0000 (22:13 +0100)]
added delete gearman worker

12 years agotest delte with spaces
Dobrica Pavlinusic [Thu, 24 Nov 2011 20:59:35 +0000 (21:59 +0100)]
test delte with spaces

12 years agoremove old shell implementation
Dobrica Pavlinusic [Wed, 23 Nov 2011 17:56:32 +0000 (18:56 +0100)]
remove old shell implementation

12 years agore-implement send_file as perl script
Dobrica Pavlinusic [Wed, 23 Nov 2011 17:47:35 +0000 (18:47 +0100)]
re-implement send_file as perl script

This allows us to correctly deal with spaces in filenames and dirnames

12 years agormdir directories
Dobrica Pavlinusic [Sun, 20 Nov 2011 21:39:59 +0000 (22:39 +0100)]
rmdir directories

12 years agotest directory delete
Dobrica Pavlinusic [Sun, 20 Nov 2011 21:37:05 +0000 (22:37 +0100)]
test directory delete

12 years agostatus of gearman workers
Dobrica Pavlinusic [Thu, 17 Nov 2011 23:42:14 +0000 (00:42 +0100)]
status of gearman workers

12 years agoscript to start worker and capture log
Dobrica Pavlinusic [Thu, 17 Nov 2011 23:41:46 +0000 (00:41 +0100)]
script to start worker and capture log

12 years agolocal IP
Dobrica Pavlinusic [Tue, 15 Nov 2011 20:57:55 +0000 (21:57 +0100)]
local IP

12 years agofix DELETED and test it
Dobrica Pavlinusic [Thu, 17 Nov 2011 20:45:30 +0000 (21:45 +0100)]
fix DELETED and test it

12 years agosend_file gearman API
Dobrica Pavlinusic [Tue, 15 Nov 2011 17:33:40 +0000 (18:33 +0100)]
send_file gearman API

12 years agocreate_user skeleton code for Gearman
Dobrica Pavlinusic [Tue, 15 Nov 2011 17:11:01 +0000 (18:11 +0100)]
create_user skeleton code for Gearman

12 years agoremove debug output
Dobrica Pavlinusic [Fri, 28 Oct 2011 09:45:38 +0000 (11:45 +0200)]
remove debug output

12 years agoset user quota
Dobrica Pavlinusic [Fri, 28 Oct 2011 09:43:10 +0000 (11:43 +0200)]
set user quota

12 years agoskip missing files for unlink
Dobrica Pavlinusic [Wed, 26 Oct 2011 10:26:59 +0000 (12:26 +0200)]
skip missing files for unlink

12 years agoadded DELETED pending log
Dobrica Pavlinusic [Tue, 25 Oct 2011 17:03:33 +0000 (19:03 +0200)]
added DELETED pending log

12 years agoshow path with open error
Dobrica Pavlinusic [Sat, 22 Oct 2011 10:50:20 +0000 (12:50 +0200)]
show path with open error

12 years agouse SLICE from env.sh
Dobrica Pavlinusic [Wed, 19 Oct 2011 21:12:34 +0000 (23:12 +0200)]
use SLICE from env.sh

12 years agoextract rsync_rebuild_config and call it for some keywords in log
root [Wed, 19 Oct 2011 18:50:53 +0000 (20:50 +0200)]
extract rsync_rebuild_config and call it for some keywords in log

12 years agouse $SLICE from env.sh
Dobrica Pavlinusic [Wed, 19 Oct 2011 18:41:41 +0000 (20:41 +0200)]
use $SLICE from env.sh

12 years agouse hostname for base slice dir
Dobrica Pavlinusic [Wed, 19 Oct 2011 18:37:38 +0000 (20:37 +0200)]
use hostname for base slice dir

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Thu, 13 Oct 2011 10:06:06 +0000 (12:06 +0200)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years ago100k quota for test user u2002
Dobrica Pavlinusic [Thu, 13 Oct 2011 10:05:54 +0000 (12:05 +0200)]
100k quota for test user u2002

12 years agodon't die on rename of non-existing file
Dobrica Pavlinusic [Thu, 13 Oct 2011 10:05:38 +0000 (12:05 +0200)]
don't die on rename of non-existing file

12 years agouse env.sh and u2002 login
Dobrica Pavlinusic [Wed, 12 Oct 2011 15:37:55 +0000 (17:37 +0200)]
use env.sh and u2002 login

12 years agouse env.sh config
Dobrica Pavlinusic [Wed, 12 Oct 2011 15:37:01 +0000 (17:37 +0200)]
use env.sh config

12 years agodon't try to rename non-existing files
Dobrica Pavlinusic [Tue, 11 Oct 2011 14:53:05 +0000 (16:53 +0200)]
don't try to rename non-existing files

12 years agomake dir prefix before .sync/(send|pending) optional (ie. work in root dir)
Dobrica Pavlinusic [Tue, 11 Oct 2011 14:52:31 +0000 (16:52 +0200)]
make dir prefix before .sync/(send|pending) optional (ie. work in root dir)

12 years agosupport MOVED or RENAMED
Dobrica Pavlinusic [Tue, 11 Oct 2011 14:35:57 +0000 (16:35 +0200)]
support MOVED or RENAMED

12 years agoinit zfs slice
Dobrica Pavlinusic [Mon, 10 Oct 2011 20:27:20 +0000 (22:27 +0200)]
init zfs slice

12 years agodump user md5sum file and use it for test
Dobrica Pavlinusic [Mon, 10 Oct 2011 20:26:36 +0000 (22:26 +0200)]
dump user md5sum file and use it for test

12 years agodelete md5 for removed files
Dobrica Pavlinusic [Mon, 10 Oct 2011 20:26:27 +0000 (22:26 +0200)]
delete md5 for removed files