cloudstore.git
12 years agomake .meta path for rsync secrets file
Dobrica Pavlinusic [Mon, 12 Dec 2011 19:50:57 +0000 (20:50 +0100)]
make .meta path for rsync secrets file

This way it ends up owned by root which is a good thing.

12 years agocreate md5pool on empty slice
Dobrica Pavlinusic [Mon, 12 Dec 2011 19:50:17 +0000 (20:50 +0100)]
create md5pool on empty slice

12 years agobetter error reporting
Dobrica Pavlinusic [Mon, 12 Dec 2011 19:49:41 +0000 (20:49 +0100)]
better error reporting

12 years agomove rsync secrets file under .meta
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:59:11 +0000 (19:59 +0100)]
move rsync secrets file under .meta

12 years agorename to append_meta
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:58:56 +0000 (19:58 +0100)]
rename to append_meta

12 years agomove all users logs under .meta, and chown to user
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:54:38 +0000 (19:54 +0100)]
move all users logs under .meta, and chown to user

This allows to track size of log files and account it towards user quota

12 years agoremove unneeded user_info call
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:44:31 +0000 (19:44 +0100)]
remove unneeded user_info call

12 years agodon't steal own files
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:41:31 +0000 (19:41 +0100)]
don't steal own files

12 years agotest md5sum upload
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:16:17 +0000 (19:16 +0100)]
test md5sum upload

12 years agodon't put md5sum files into pool
Dobrica Pavlinusic [Mon, 12 Dec 2011 18:07:34 +0000 (19:07 +0100)]
don't put md5sum files into pool

12 years agotest md5sum handling
Dobrica Pavlinusic [Mon, 12 Dec 2011 17:52:04 +0000 (18:52 +0100)]
test md5sum handling

12 years agomd5sum_dump now returns md5(space,space)path
Dobrica Pavlinusic [Mon, 12 Dec 2011 17:51:33 +0000 (18:51 +0100)]
md5sum_dump now returns md5(space,space)path

12 years agoremove file send via file API
Dobrica Pavlinusic [Mon, 12 Dec 2011 17:44:32 +0000 (18:44 +0100)]
remove file send via file API

12 years agoignore all .sync files from client
Dobrica Pavlinusic [Mon, 12 Dec 2011 17:34:52 +0000 (18:34 +0100)]
ignore all .sync files from client

12 years agodelete returns true, include md5sum
Dobrica Pavlinusic [Mon, 12 Dec 2011 00:43:38 +0000 (01:43 +0100)]
delete returns true, include md5sum

12 years agowrap append from API
Dobrica Pavlinusic [Mon, 12 Dec 2011 00:12:24 +0000 (01:12 +0100)]
wrap append from API

12 years agomore store test cleanups
Dobrica Pavlinusic [Mon, 12 Dec 2011 00:12:15 +0000 (01:12 +0100)]
more store test cleanups

12 years agocorrectly create test file
Dobrica Pavlinusic [Mon, 12 Dec 2011 00:08:54 +0000 (01:08 +0100)]
correctly create test file

12 years agomore correct (not complete) chown and usage tracking for rsync
Dobrica Pavlinusic [Mon, 12 Dec 2011 00:01:02 +0000 (01:01 +0100)]
more correct (not complete) chown and usage tracking for rsync

12 years agoextract MD5sum handling using TokyoCabinet
Dobrica Pavlinusic [Sun, 11 Dec 2011 22:56:23 +0000 (23:56 +0100)]
extract MD5sum handling using TokyoCabinet

12 years agouse slice name and get dir from group
Dobrica Pavlinusic [Sun, 11 Dec 2011 12:55:20 +0000 (13:55 +0100)]
use slice name and get dir from group

12 years agoremove obsoleted shell code
Dobrica Pavlinusic [Sat, 10 Dec 2011 21:44:05 +0000 (22:44 +0100)]
remove obsoleted shell code

12 years agocreate rsync secrets
Dobrica Pavlinusic [Sat, 10 Dec 2011 21:43:18 +0000 (22:43 +0100)]
create rsync secrets

12 years agouse CloudStore::API
Dobrica Pavlinusic [Sat, 10 Dec 2011 21:39:37 +0000 (22:39 +0100)]
use CloudStore::API

12 years agouse bytes for create_user
Dobrica Pavlinusic [Sat, 10 Dec 2011 21:39:25 +0000 (22:39 +0100)]
use bytes for create_user

12 years agopass slice group name to new
Dobrica Pavlinusic [Sat, 10 Dec 2011 21:39:06 +0000 (22:39 +0100)]
pass slice group name to new

12 years agoinclude system quota using gearman
Dobrica Pavlinusic [Sat, 10 Dec 2011 17:20:31 +0000 (18:20 +0100)]
include system quota using gearman

12 years agotweaks
Dobrica Pavlinusic [Sat, 10 Dec 2011 17:16:16 +0000 (18:16 +0100)]
tweaks

12 years agoGearman::XS client implementation
Dobrica Pavlinusic [Sat, 10 Dec 2011 17:15:39 +0000 (18:15 +0100)]
Gearman::XS client implementation

12 years agofinish quota set/get worker and test it
root [Sat, 10 Dec 2011 15:35:28 +0000 (16:35 +0100)]
finish quota set/get worker and test it

12 years agolinux get quota worker
root [Sat, 10 Dec 2011 14:38:00 +0000 (15:38 +0100)]
linux get quota worker

12 years agocalculate usage based on log files
Dobrica Pavlinusic [Sat, 10 Dec 2011 13:53:19 +0000 (14:53 +0100)]
calculate usage based on log files

12 years agoadded delete
Dobrica Pavlinusic [Sat, 10 Dec 2011 00:51:34 +0000 (01:51 +0100)]
added delete

12 years agocreate sent/received logs
Dobrica Pavlinusic [Sat, 10 Dec 2011 00:13:18 +0000 (01:13 +0100)]
create sent/received logs

12 years agouser_info($login|$uid)
Dobrica Pavlinusic [Fri, 9 Dec 2011 21:22:16 +0000 (22:22 +0100)]
user_info($login|$uid)

12 years agobegin API rewrite to expose with gearman
Dobrica Pavlinusic [Fri, 9 Dec 2011 20:36:29 +0000 (21:36 +0100)]
begin API rewrite to expose with gearman

create_user

12 years agoquery zfs quota
Dobrica Pavlinusic [Fri, 9 Dec 2011 20:29:39 +0000 (21:29 +0100)]
query zfs quota

12 years agocleanup everything from ~u2002 for test
Dobrica Pavlinusic [Thu, 8 Dec 2011 13:40:03 +0000 (14:40 +0100)]
cleanup everything from ~u2002 for test

12 years agoappend logs to existing files
Dobrica Pavlinusic [Thu, 8 Dec 2011 13:39:32 +0000 (14:39 +0100)]
append logs to existing files

12 years agorename_file Gearman API
Dobrica Pavlinusic [Wed, 7 Dec 2011 22:11:06 +0000 (23:11 +0100)]
rename_file Gearman API

12 years agoextract init and cleanup
Dobrica Pavlinusic [Wed, 7 Dec 2011 21:10:10 +0000 (22:10 +0100)]
extract init and cleanup

12 years agouse mkbasepath more
Dobrica Pavlinusic [Tue, 6 Dec 2011 14:35:28 +0000 (15:35 +0100)]
use mkbasepath more

12 years agostunnel client on rsync://localhost:12345/ for testing
root [Wed, 30 Nov 2011 23:58:01 +0000 (00:58 +0100)]
stunnel client on localhost:12345/ for testing

12 years agoturn into server
root [Wed, 30 Nov 2011 23:55:56 +0000 (00:55 +0100)]
turn into server

12 years agostart/stop stunnel
root [Wed, 30 Nov 2011 23:13:49 +0000 (00:13 +0100)]
start/stop stunnel

and refactor to make BACKGROUND optional

12 years agostart/stop stunnel
root [Wed, 30 Nov 2011 23:01:57 +0000 (00:01 +0100)]
start/stop stunnel

12 years agoadded init script for monit
root [Wed, 30 Nov 2011 20:22:32 +0000 (21:22 +0100)]
added init script for monit

12 years agochroot into slice dir to limit security exposure
Dobrica Pavlinusic [Wed, 30 Nov 2011 20:20:18 +0000 (21:20 +0100)]
chroot into slice dir to limit security exposure

12 years agostore send_file and delete operation in log
Dobrica Pavlinusic [Tue, 29 Nov 2011 23:02:34 +0000 (00:02 +0100)]
store send_file and delete operation in log

12 years agotest Gearman API
Dobrica Pavlinusic [Tue, 29 Nov 2011 22:58:37 +0000 (23:58 +0100)]
test Gearman API

12 years agoreport errors better in send_file
Dobrica Pavlinusic [Tue, 29 Nov 2011 21:21:03 +0000 (22:21 +0100)]
report errors better in send_file

12 years agoremote_tree for directory deletion
Dobrica Pavlinusic [Fri, 25 Nov 2011 12:58:23 +0000 (13:58 +0100)]
remote_tree for directory deletion

12 years agoadded delete gearman worker
Dobrica Pavlinusic [Thu, 24 Nov 2011 21:13:35 +0000 (22:13 +0100)]
added delete gearman worker

12 years agotest delte with spaces
Dobrica Pavlinusic [Thu, 24 Nov 2011 20:59:35 +0000 (21:59 +0100)]
test delte with spaces

12 years agoremove old shell implementation
Dobrica Pavlinusic [Wed, 23 Nov 2011 17:56:32 +0000 (18:56 +0100)]
remove old shell implementation

12 years agore-implement send_file as perl script
Dobrica Pavlinusic [Wed, 23 Nov 2011 17:47:35 +0000 (18:47 +0100)]
re-implement send_file as perl script

This allows us to correctly deal with spaces in filenames and dirnames

12 years agormdir directories
Dobrica Pavlinusic [Sun, 20 Nov 2011 21:39:59 +0000 (22:39 +0100)]
rmdir directories

12 years agotest directory delete
Dobrica Pavlinusic [Sun, 20 Nov 2011 21:37:05 +0000 (22:37 +0100)]
test directory delete

12 years agostatus of gearman workers
Dobrica Pavlinusic [Thu, 17 Nov 2011 23:42:14 +0000 (00:42 +0100)]
status of gearman workers

12 years agoscript to start worker and capture log
Dobrica Pavlinusic [Thu, 17 Nov 2011 23:41:46 +0000 (00:41 +0100)]
script to start worker and capture log

12 years agolocal IP
Dobrica Pavlinusic [Tue, 15 Nov 2011 20:57:55 +0000 (21:57 +0100)]
local IP

12 years agofix DELETED and test it
Dobrica Pavlinusic [Thu, 17 Nov 2011 20:45:30 +0000 (21:45 +0100)]
fix DELETED and test it

12 years agosend_file gearman API
Dobrica Pavlinusic [Tue, 15 Nov 2011 17:33:40 +0000 (18:33 +0100)]
send_file gearman API

12 years agocreate_user skeleton code for Gearman
Dobrica Pavlinusic [Tue, 15 Nov 2011 17:11:01 +0000 (18:11 +0100)]
create_user skeleton code for Gearman

12 years agoremove debug output
Dobrica Pavlinusic [Fri, 28 Oct 2011 09:45:38 +0000 (11:45 +0200)]
remove debug output

12 years agoset user quota
Dobrica Pavlinusic [Fri, 28 Oct 2011 09:43:10 +0000 (11:43 +0200)]
set user quota

12 years agoskip missing files for unlink
Dobrica Pavlinusic [Wed, 26 Oct 2011 10:26:59 +0000 (12:26 +0200)]
skip missing files for unlink

12 years agoadded DELETED pending log
Dobrica Pavlinusic [Tue, 25 Oct 2011 17:03:33 +0000 (19:03 +0200)]
added DELETED pending log

12 years agoshow path with open error
Dobrica Pavlinusic [Sat, 22 Oct 2011 10:50:20 +0000 (12:50 +0200)]
show path with open error

12 years agouse SLICE from env.sh
Dobrica Pavlinusic [Wed, 19 Oct 2011 21:12:34 +0000 (23:12 +0200)]
use SLICE from env.sh

12 years agoextract rsync_rebuild_config and call it for some keywords in log
root [Wed, 19 Oct 2011 18:50:53 +0000 (20:50 +0200)]
extract rsync_rebuild_config and call it for some keywords in log

12 years agouse $SLICE from env.sh
Dobrica Pavlinusic [Wed, 19 Oct 2011 18:41:41 +0000 (20:41 +0200)]
use $SLICE from env.sh

12 years agouse hostname for base slice dir
Dobrica Pavlinusic [Wed, 19 Oct 2011 18:37:38 +0000 (20:37 +0200)]
use hostname for base slice dir

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Thu, 13 Oct 2011 10:06:06 +0000 (12:06 +0200)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years ago100k quota for test user u2002
Dobrica Pavlinusic [Thu, 13 Oct 2011 10:05:54 +0000 (12:05 +0200)]
100k quota for test user u2002

12 years agodon't die on rename of non-existing file
Dobrica Pavlinusic [Thu, 13 Oct 2011 10:05:38 +0000 (12:05 +0200)]
don't die on rename of non-existing file

12 years agouse env.sh and u2002 login
Dobrica Pavlinusic [Wed, 12 Oct 2011 15:37:55 +0000 (17:37 +0200)]
use env.sh and u2002 login

12 years agouse env.sh config
Dobrica Pavlinusic [Wed, 12 Oct 2011 15:37:01 +0000 (17:37 +0200)]
use env.sh config

12 years agodon't try to rename non-existing files
Dobrica Pavlinusic [Tue, 11 Oct 2011 14:53:05 +0000 (16:53 +0200)]
don't try to rename non-existing files

12 years agomake dir prefix before .sync/(send|pending) optional (ie. work in root dir)
Dobrica Pavlinusic [Tue, 11 Oct 2011 14:52:31 +0000 (16:52 +0200)]
make dir prefix before .sync/(send|pending) optional (ie. work in root dir)

12 years agosupport MOVED or RENAMED
Dobrica Pavlinusic [Tue, 11 Oct 2011 14:35:57 +0000 (16:35 +0200)]
support MOVED or RENAMED

12 years agoinit zfs slice
Dobrica Pavlinusic [Mon, 10 Oct 2011 20:27:20 +0000 (22:27 +0200)]
init zfs slice

12 years agodump user md5sum file and use it for test
Dobrica Pavlinusic [Mon, 10 Oct 2011 20:26:36 +0000 (22:26 +0200)]
dump user md5sum file and use it for test

12 years agodelete md5 for removed files
Dobrica Pavlinusic [Mon, 10 Oct 2011 20:26:27 +0000 (22:26 +0200)]
delete md5 for removed files

12 years agotest receiving of sent files
Dobrica Pavlinusic [Mon, 10 Oct 2011 20:02:30 +0000 (22:02 +0200)]
test receiving of sent files

12 years agoadded md5 TokyoCabinet and perms note
Dobrica Pavlinusic [Mon, 10 Oct 2011 20:00:53 +0000 (22:00 +0200)]
added md5 TokyoCabinet and perms note

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Mon, 10 Oct 2011 16:45:45 +0000 (18:45 +0200)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

Conflicts:
rsync-piper.pl
test.sh

12 years agoforce sane chmod on incoming files
Dobrica Pavlinusic [Mon, 10 Oct 2011 16:13:33 +0000 (18:13 +0200)]
force sane chmod on incoming files

group read for group sharing with other users in same slice, other read
for sharing with remote slices

12 years agoforce sane chmod on incoming files
Dobrica Pavlinusic [Mon, 10 Oct 2011 16:13:33 +0000 (18:13 +0200)]
force sane chmod on incoming files

12 years agohide .md5 file from rsync
Dobrica Pavlinusic [Mon, 10 Oct 2011 15:01:34 +0000 (17:01 +0200)]
hide .md5 file from rsync

12 years agoport md5 support to TokyoCabinet
Dobrica Pavlinusic [Sun, 9 Oct 2011 21:14:48 +0000 (23:14 +0200)]
port md5 support to TokyoCabinet

12 years agoimplement and test mv from pending log
Dobrica Pavlinusic [Sun, 9 Oct 2011 12:09:26 +0000 (14:09 +0200)]
implement and test mv from pending log

12 years agoremove unused files from md5pool
Dobrica Pavlinusic [Sat, 8 Oct 2011 23:29:53 +0000 (01:29 +0200)]
remove unused files from md5pool

12 years agonew .sync/send/timestamp
Dobrica Pavlinusic [Sat, 8 Oct 2011 23:24:03 +0000 (01:24 +0200)]
new .sync/send/timestamp

12 years agodirectories don't have md5sum
Dobrica Pavlinusic [Sat, 8 Oct 2011 22:22:30 +0000 (00:22 +0200)]
directories don't have md5sum

12 years agotest md5 chown
Dobrica Pavlinusic [Sat, 8 Oct 2011 22:13:43 +0000 (00:13 +0200)]
test md5 chown

12 years agochown md5pool to md5 user for last copy to correct quota usage
Dobrica Pavlinusic [Sat, 8 Oct 2011 22:00:52 +0000 (00:00 +0200)]
chown md5pool to md5 user for last copy to correct quota usage

12 years agosplit md5sum db per user
Dobrica Pavlinusic [Sat, 8 Oct 2011 16:31:49 +0000 (18:31 +0200)]
split md5sum db per user

12 years agoworking remove-user.sh for extrausers
Dobrica Pavlinusic [Sat, 8 Oct 2011 13:53:28 +0000 (15:53 +0200)]
working remove-user.sh for extrausers

12 years agouse logins from create-user.sh
Dobrica Pavlinusic [Sat, 8 Oct 2011 13:53:10 +0000 (15:53 +0200)]
use logins from create-user.sh