cloudstore.git
12 years agorename Couchbase to Store
Dobrica Pavlinusic [Tue, 20 Sep 2011 12:09:08 +0000 (12:09 +0000)]
rename Couchbase to Store

this is first step in refactoring to remove Membase as back-end store

12 years agouse libnss-extrausers to provide uids for quota
Dobrica Pavlinusic [Sun, 11 Sep 2011 15:12:53 +0000 (15:12 +0000)]
use libnss-extrausers to provide uids for quota

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Sun, 11 Sep 2011 13:29:51 +0000 (15:29 +0200)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years agoadded size_bytes
Dobrica Pavlinusic [Sun, 11 Sep 2011 13:29:47 +0000 (15:29 +0200)]
added size_bytes

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Thu, 8 Sep 2011 22:28:28 +0000 (22:28 +0000)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years agofirst working /.send/ implementation for all cases
Dobrica Pavlinusic [Thu, 8 Sep 2011 22:27:07 +0000 (22:27 +0000)]
first working /.send/ implementation for all cases

It doesn't die on non-existing files, but just on fatal errors,
create files in storage for sent file

12 years agouse blue and yellow more
Dobrica Pavlinusic [Thu, 8 Sep 2011 22:25:32 +0000 (22:25 +0000)]
use blue and yellow more

12 years agosend also file to send
Dobrica Pavlinusic [Thu, 8 Sep 2011 21:14:29 +0000 (21:14 +0000)]
send also file to send

12 years agocolor warn quotes yellow
Dobrica Pavlinusic [Thu, 8 Sep 2011 21:13:34 +0000 (21:13 +0000)]
color warn quotes yellow

12 years agocolorize server output
Dobrica Pavlinusic [Thu, 8 Sep 2011 19:00:25 +0000 (19:00 +0000)]
colorize server output

12 years agoreturn rsync xfer errors to client
Dobrica Pavlinusic [Thu, 8 Sep 2011 18:46:31 +0000 (18:46 +0000)]
return rsync xfer errors to client

by simple writing to STDOUT instead to STDERR

12 years agotest /.send/to/dir/file
Dobrica Pavlinusic [Thu, 8 Sep 2011 17:09:47 +0000 (17:09 +0000)]
test /.send/to/dir/file

12 years agoreformat output to single line per torrent
Dobrica Pavlinusic [Thu, 8 Sep 2011 14:21:28 +0000 (16:21 +0200)]
reformat output to single line per torrent

12 years agouse SOCKET from env
Dobrica Pavlinusic [Thu, 8 Sep 2011 14:01:47 +0000 (16:01 +0200)]
use SOCKET from env

12 years agoless output without DEBUG=1
Dobrica Pavlinusic [Thu, 8 Sep 2011 11:52:39 +0000 (11:52 +0000)]
less output without DEBUG=1

12 years agouse $USER for login and module
Dobrica Pavlinusic [Thu, 8 Sep 2011 11:50:19 +0000 (11:50 +0000)]
use $USER for login and module

12 years agoadopt running rsync instead of killing it
Dobrica Pavlinusic [Wed, 7 Sep 2011 21:54:17 +0000 (21:54 +0000)]
adopt running rsync instead of killing it

12 years agocreate directories in /.send/login/some/dir/file
Dobrica Pavlinusic [Wed, 7 Sep 2011 21:54:00 +0000 (21:54 +0000)]
create directories in /.send/login/some/dir/file

12 years agouse symlinks to transfer /.send/login/file informations
Dobrica Pavlinusic [Wed, 7 Sep 2011 21:26:59 +0000 (21:26 +0000)]
use symlinks to transfer /.send/login/file informations

12 years agolsyncd client
Dobrica Pavlinusic [Wed, 7 Sep 2011 19:01:25 +0000 (21:01 +0200)]
lsyncd client

12 years agorename client to more sensible name
Dobrica Pavlinusic [Wed, 7 Sep 2011 18:42:06 +0000 (20:42 +0200)]
rename client to more sensible name

12 years agosimple push once rsync client
Dobrica Pavlinusic [Wed, 7 Sep 2011 18:31:37 +0000 (20:31 +0200)]
simple push once rsync client

12 years agoconfigure default QUOTA env
Dobrica Pavlinusic [Wed, 7 Sep 2011 18:27:42 +0000 (18:27 +0000)]
configure default QUOTA env

12 years agospecify LIMIT and increase it to 10000 docs
Dobrica Pavlinusic [Mon, 5 Sep 2011 09:47:32 +0000 (09:47 +0000)]
specify LIMIT and increase it to 10000 docs

12 years agoverify that all entryies in store exists on filesystem
Dobrica Pavlinusic [Sun, 4 Sep 2011 21:50:23 +0000 (21:50 +0000)]
verify that all entryies in store exists on filesystem

12 years agocleanup and reformat status
Dobrica Pavlinusic [Sun, 4 Sep 2011 21:48:05 +0000 (21:48 +0000)]
cleanup and reformat status

12 years agoextract couchdb view call
Dobrica Pavlinusic [Sun, 4 Sep 2011 21:47:41 +0000 (21:47 +0000)]
extract couchdb view call

12 years agostore quota status in session
Dobrica Pavlinusic [Sun, 4 Sep 2011 18:00:14 +0000 (18:00 +0000)]
store quota status in session

12 years agoenforce user quota on rsync xfer hooks
Dobrica Pavlinusic [Sun, 4 Sep 2011 17:29:31 +0000 (17:29 +0000)]
enforce user quota on rsync xfer hooks

12 years agorsync server now creates user objects
Dobrica Pavlinusic [Sun, 4 Sep 2011 16:45:49 +0000 (16:45 +0000)]
rsync server now creates user objects

12 years agoadded users bucket
Dobrica Pavlinusic [Sun, 4 Sep 2011 16:09:40 +0000 (16:09 +0000)]
added users bucket

12 years agoadded usage_init from view
Dobrica Pavlinusic [Sat, 3 Sep 2011 23:12:37 +0000 (23:12 +0000)]
added usage_init from view

12 years agocreate production files view
Dobrica Pavlinusic [Sat, 3 Sep 2011 22:45:12 +0000 (22:45 +0000)]
create production files view

12 years agoignore compilation files
Dobrica Pavlinusic [Sat, 3 Sep 2011 22:37:33 +0000 (22:37 +0000)]
ignore compilation files

12 years agouse memcached session bucket for usage
Dobrica Pavlinusic [Sat, 3 Sep 2011 22:15:34 +0000 (22:15 +0000)]
use memcached session bucket for usage

12 years ago_key wrapper
Dobrica Pavlinusic [Sat, 3 Sep 2011 21:51:12 +0000 (21:51 +0000)]
_key wrapper

12 years agocreate couchbase data buckets
Dobrica Pavlinusic [Sat, 3 Sep 2011 21:21:27 +0000 (21:21 +0000)]
create couchbase data buckets

12 years agobetter test non-existing md5sum directory
Dobrica Pavlinusic [Sat, 3 Sep 2011 21:20:57 +0000 (21:20 +0000)]
better test non-existing md5sum directory

12 years agofix fake md5sum import objects
Dobrica Pavlinusic [Sat, 3 Sep 2011 21:17:52 +0000 (21:17 +0000)]
fix fake md5sum import objects

12 years agoclean blob before test
Dobrica Pavlinusic [Sat, 3 Sep 2011 18:41:48 +0000 (18:41 +0000)]
clean blob before test

12 years agosimplify remove file
Dobrica Pavlinusic [Sat, 3 Sep 2011 18:19:02 +0000 (18:19 +0000)]
simplify remove file

12 years agofake data entry for files from md5sum
Dobrica Pavlinusic [Sat, 3 Sep 2011 17:36:20 +0000 (17:36 +0000)]
fake data entry for files from md5sum

12 years agomake_path must be exported if md5sum path doesn't exist
Dobrica Pavlinusic [Sat, 3 Sep 2011 17:35:42 +0000 (17:35 +0000)]
make_path must be exported if md5sum path doesn't exist

12 years agorename module to Couchbase
Dobrica Pavlinusic [Sat, 3 Sep 2011 16:22:47 +0000 (16:22 +0000)]
rename module to Couchbase

12 years agoexperimental Couchbase storage API
Dobrica Pavlinusic [Sat, 3 Sep 2011 15:14:19 +0000 (15:14 +0000)]
experimental Couchbase storage API

12 years agoadded memcache to store data in couchbase
Dobrica Pavlinusic [Fri, 2 Sep 2011 11:42:52 +0000 (11:42 +0000)]
added memcache to store data in couchbase

12 years agoadded child reaper
Dobrica Pavlinusic [Thu, 1 Sep 2011 14:45:22 +0000 (14:45 +0000)]
added child reaper

12 years agocreate full paths from md5sum files
Dobrica Pavlinusic [Thu, 1 Sep 2011 10:35:52 +0000 (10:35 +0000)]
create full paths from md5sum files

12 years agomd5sum from subdirectory
Dobrica Pavlinusic [Mon, 29 Aug 2011 18:03:35 +0000 (18:03 +0000)]
md5sum from subdirectory

12 years agomktorrent binary
Dobrica Pavlinusic [Sun, 28 Aug 2011 14:42:44 +0000 (14:42 +0000)]
mktorrent binary

12 years agomove all torrent configuration into config.sh
Dobrica Pavlinusic [Sat, 27 Aug 2011 15:14:23 +0000 (15:14 +0000)]
move all torrent configuration into config.sh

12 years agoadd libtorrnet_resume for fastresume
Dobrica Pavlinusic [Sat, 27 Aug 2011 11:51:09 +0000 (11:51 +0000)]
add libtorrnet_resume for fastresume

http://libtorrent.rakshasa.no/wiki/RTorrentCommonTasks

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:27:00 +0000 (00:27 +0000)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years agousage example
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:26:43 +0000 (00:26 +0000)]
usage example

12 years agoconfigurable seeder address
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:26:33 +0000 (00:26 +0000)]
configurable seeder address

12 years agoquery rtorrent status over socket
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:23:29 +0000 (00:23 +0000)]
query rtorrent status over socket

12 years agostart rtorrent for seeding
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:20:45 +0000 (00:20 +0000)]
start rtorrent for seeding

12 years agofix typo
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:05:37 +0000 (00:05 +0000)]
fix typo

12 years agostart open tracker
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:04:18 +0000 (00:04 +0000)]
start open tracker

12 years agoadded opentracker binary
Dobrica Pavlinusic [Fri, 26 Aug 2011 23:47:26 +0000 (23:47 +0000)]
added opentracker binary

12 years agodump torrent file
Dobrica Pavlinusic [Fri, 26 Aug 2011 15:25:04 +0000 (15:25 +0000)]
dump torrent file

12 years agobind to IP and open scgi socket, fix schedule
Dobrica Pavlinusic [Fri, 26 Aug 2011 15:23:37 +0000 (15:23 +0000)]
bind to IP and open scgi socket, fix schedule

12 years agocreate torrent file and symlinks for seeding
Dobrica Pavlinusic [Fri, 26 Aug 2011 15:08:12 +0000 (15:08 +0000)]
create torrent file and symlinks for seeding

12 years agodebian packages required on server setup
Dobrica Pavlinusic [Thu, 25 Aug 2011 18:49:10 +0000 (18:49 +0000)]
debian packages required on server setup

12 years agolink to torrent specification
Dobrica Pavlinusic [Thu, 25 Aug 2011 18:48:41 +0000 (18:48 +0000)]
link to torrent specification

12 years agohttp://wiki.theory.org/BitTorrentSpecification
Dobrica Pavlinusic [Thu, 25 Aug 2011 18:46:11 +0000 (18:46 +0000)]
http://wiki.theory.org/BitTorrentSpecification

12 years agoinitial explanation of motivation for torrent protocol
Dobrica Pavlinusic [Thu, 25 Aug 2011 18:20:11 +0000 (18:20 +0000)]
initial explanation of motivation for torrent protocol

12 years agoimprove documentation for available scripts
Dobrica Pavlinusic [Wed, 24 Aug 2011 11:54:34 +0000 (13:54 +0200)]
improve documentation for available scripts

12 years agodon't fail on non-existing users
Dobrica Pavlinusic [Wed, 24 Aug 2011 00:07:27 +0000 (02:07 +0200)]
don't fail on non-existing users

12 years agoneed File::Path
Dobrica Pavlinusic [Wed, 24 Aug 2011 00:07:05 +0000 (02:07 +0200)]
need File::Path

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:35:03 +0000 (01:35 +0200)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years agostart tracker
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:34:18 +0000 (23:34 +0000)]
start tracker

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:32:21 +0000 (23:32 +0000)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years agoenable features
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:31:28 +0000 (23:31 +0000)]
enable features

12 years agodie if process can't be killed
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:31:05 +0000 (23:31 +0000)]
die if process can't be killed

12 years agorsync version 3.1.0dev protocol version 31.PR13
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:30:08 +0000 (23:30 +0000)]
rsync  version 3.1.0dev  protocol version 31.PR13

12 years agocomment out gearman requirement
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:25:43 +0000 (01:25 +0200)]
comment out gearman requirement

12 years agodon't die if database doesn't exist
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:21:27 +0000 (01:21 +0200)]
don't die if database doesn't exist

12 years agoinstall required packages
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:19:58 +0000 (01:19 +0200)]
install required packages

12 years agortorrent configuration which watch for new torrent files
Dobrica Pavlinusic [Thu, 18 Aug 2011 10:53:52 +0000 (10:53 +0000)]
rtorrent configuration which watch for new torrent files

12 years agortorrent.rc from examples
Dobrica Pavlinusic [Wed, 17 Aug 2011 18:10:45 +0000 (18:10 +0000)]
rtorrent.rc from examples

12 years agoinstall mktorrent
Dobrica Pavlinusic [Wed, 17 Aug 2011 16:03:32 +0000 (16:03 +0000)]
install mktorrent

12 years agoinstall required debian packages
Dobrica Pavlinusic [Wed, 17 Aug 2011 14:39:28 +0000 (14:39 +0000)]
install required debian packages

12 years agofix permission
Dobrica Pavlinusic [Wed, 17 Aug 2011 14:38:54 +0000 (14:38 +0000)]
fix permission

12 years agocompile opentracker
Dobrica Pavlinusic [Wed, 17 Aug 2011 14:36:58 +0000 (16:36 +0200)]
compile opentracker

12 years agopush md5sum file to create files from server's md5 pool
Dobrica Pavlinusic [Fri, 22 Jul 2011 18:54:34 +0000 (18:54 +0000)]
push md5sum file to create files from server's md5 pool

12 years agoneed to chdir because glob seems to have limited length return values
Dobrica Pavlinusic [Fri, 22 Jul 2011 15:48:41 +0000 (15:48 +0000)]
need to chdir because glob seems to have limited length return values

12 years agoremove log file is fifo is needed
Dobrica Pavlinusic [Fri, 22 Jul 2011 15:01:09 +0000 (15:01 +0000)]
remove log file is fifo is needed

12 years agomore complete usage info for rsync-piper
Dobrica Pavlinusic [Fri, 22 Jul 2011 14:46:07 +0000 (14:46 +0000)]
more complete usage info for rsync-piper

12 years agouse login+hostname
Dobrica Pavlinusic [Fri, 22 Jul 2011 14:23:44 +0000 (14:23 +0000)]
use login+hostname

12 years agoremove test user before test
Dobrica Pavlinusic [Fri, 22 Jul 2011 13:19:07 +0000 (13:19 +0000)]
remove test user before test

12 years agokill rsync with INT if allready running
Dobrica Pavlinusic [Fri, 22 Jul 2011 13:15:02 +0000 (13:15 +0000)]
kill rsync with INT if allready running

12 years agosupport login+host usernames for client secrets
Dobrica Pavlinusic [Fri, 22 Jul 2011 12:51:43 +0000 (12:51 +0000)]
support login+host usernames for client secrets

12 years agodie on rsync error
Dobrica Pavlinusic [Fri, 22 Jul 2011 12:18:54 +0000 (12:18 +0000)]
die on rsync error

12 years agooverview of existing features
Dobrica Pavlinusic [Wed, 20 Jul 2011 21:12:12 +0000 (21:12 +0000)]
overview of existing features

12 years agogenerate var/dedup.log
Dobrica Pavlinusic [Tue, 19 Jul 2011 21:41:03 +0000 (21:41 +0000)]
generate var/dedup.log

12 years agoremove only affected file
Dobrica Pavlinusic [Tue, 19 Jul 2011 20:57:31 +0000 (20:57 +0000)]
remove only affected file

12 years agomake dedup pass test and refactore JSON store
Dobrica Pavlinusic [Tue, 19 Jul 2011 20:43:15 +0000 (20:43 +0000)]
make dedup pass test and refactore JSON store

- store directory data in dot files
- modify names of VFS calls
- show unused md5sum files queued for removal

12 years agofist dedup implementation
Dobrica Pavlinusic [Tue, 19 Jul 2011 19:32:42 +0000 (19:32 +0000)]
fist dedup implementation

12 years agostore modified JSON
Dobrica Pavlinusic [Tue, 19 Jul 2011 17:45:45 +0000 (17:45 +0000)]
store modified JSON