cloudstore.git
12 years agorsync server now creates user objects
Dobrica Pavlinusic [Sun, 4 Sep 2011 16:45:49 +0000 (16:45 +0000)]
rsync server now creates user objects

12 years agoadded users bucket
Dobrica Pavlinusic [Sun, 4 Sep 2011 16:09:40 +0000 (16:09 +0000)]
added users bucket

12 years agoadded usage_init from view
Dobrica Pavlinusic [Sat, 3 Sep 2011 23:12:37 +0000 (23:12 +0000)]
added usage_init from view

12 years agocreate production files view
Dobrica Pavlinusic [Sat, 3 Sep 2011 22:45:12 +0000 (22:45 +0000)]
create production files view

12 years agoignore compilation files
Dobrica Pavlinusic [Sat, 3 Sep 2011 22:37:33 +0000 (22:37 +0000)]
ignore compilation files

12 years agouse memcached session bucket for usage
Dobrica Pavlinusic [Sat, 3 Sep 2011 22:15:34 +0000 (22:15 +0000)]
use memcached session bucket for usage

12 years ago_key wrapper
Dobrica Pavlinusic [Sat, 3 Sep 2011 21:51:12 +0000 (21:51 +0000)]
_key wrapper

12 years agocreate couchbase data buckets
Dobrica Pavlinusic [Sat, 3 Sep 2011 21:21:27 +0000 (21:21 +0000)]
create couchbase data buckets

12 years agobetter test non-existing md5sum directory
Dobrica Pavlinusic [Sat, 3 Sep 2011 21:20:57 +0000 (21:20 +0000)]
better test non-existing md5sum directory

12 years agofix fake md5sum import objects
Dobrica Pavlinusic [Sat, 3 Sep 2011 21:17:52 +0000 (21:17 +0000)]
fix fake md5sum import objects

12 years agoclean blob before test
Dobrica Pavlinusic [Sat, 3 Sep 2011 18:41:48 +0000 (18:41 +0000)]
clean blob before test

12 years agosimplify remove file
Dobrica Pavlinusic [Sat, 3 Sep 2011 18:19:02 +0000 (18:19 +0000)]
simplify remove file

12 years agofake data entry for files from md5sum
Dobrica Pavlinusic [Sat, 3 Sep 2011 17:36:20 +0000 (17:36 +0000)]
fake data entry for files from md5sum

12 years agomake_path must be exported if md5sum path doesn't exist
Dobrica Pavlinusic [Sat, 3 Sep 2011 17:35:42 +0000 (17:35 +0000)]
make_path must be exported if md5sum path doesn't exist

12 years agorename module to Couchbase
Dobrica Pavlinusic [Sat, 3 Sep 2011 16:22:47 +0000 (16:22 +0000)]
rename module to Couchbase

12 years agoexperimental Couchbase storage API
Dobrica Pavlinusic [Sat, 3 Sep 2011 15:14:19 +0000 (15:14 +0000)]
experimental Couchbase storage API

12 years agoadded memcache to store data in couchbase
Dobrica Pavlinusic [Fri, 2 Sep 2011 11:42:52 +0000 (11:42 +0000)]
added memcache to store data in couchbase

12 years agoadded child reaper
Dobrica Pavlinusic [Thu, 1 Sep 2011 14:45:22 +0000 (14:45 +0000)]
added child reaper

12 years agocreate full paths from md5sum files
Dobrica Pavlinusic [Thu, 1 Sep 2011 10:35:52 +0000 (10:35 +0000)]
create full paths from md5sum files

12 years agomd5sum from subdirectory
Dobrica Pavlinusic [Mon, 29 Aug 2011 18:03:35 +0000 (18:03 +0000)]
md5sum from subdirectory

12 years agomktorrent binary
Dobrica Pavlinusic [Sun, 28 Aug 2011 14:42:44 +0000 (14:42 +0000)]
mktorrent binary

12 years agomove all torrent configuration into config.sh
Dobrica Pavlinusic [Sat, 27 Aug 2011 15:14:23 +0000 (15:14 +0000)]
move all torrent configuration into config.sh

12 years agoadd libtorrnet_resume for fastresume
Dobrica Pavlinusic [Sat, 27 Aug 2011 11:51:09 +0000 (11:51 +0000)]
add libtorrnet_resume for fastresume

http://libtorrent.rakshasa.no/wiki/RTorrentCommonTasks

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:27:00 +0000 (00:27 +0000)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years agousage example
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:26:43 +0000 (00:26 +0000)]
usage example

12 years agoconfigurable seeder address
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:26:33 +0000 (00:26 +0000)]
configurable seeder address

12 years agoquery rtorrent status over socket
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:23:29 +0000 (00:23 +0000)]
query rtorrent status over socket

12 years agostart rtorrent for seeding
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:20:45 +0000 (00:20 +0000)]
start rtorrent for seeding

12 years agofix typo
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:05:37 +0000 (00:05 +0000)]
fix typo

12 years agostart open tracker
Dobrica Pavlinusic [Sat, 27 Aug 2011 00:04:18 +0000 (00:04 +0000)]
start open tracker

12 years agoadded opentracker binary
Dobrica Pavlinusic [Fri, 26 Aug 2011 23:47:26 +0000 (23:47 +0000)]
added opentracker binary

12 years agodump torrent file
Dobrica Pavlinusic [Fri, 26 Aug 2011 15:25:04 +0000 (15:25 +0000)]
dump torrent file

12 years agobind to IP and open scgi socket, fix schedule
Dobrica Pavlinusic [Fri, 26 Aug 2011 15:23:37 +0000 (15:23 +0000)]
bind to IP and open scgi socket, fix schedule

12 years agocreate torrent file and symlinks for seeding
Dobrica Pavlinusic [Fri, 26 Aug 2011 15:08:12 +0000 (15:08 +0000)]
create torrent file and symlinks for seeding

12 years agodebian packages required on server setup
Dobrica Pavlinusic [Thu, 25 Aug 2011 18:49:10 +0000 (18:49 +0000)]
debian packages required on server setup

12 years agolink to torrent specification
Dobrica Pavlinusic [Thu, 25 Aug 2011 18:48:41 +0000 (18:48 +0000)]
link to torrent specification

12 years agohttp://wiki.theory.org/BitTorrentSpecification
Dobrica Pavlinusic [Thu, 25 Aug 2011 18:46:11 +0000 (18:46 +0000)]
http://wiki.theory.org/BitTorrentSpecification

12 years agoinitial explanation of motivation for torrent protocol
Dobrica Pavlinusic [Thu, 25 Aug 2011 18:20:11 +0000 (18:20 +0000)]
initial explanation of motivation for torrent protocol

12 years agoimprove documentation for available scripts
Dobrica Pavlinusic [Wed, 24 Aug 2011 11:54:34 +0000 (13:54 +0200)]
improve documentation for available scripts

12 years agodon't fail on non-existing users
Dobrica Pavlinusic [Wed, 24 Aug 2011 00:07:27 +0000 (02:07 +0200)]
don't fail on non-existing users

12 years agoneed File::Path
Dobrica Pavlinusic [Wed, 24 Aug 2011 00:07:05 +0000 (02:07 +0200)]
need File::Path

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:35:03 +0000 (01:35 +0200)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years agostart tracker
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:34:18 +0000 (23:34 +0000)]
start tracker

12 years agoMerge branch 'master' of git.rot13.org:/git/cloudstore
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:32:21 +0000 (23:32 +0000)]
Merge branch 'master' of git.rot13.org:/git/cloudstore

12 years agoenable features
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:31:28 +0000 (23:31 +0000)]
enable features

12 years agodie if process can't be killed
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:31:05 +0000 (23:31 +0000)]
die if process can't be killed

12 years agorsync version 3.1.0dev protocol version 31.PR13
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:30:08 +0000 (23:30 +0000)]
rsync  version 3.1.0dev  protocol version 31.PR13

12 years agocomment out gearman requirement
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:25:43 +0000 (01:25 +0200)]
comment out gearman requirement

12 years agodon't die if database doesn't exist
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:21:27 +0000 (01:21 +0200)]
don't die if database doesn't exist

12 years agoinstall required packages
Dobrica Pavlinusic [Tue, 23 Aug 2011 23:19:58 +0000 (01:19 +0200)]
install required packages

12 years agortorrent configuration which watch for new torrent files
Dobrica Pavlinusic [Thu, 18 Aug 2011 10:53:52 +0000 (10:53 +0000)]
rtorrent configuration which watch for new torrent files

12 years agortorrent.rc from examples
Dobrica Pavlinusic [Wed, 17 Aug 2011 18:10:45 +0000 (18:10 +0000)]
rtorrent.rc from examples

12 years agoinstall mktorrent
Dobrica Pavlinusic [Wed, 17 Aug 2011 16:03:32 +0000 (16:03 +0000)]
install mktorrent

12 years agoinstall required debian packages
Dobrica Pavlinusic [Wed, 17 Aug 2011 14:39:28 +0000 (14:39 +0000)]
install required debian packages

12 years agofix permission
Dobrica Pavlinusic [Wed, 17 Aug 2011 14:38:54 +0000 (14:38 +0000)]
fix permission

12 years agocompile opentracker
Dobrica Pavlinusic [Wed, 17 Aug 2011 14:36:58 +0000 (16:36 +0200)]
compile opentracker

12 years agopush md5sum file to create files from server's md5 pool
Dobrica Pavlinusic [Fri, 22 Jul 2011 18:54:34 +0000 (18:54 +0000)]
push md5sum file to create files from server's md5 pool

12 years agoneed to chdir because glob seems to have limited length return values
Dobrica Pavlinusic [Fri, 22 Jul 2011 15:48:41 +0000 (15:48 +0000)]
need to chdir because glob seems to have limited length return values

12 years agoremove log file is fifo is needed
Dobrica Pavlinusic [Fri, 22 Jul 2011 15:01:09 +0000 (15:01 +0000)]
remove log file is fifo is needed

12 years agomore complete usage info for rsync-piper
Dobrica Pavlinusic [Fri, 22 Jul 2011 14:46:07 +0000 (14:46 +0000)]
more complete usage info for rsync-piper

12 years agouse login+hostname
Dobrica Pavlinusic [Fri, 22 Jul 2011 14:23:44 +0000 (14:23 +0000)]
use login+hostname

12 years agoremove test user before test
Dobrica Pavlinusic [Fri, 22 Jul 2011 13:19:07 +0000 (13:19 +0000)]
remove test user before test

12 years agokill rsync with INT if allready running
Dobrica Pavlinusic [Fri, 22 Jul 2011 13:15:02 +0000 (13:15 +0000)]
kill rsync with INT if allready running

12 years agosupport login+host usernames for client secrets
Dobrica Pavlinusic [Fri, 22 Jul 2011 12:51:43 +0000 (12:51 +0000)]
support login+host usernames for client secrets

12 years agodie on rsync error
Dobrica Pavlinusic [Fri, 22 Jul 2011 12:18:54 +0000 (12:18 +0000)]
die on rsync error

12 years agooverview of existing features
Dobrica Pavlinusic [Wed, 20 Jul 2011 21:12:12 +0000 (21:12 +0000)]
overview of existing features

12 years agogenerate var/dedup.log
Dobrica Pavlinusic [Tue, 19 Jul 2011 21:41:03 +0000 (21:41 +0000)]
generate var/dedup.log

12 years agoremove only affected file
Dobrica Pavlinusic [Tue, 19 Jul 2011 20:57:31 +0000 (20:57 +0000)]
remove only affected file

12 years agomake dedup pass test and refactore JSON store
Dobrica Pavlinusic [Tue, 19 Jul 2011 20:43:15 +0000 (20:43 +0000)]
make dedup pass test and refactore JSON store

- store directory data in dot files
- modify names of VFS calls
- show unused md5sum files queued for removal

12 years agofist dedup implementation
Dobrica Pavlinusic [Tue, 19 Jul 2011 19:32:42 +0000 (19:32 +0000)]
fist dedup implementation

12 years agostore modified JSON
Dobrica Pavlinusic [Tue, 19 Jul 2011 17:45:45 +0000 (17:45 +0000)]
store modified JSON

12 years agojson_path -> path
Dobrica Pavlinusic [Tue, 19 Jul 2011 17:02:56 +0000 (17:02 +0000)]
json_path -> path

12 years agofirst semi-functional file browser
Dobrica Pavlinusic [Tue, 19 Jul 2011 15:45:17 +0000 (15:45 +0000)]
first semi-functional file browser

12 years agogenerate config for all rsync modules available on disk
Dobrica Pavlinusic [Mon, 18 Jul 2011 19:01:07 +0000 (19:01 +0000)]
generate config for all rsync modules available on disk

12 years agouse new test user
Dobrica Pavlinusic [Mon, 18 Jul 2011 18:59:14 +0000 (18:59 +0000)]
use new test user

12 years agorsync reads just file entry in secrets
Dobrica Pavlinusic [Mon, 18 Jul 2011 18:58:40 +0000 (18:58 +0000)]
rsync reads just file entry in secrets

12 years agoscripts to create and remove users
Dobrica Pavlinusic [Mon, 18 Jul 2011 18:27:21 +0000 (18:27 +0000)]
scripts to create and remove users

12 years agotest more variants of file modification
Dobrica Pavlinusic [Mon, 18 Jul 2011 12:28:41 +0000 (12:28 +0000)]
test more variants of file modification

12 years agodump less output without DEBUG=1
Dobrica Pavlinusic [Sun, 17 Jul 2011 21:31:48 +0000 (21:31 +0000)]
dump less output without DEBUG=1

12 years agoadded semi-vfs API to log more output
Dobrica Pavlinusic [Sun, 17 Jul 2011 19:42:27 +0000 (19:42 +0000)]
added semi-vfs API to log more output

12 years agoadded experimental JSON store for file meta-data
Dobrica Pavlinusic [Sun, 17 Jul 2011 19:15:24 +0000 (19:15 +0000)]
added experimental JSON store for file meta-data

12 years agoforce log remove so we don't fail
Dobrica Pavlinusic [Sun, 17 Jul 2011 17:39:39 +0000 (17:39 +0000)]
force log remove so we don't fail

12 years agopush same file again
Dobrica Pavlinusic [Sun, 17 Jul 2011 16:21:45 +0000 (16:21 +0000)]
push same file again

12 years agoinclude md5 sum using %C introduced in rsync 3.1
Dobrica Pavlinusic [Sun, 17 Jul 2011 15:45:21 +0000 (15:45 +0000)]
include md5 sum using %C introduced in rsync 3.1

12 years agore-create db and run test
Dobrica Pavlinusic [Sun, 17 Jul 2011 13:12:36 +0000 (13:12 +0000)]
re-create db and run test

12 years agopipe delimit | fields in log to better support *deleting itemize which have spaces...
Dobrica Pavlinusic [Sun, 17 Jul 2011 13:12:12 +0000 (13:12 +0000)]
pipe delimit | fields in log to better support *deleting itemize which have spaces at end

12 years agoremove schema, now generated with SQL=1 rsync-piper.pl
Dobrica Pavlinusic [Sun, 17 Jul 2011 13:08:51 +0000 (13:08 +0000)]
remove schema, now generated with SQL=1 rsync-piper.pl

12 years agocleanup log before test runs
Dobrica Pavlinusic [Sun, 17 Jul 2011 12:56:08 +0000 (12:56 +0000)]
cleanup log before test runs

12 years agoinclude configurable RSYNC_PORT in log
Dobrica Pavlinusic [Sun, 17 Jul 2011 12:56:04 +0000 (12:56 +0000)]
include configurable RSYNC_PORT in log

12 years agodump SQL schema for rsync_transfer
Dobrica Pavlinusic [Sun, 17 Jul 2011 12:47:46 +0000 (12:47 +0000)]
dump SQL schema for rsync_transfer

12 years agorsync_transfer worker which inserts into PostgreSQL
Dobrica Pavlinusic [Sun, 17 Jul 2011 12:47:28 +0000 (12:47 +0000)]
rsync_transfer worker which inserts into PostgreSQL

12 years agotail last transfer log
Dobrica Pavlinusic [Sun, 17 Jul 2011 12:31:00 +0000 (12:31 +0000)]
tail last transfer log

12 years agocreate user/log/yyyy-mm-dd transfer logs
Dobrica Pavlinusic [Sun, 17 Jul 2011 12:29:22 +0000 (12:29 +0000)]
create user/log/yyyy-mm-dd transfer logs

12 years agotest file with spaces
Dobrica Pavlinusic [Sun, 17 Jul 2011 12:04:04 +0000 (12:04 +0000)]
test file with spaces

12 years agodispatch log entries into data gearman worker
Dobrica Pavlinusic [Sat, 16 Jul 2011 18:33:15 +0000 (18:33 +0000)]
dispatch log entries into data gearman worker

12 years agofix mtime iso
Dobrica Pavlinusic [Sat, 16 Jul 2011 17:58:13 +0000 (17:58 +0000)]
fix mtime iso

12 years agostore audit log in PostgreSQL
Dobrica Pavlinusic [Sat, 16 Jul 2011 10:45:48 +0000 (10:45 +0000)]
store audit log in PostgreSQL

12 years agostore data in json timestamped files
Dobrica Pavlinusic [Sat, 16 Jul 2011 10:00:53 +0000 (10:00 +0000)]
store data in json timestamped files

12 years agoadded pull tests
Dobrica Pavlinusic [Fri, 15 Jul 2011 20:32:55 +0000 (20:32 +0000)]
added pull tests

12 years agore-use existing rsync on restart
Dobrica Pavlinusic [Fri, 15 Jul 2011 19:59:43 +0000 (19:59 +0000)]
re-use existing rsync on restart