BackupPC.git
10 years agoMerge branch 'master' of git.rot13.org:/git/BackupPC
Dobrica Pavlinusic [Wed, 16 Feb 2011 15:12:39 +0000 (16:12 +0100)]
Merge branch 'master' of git.rot13.org:/git/BackupPC

Conflicts:
bin/BackupPC_ASA_PostArchive_Update

10 years agoall backup parts will be attached to first share in backups
Dobrica Pavlinusic [Wed, 16 Feb 2011 15:07:10 +0000 (16:07 +0100)]
all backup parts will be attached to first share in backups

10 years agoimport just increments which have files in them
Dobrica Pavlinusic [Wed, 9 Feb 2011 12:47:16 +0000 (13:47 +0100)]
import just increments which have files in them

10 years agoimport just increments which have files in them
Dobrica Pavlinusic [Wed, 9 Feb 2011 12:47:16 +0000 (13:47 +0100)]
import just increments which have files in them

10 years agofew more manual tests
Dobrica Pavlinusic [Wed, 9 Feb 2011 11:05:05 +0000 (12:05 +0100)]
few more manual tests

10 years agosort backup nums numerically to get correct order
Dobrica Pavlinusic [Wed, 9 Feb 2011 10:47:28 +0000 (10:47 +0000)]
sort backup nums numerically to get correct order

10 years agoLIMIT doesn't work since we don't get correct number of results search-3.2.0
Dobrica Pavlinusic [Mon, 7 Feb 2011 12:39:18 +0000 (12:39 +0000)]
LIMIT  doesn't work since we don't get correct number of results

10 years agoMerge branch 'search-3.2.0' of git.rot13.org:/git/BackupPC into search-3.2.0
Dobrica Pavlinusic [Mon, 7 Feb 2011 10:53:32 +0000 (10:53 +0000)]
Merge branch 'search-3.2.0' of git.rot13.org:/git/BackupPC into search-3.2.0

10 years agocorrectly lc $host all over the place
Dobrica Pavlinusic [Sun, 6 Feb 2011 12:27:07 +0000 (13:27 +0100)]
correctly lc $host all over the place

10 years agouse asa logo
Dobrica Pavlinusic [Sun, 6 Feb 2011 10:32:36 +0000 (11:32 +0100)]
use asa logo

10 years agodisable debug
Dobrica Pavlinusic [Sun, 6 Feb 2011 10:32:02 +0000 (11:32 +0100)]
disable debug

10 years agolowercase (lc) hostname to get increments
Dobrica Pavlinusic [Sun, 6 Feb 2011 10:31:20 +0000 (11:31 +0100)]
lowercase (lc) hostname to get increments

10 years ago_search_archive host config file for /etc/BackupPC/pc
Dobrica Pavlinusic [Fri, 4 Feb 2011 16:58:08 +0000 (16:58 +0000)]
_search_archive host config file for /etc/BackupPC/pc

10 years agoremove debug output to STDERR
Dobrica Pavlinusic [Tue, 1 Feb 2011 12:12:02 +0000 (13:12 +0100)]
remove debug output to STDERR

10 years agovisit minimum number of backups for only_increment
Dobrica Pavlinusic [Mon, 31 Jan 2011 15:04:06 +0000 (16:04 +0100)]
visit minimum number of backups for only_increment

we need two increment and full or two full backups to correctly detect changes

without this change every full backup was dumped with all content instead of increment

10 years agore-implement only_increment by comparing inodes
Dobrica Pavlinusic [Mon, 31 Jan 2011 13:14:33 +0000 (14:14 +0100)]
re-implement only_increment by comparing inodes

BackupPC history does that, and this also allows us to hide directories
which are same on previous increments.

10 years agoexpand and fix backups_burned view
Dobrica Pavlinusic [Sun, 30 Jan 2011 19:20:52 +0000 (20:20 +0100)]
expand and fix backups_burned view

10 years agotranfer xferOK to detect errors and run cleanup
Dobrica Pavlinusic [Sun, 30 Jan 2011 17:17:50 +0000 (18:17 +0100)]
tranfer xferOK to detect errors and run cleanup

this can be killall par2 or similar command or par dying on us

10 years agomake check_archive transactionally safe
Dobrica Pavlinusic [Sun, 30 Jan 2011 16:47:25 +0000 (17:47 +0100)]
make check_archive transactionally safe

10 years agofix sql filter for burned/pending
Dobrica Pavlinusic [Sun, 30 Jan 2011 16:01:23 +0000 (17:01 +0100)]
fix sql filter for burned/pending

10 years agouse DateTime::Duration to correctly convert partial dates in to fields
Dobrica Pavlinusic [Sun, 30 Jan 2011 13:38:44 +0000 (14:38 +0100)]
use DateTime::Duration to correctly convert partial dates in to fields

10 years agoarchive_backup renamed to archive_backup_parts
Dobrica Pavlinusic [Sun, 30 Jan 2011 13:07:10 +0000 (14:07 +0100)]
archive_backup renamed to archive_backup_parts

10 years agogit mv BackupPC_removeBurnedArchives BackupPC_ASA_removeBurnedArchives
Dobrica Pavlinusic [Sun, 30 Jan 2011 13:04:48 +0000 (14:04 +0100)]
git mv BackupPC_removeBurnedArchives BackupPC_ASA_removeBurnedArchives

10 years agoadded par2cmdline 0.4 with Intel Threading Building Blocks 2.2
Dobrica Pavlinusic [Sat, 29 Jan 2011 15:12:24 +0000 (16:12 +0100)]
added par2cmdline 0.4 with Intel Threading Building Blocks 2.2

10 years agomake md5sums read-only
Dobrica Pavlinusic [Sat, 29 Jan 2011 14:54:49 +0000 (15:54 +0100)]
make md5sums read-only

10 years agodocument ASA operation
Dobrica Pavlinusic [Sat, 29 Jan 2011 14:37:56 +0000 (15:37 +0100)]
document ASA operation

10 years agocorrectly support all command-line handling
Dobrica Pavlinusic [Sat, 29 Jan 2011 14:19:27 +0000 (15:19 +0100)]
correctly support all command-line handling

10 years agomake test target for archive testing
Dobrica Pavlinusic [Sat, 29 Jan 2011 13:50:07 +0000 (14:50 +0100)]
make test target for archive testing

10 years agoread protect tar dumps after md5sum calculation
Dobrica Pavlinusic [Sat, 29 Jan 2011 13:46:45 +0000 (14:46 +0100)]
read protect tar dumps after md5sum calculation

This allows operator errors in re-running dumps which have
archives allready created, and it seems that pigz produce
some amount of fuzzing in archive creation, so md5sums
of re-created archives don't match any more (which is bad
since we stored them in database for export to CD/DVD image)

10 years agodocument required global /etc/BackupPC/config.pl options
Dobrica Pavlinusic [Sat, 29 Jan 2011 13:07:02 +0000 (14:07 +0100)]
document required global /etc/BackupPC/config.pl options

10 years agouse same logic as CGI/Archive.pm
Dobrica Pavlinusic [Sat, 29 Jan 2011 13:02:51 +0000 (14:02 +0100)]
use same logic as CGI/Archive.pm

This will select increments which are not yet indexed, because archive will update
database and full-text search for them.

10 years agodon't start initial archive on make reset
Dobrica Pavlinusic [Sat, 29 Jan 2011 12:38:35 +0000 (13:38 +0100)]
don't start initial archive on make reset

10 years agofix example _search_archive.pl configuration
Dobrica Pavlinusic [Fri, 28 Jan 2011 23:02:42 +0000 (00:02 +0100)]
fix example _search_archive.pl configuration

10 years agoremove unused ArchiveChunkSize
Dobrica Pavlinusic [Fri, 28 Jan 2011 22:41:46 +0000 (23:41 +0100)]
remove unused ArchiveChunkSize

10 years agofix backup selection
Dobrica Pavlinusic [Fri, 28 Jan 2011 22:41:20 +0000 (23:41 +0100)]
fix backup selection

10 years agouse ArchiveSplit in Mb everywhere
Dobrica Pavlinusic [Fri, 28 Jan 2011 22:41:00 +0000 (23:41 +0100)]
use ArchiveSplit in Mb everywhere

10 years agoskip hosts without backups checked
Dobrica Pavlinusic [Fri, 28 Jan 2011 22:05:50 +0000 (23:05 +0100)]
skip hosts without backups checked

10 years agodisplay all backups which we don't know state of in web interface
Dobrica Pavlinusic [Fri, 28 Jan 2011 21:40:17 +0000 (22:40 +0100)]
display all backups which we don't know state of in web interface

10 years agoshow all increments without archived copy
Dobrica Pavlinusic [Fri, 28 Jan 2011 20:50:54 +0000 (21:50 +0100)]
show all increments without archived copy

This is mid-size change but it brings web interface in-sync with
default operation of BackupPC_ASA_ArchiveStart

10 years agohush debug output
Dobrica Pavlinusic [Fri, 28 Jan 2011 20:41:58 +0000 (21:41 +0100)]
hush debug output

10 years agofix order and burning is working again
Dobrica Pavlinusic [Fri, 28 Jan 2011 19:48:22 +0000 (20:48 +0100)]
fix order and burning is working again

10 years agoadded dvd_nr to archive_backup_parts
Dobrica Pavlinusic [Fri, 28 Jan 2011 19:05:52 +0000 (20:05 +0100)]
added dvd_nr to archive_backup_parts

10 years agoorder by backup_part_id
Dobrica Pavlinusic [Fri, 28 Jan 2011 19:00:54 +0000 (20:00 +0100)]
order by backup_part_id

10 years agoshow parts archived using view
Dobrica Pavlinusic [Fri, 28 Jan 2011 18:55:43 +0000 (19:55 +0100)]
show parts archived using view

10 years agocreate archive_backup_parts view and use it
Dobrica Pavlinusic [Fri, 28 Jan 2011 18:33:45 +0000 (19:33 +0100)]
create archive_backup_parts view and use it

10 years agomove sql schema in __DATA__
Dobrica Pavlinusic [Fri, 28 Jan 2011 17:58:36 +0000 (18:58 +0100)]
move sql schema in __DATA__

10 years agorun archive test on update
Dobrica Pavlinusic [Fri, 28 Jan 2011 17:58:29 +0000 (18:58 +0100)]
run archive test on update

10 years agotest BackupPC_ASA_ArchiveStart
Dobrica Pavlinusic [Fri, 28 Jan 2011 17:56:21 +0000 (18:56 +0100)]
test BackupPC_ASA_ArchiveStart

10 years agoremove broken tar increment implementation
Dobrica Pavlinusic [Fri, 28 Jan 2011 17:46:32 +0000 (18:46 +0100)]
remove broken tar increment implementation

this is left-over from port of previous version

10 years agoupdate SQL for new schema, cleanup
Dobrica Pavlinusic [Fri, 28 Jan 2011 17:45:28 +0000 (18:45 +0100)]
update SQL for new schema, cleanup

10 years agogit mv BackupPC_burnArchiveCLI BackupPC_ASA_BurnArchiveMedia
Dobrica Pavlinusic [Fri, 28 Jan 2011 16:57:30 +0000 (17:57 +0100)]
git mv BackupPC_burnArchiveCLI BackupPC_ASA_BurnArchiveMedia

10 years agoShow scheduled parts button
Dobrica Pavlinusic [Fri, 28 Jan 2011 16:55:40 +0000 (17:55 +0100)]
Show scheduled parts button

10 years agohide scheduled without option
Dobrica Pavlinusic [Fri, 28 Jan 2011 16:48:15 +0000 (17:48 +0100)]
hide scheduled without option

10 years agomove html and javascipt in __DATA__
Dobrica Pavlinusic [Fri, 28 Jan 2011 16:41:54 +0000 (17:41 +0100)]
move html and javascipt in __DATA__

10 years agoshow scheduled and burned columns
Dobrica Pavlinusic [Fri, 28 Jan 2011 16:29:42 +0000 (17:29 +0100)]
show scheduled and burned columns

10 years agosave selected backup_parts for burning
Dobrica Pavlinusic [Fri, 28 Jan 2011 15:55:37 +0000 (16:55 +0100)]
save selected backup_parts for burning

10 years agobegin rewrite to select backup_parts
Dobrica Pavlinusic [Fri, 28 Jan 2011 15:32:24 +0000 (16:32 +0100)]
begin rewrite to select backup_parts

10 years agostore filename in backup_parts
Dobrica Pavlinusic [Fri, 28 Jan 2011 14:24:38 +0000 (15:24 +0100)]
store filename in backup_parts

10 years agofix inc_size
Dobrica Pavlinusic [Fri, 28 Jan 2011 14:19:16 +0000 (15:19 +0100)]
fix inc_size

10 years agodocument new archive host ASA extension
Dobrica Pavlinusic [Fri, 28 Jan 2011 13:59:45 +0000 (14:59 +0100)]
document new archive host ASA extension

10 years agouse unit all over
Dobrica Pavlinusic [Fri, 28 Jan 2011 13:57:11 +0000 (14:57 +0100)]
use unit all over

10 years agoadded humanly readable unit (b k M G)
Dobrica Pavlinusic [Fri, 28 Jan 2011 13:48:14 +0000 (14:48 +0100)]
added humanly readable unit (b k M G)

10 years agoArchiveMediaSize and ArchiveChunkSize from _search_archive config
Dobrica Pavlinusic [Fri, 28 Jan 2011 13:18:51 +0000 (14:18 +0100)]
ArchiveMediaSize and ArchiveChunkSize from _search_archive config

10 years agorename MaxArchiveFileSize to ArchiveChunkSize
Dobrica Pavlinusic [Fri, 28 Jan 2011 12:50:33 +0000 (13:50 +0100)]
rename MaxArchiveFileSize to ArchiveChunkSize

grep -rl MaxArchiveFileSize . | xargs -i sh -cv "perl -p -i -n -e 's/MaxArchiveFileSize/ArchiveChunkSize/' {}"

10 years agorename MaxArchiveSize to ArchiveMediaSize
Dobrica Pavlinusic [Fri, 28 Jan 2011 12:49:18 +0000 (13:49 +0100)]
rename MaxArchiveSize to ArchiveMediaSize

grep -rl MaxArchiveSize . | xargs -i sh -cv "perl -p -i -n -e 's/MaxArchiveSize/ArchiveMediaSize/' {}"

10 years agoenable backup_parts triggers
Dobrica Pavlinusic [Fri, 28 Jan 2011 12:43:13 +0000 (13:43 +0100)]
enable backup_parts triggers

10 years agorespect ArchiveSplit when creating dumps
Dobrica Pavlinusic [Fri, 28 Jan 2011 12:42:56 +0000 (13:42 +0100)]
respect ArchiveSplit when creating dumps

10 years agodon't eval full-text update, it breaks our re-try logic
Dobrica Pavlinusic [Thu, 27 Jan 2011 23:58:40 +0000 (00:58 +0100)]
don't eval full-text update, it breaks our re-try logic

10 years agouse Getopt::Long::Descriptive
Dobrica Pavlinusic [Thu, 27 Jan 2011 23:36:52 +0000 (00:36 +0100)]
use Getopt::Long::Descriptive

10 years agofix
Dobrica Pavlinusic [Thu, 27 Jan 2011 23:14:06 +0000 (00:14 +0100)]
fix

10 years agofix warning about rollback
Dobrica Pavlinusic [Thu, 27 Jan 2011 23:13:49 +0000 (00:13 +0100)]
fix warning about rollback

10 years agopush host to archive so import and index update will be triggerd
Dobrica Pavlinusic [Thu, 27 Jan 2011 22:40:28 +0000 (23:40 +0100)]
push host to archive so import and index update will be triggerd

10 years agorenamed to only_increment
Dobrica Pavlinusic [Thu, 27 Jan 2011 22:34:29 +0000 (23:34 +0100)]
renamed to only_increment

This better describes functionality and is self-documenting
you can also add it to view ULRs on the web

10 years agofix only_first implementation to return only increment
Dobrica Pavlinusic [Thu, 27 Jan 2011 22:32:27 +0000 (23:32 +0100)]
fix only_first implementation to return only increment

10 years agoadded TarCreateIncremental config variable forced in archive host
Dobrica Pavlinusic [Thu, 27 Jan 2011 21:48:21 +0000 (22:48 +0100)]
added TarCreateIncremental config variable forced in archive host

10 years agostart indexing of dellboy after reset
Dobrica Pavlinusic [Thu, 27 Jan 2011 21:30:02 +0000 (22:30 +0100)]
start indexing of dellboy after reset

10 years agoshow status in ps output by modifing $0
Dobrica Pavlinusic [Thu, 27 Jan 2011 21:29:43 +0000 (22:29 +0100)]
show status in ps output by modifing $0

10 years agofix parsing of gzip -l output
Dobrica Pavlinusic [Thu, 27 Jan 2011 20:32:21 +0000 (21:32 +0100)]
fix parsing of gzip -l output

10 years agoif I can't find gzip size return original one
Dobrica Pavlinusic [Thu, 27 Jan 2011 20:07:05 +0000 (21:07 +0100)]
if I can't find gzip size return original one

10 years agorestart backuppc
Dobrica Pavlinusic [Thu, 27 Jan 2011 19:42:29 +0000 (20:42 +0100)]
restart backuppc

10 years agowithout params archive all hosts
Dobrica Pavlinusic [Thu, 27 Jan 2011 18:31:53 +0000 (18:31 +0000)]
without params archive all hosts

10 years agoremove archive history
Dobrica Pavlinusic [Thu, 27 Jan 2011 18:10:46 +0000 (18:10 +0000)]
remove archive history

10 years agoadded custom DumpPostFinishCmd command
Dobrica Pavlinusic [Thu, 27 Jan 2011 18:10:05 +0000 (18:10 +0000)]
added custom DumpPostFinishCmd command

we really need finished dump to start indexing it! so all other DumpPost
commands happen too early

10 years agouse Getopt::Long::Descriptive
Dobrica Pavlinusic [Thu, 27 Jan 2011 16:56:52 +0000 (16:56 +0000)]
use Getopt::Long::Descriptive

10 years agocreate all archives which are missing for given host
Dobrica Pavlinusic [Thu, 27 Jan 2011 15:55:52 +0000 (15:55 +0000)]
create all archives which are missing for given host

10 years agocleanup
Dobrica Pavlinusic [Thu, 27 Jan 2011 11:58:56 +0000 (11:58 +0000)]
cleanup

10 years agostore inc_size in backups rounded to 2k cluster
Dobrica Pavlinusic [Thu, 27 Jan 2011 11:28:26 +0000 (11:28 +0000)]
store inc_size in backups rounded to 2k cluster

10 years agofirst version which stores backup parts
Dobrica Pavlinusic [Thu, 27 Jan 2011 01:21:58 +0000 (01:21 +0000)]
first version which stores backup parts

but doesn't work with consistency triggers enabled

10 years agosupport hostList in quotes as -h option
Dobrica Pavlinusic [Thu, 27 Jan 2011 00:26:31 +0000 (00:26 +0000)]
support hostList in quotes as -h option

this speeds up pre-archive hook

10 years agofirst steps in importing archive data to RDBMS
Dobrica Pavlinusic [Thu, 27 Jan 2011 00:10:33 +0000 (00:10 +0000)]
first steps in importing archive data to RDBMS

10 years agorename to BackupPC_ASA_SearchUpdate
Dobrica Pavlinusic [Thu, 27 Jan 2011 00:10:20 +0000 (00:10 +0000)]
rename to BackupPC_ASA_SearchUpdate

10 years agogit mv BackupPC_ASA_PostDump_SearchUpdate BackupPC_ASA_SearchUpdate
Dobrica Pavlinusic [Wed, 26 Jan 2011 22:36:49 +0000 (22:36 +0000)]
git mv BackupPC_ASA_PostDump_SearchUpdate BackupPC_ASA_SearchUpdate

10 years agoarg parsing is only functional thing right now
Dobrica Pavlinusic [Wed, 26 Jan 2011 22:32:09 +0000 (22:32 +0000)]
arg parsing is only functional thing right now

10 years agosupport no dumps with -m 0
Dobrica Pavlinusic [Wed, 26 Jan 2011 22:25:36 +0000 (22:25 +0000)]
support no dumps with -m 0

10 years agoreally clean eveything on make reset
Dobrica Pavlinusic [Wed, 26 Jan 2011 22:24:45 +0000 (22:24 +0000)]
really clean eveything on make reset

10 years agofixed pid file
Dobrica Pavlinusic [Wed, 26 Jan 2011 21:45:30 +0000 (21:45 +0000)]
fixed pid file

10 years agoless output
Dobrica Pavlinusic [Wed, 26 Jan 2011 20:41:11 +0000 (20:41 +0000)]
less output

10 years agofix make reset
Dobrica Pavlinusic [Wed, 26 Jan 2011 20:35:37 +0000 (20:35 +0000)]
fix make reset

10 years agomove this to post-archive action
Dobrica Pavlinusic [Wed, 26 Jan 2011 16:57:20 +0000 (16:57 +0000)]
move this to post-archive action

10 years agoselect backup number for each host
Dobrica Pavlinusic [Wed, 26 Jan 2011 16:56:48 +0000 (16:56 +0000)]
select backup number for each host