TIBCO LogLogic LMI backup fails due to vanished files

TIBCO LogLogic LMI backup fails due to vanished files

book

Article ID: KB0077279

calendar_today

Updated On:

Products Versions
TIBCO LogLogic Log Management Intelligence all versions

Description

LogLogic LMI backups can fail if during the backup process files vanish before they can be backed up. The logs below provide an example of this behavior:
Tue Oct 13 09:17:55 2009: INFO: ###################################
Tue Oct 13 09:17:55 2009: INFO: # Copying the BFQ directories
Tue Oct 13 09:17:55 2009: INFO: ###################################
Tue Oct 13 09:17:55 2009: INFO: Executing command "/usr/bin/rsync -rltv --delete-during --whole-file /loglogic/data/vol1 /loglogic/backup_prep/nfs_mount/ll_bkup_172.21.145.72/ll_bkup_session_1255450502_0 2>&1"
Wed Oct 14 02:33:48 2009: ERROR: Rsync: file has vanished: "/loglogic/data/vol1/2009/10/08/0800index/0"
Wed Oct 14 02:33:48 2009: ERROR: Rsync: file has vanished: "/loglogic/data/vol1/2009/10/08/0800index/1"
Wed Oct 14 02:33:48 2009: ERROR: Rsync: file has vanished: "/loglogic/data/vol1/2009/10/08/0800index/2"

There are now-missing files that existed when rsync built the list of files to copy, but by the time rsync got to the files they were in fact missing. This is normal behavior as explained in the following paragraph. 

The vanished files are due to a couple of factors:
1. The appliance may have a large amount of data to back up and may take one or more days to copy the entire data set
2. The other factor is the index directories are dynamic and are frequently updating or changing. This is more likely to occur on appliances collecting file-based data.. 

When rsync starts the copy process it builds a list of files to process. Then when rsync actually copies the files the engine_archive process may purge them before they can be copied or the temporary index files may already be processed or changed and therefore rsync thinks they are missing. Both of these conditions are normal behavior. The former situation is more likely to happen when there are many terabytes of data to backup over a slow connection because that scenario will increase the chances the backup will take sufficiently long time to complete that engine_archive may purge some of the data that rsync plans to back up.

Unfortunately the missing files cause LogLogic LMI to state that the backup failed when it did not. This event has been reclassified as an INFO level log in a future LMI version.

Issue/Introduction

This article explains what can cause files to disappear and cause an LMI backup to fail.