With a cleanup task, you can limit the data amount of any directory, by deleting the oldest files. The cleanup task operates independently of the cleanup strategies used by the individual file-generating tasks (Extract, Copy/Move/Delete, Report, Update).
As any file-type can be deleted, as long as it can be identified clearly by a file-extension, the cleanup task is suitable for cleaning up any files. For example, you can automatically remove temporary files that are created during script tasks on a regular basis to free up storage space.
Like other tasks, the cleanup task can always be executed depending on a preceding task or a condition within the course of jobs. The cleanup task is particularly suitable for scheduled jobs, e.g., to clean up directories on a weekly basis.
To configure a cleanup task, you must specify a cleanup directory that will be monitored. To access a network drive, you can also enter the login data of a write-authorized user, if required.
Note |
|
|---|---|
 |
To avoid overlaps in cleanup actions, disable task-specific cleanup strategies if you want to use global cleanup, see Settings – Global cleanup. |
Tip |
|
|---|---|
 |
If you use cleanup strategies, look at all cleanup strategies that refer to the storage medium. The cleanup strategy that has been configured in ibaPDA might be among these strategies. Reduce the risk that a process "falls behind" and cannot store its data. Calculate the required storage capacity for the output files of the different processes and tasks for being able to judge which data sets are especially fast-growing. |
The task-specific settings are explained below. For all other settings, see General task settings.
Clean up
Cleanup directory
To configure a cleanup task, you must specify a directory to be monitored. To access a network drive, you can also enter the login details of a user with write permissions, if necessary.
File extension
By specifying the file extension, you can limit the cleanup task to certain file types. You must enter at least one extension. The default setting is *.dat.
You can replace the entry with another one or add more, e.g. *.dat, *.pdf, *.jpg, etc. If you specify multiple extensions, separate them with a comma.
The criterion for deleting files is solely the date of the file.
Cleanup strategy
Strategy
Select which of the following strategies should be used to monitor and clean up the specified directory:
-
Limit subdirectories
When the number of allowed subdirectories is reached, the oldest subdirectories containing files with one of the specified extensions are deleted. If all files in a directory are deleted, the subdirectory is also deleted. If there are still files with extensions other than those specified in the subdirectory, they will not be deleted and the subdirectory will remain intact.
-
Limit disk space usage
If the total size of all files in the directory exceeds the storage limit set here, the oldest files will be deleted until the limit is no longer exceeded. The date of the files is the only criterion. Only files with the specified extensions are taken into account.
-
Minimal free disk space
If the total (!) free space on the hard drive falls below the set limit, the oldest files will be deleted.
This strategy should be used carefully, as the hard disk can be filled by many processes. However, the cleanup task can only delete files in the specified directory. In extreme cases, even deleting files in the directory cannot prevent the free space from falling below the limit.