Internal re-write of the software to address problems with database that stores metadata.
Added a configuration option that allows the thread that deletes files from the cache to be switched off - this is the default option. This is to remove the problems associated with the deletion thread while the database issues (slow response) are investigated.
Changes made to the internal cache file structure. Files are now stored in batches of 1000 in subdirectories of the main cache directory. The subdirectory name is the file's ID number divided by 1000. Subdirectories are automatically created and destroyed. This was implemented to try to help with problems associated with having tens of thousands of files in a single directory.
Fixed bugs to do with trimming the cache to the configured maximum size. Added an option to allow trimming the cache to be run manually (it also runs automatically once an hour). Changed the default cache size from 20Gb to 5Gb.
Support for quasi-definitive data added.
Check for type of incoming files removed, because IMF and IAGA files put the observatory name as the file type, which some browsers then convert to an application type (e.g. .mpt ==> applcation/vnd.ms-project).
Metadata moved to a JDBC compliant database - previously held as an in-memory array, but the size grew too large. System tested using an embedded Derby database. See InstallConfigInstructions.txt for more details.
Option added to allow deletion of data. This is achieved by passing a command through to the GIN software that runs the GIN's deletion programme. This option can only be used by an administrative user.
The process of deleting cache files had been moved to a background thread. The cache size is checked once an hour and the oldest files deleted until the cache size is within the user specified limits. A second background thread allows cache metadata to be reloaded from the cache. The reload process is started by an 'admin' user from the Administration page. The Administration page shows details of the last deletion process as well as progress of the metadata reload.
Rules preventing data being uploaded have been relaxed. Specifically you may now upload IAGA-2002 variation data and duplicate data files.
Initial release