Updated by MG July 15, 2004
|
Integrated Library Technology Services Web, Workstation & Digital Consulting Services Database Loads Schedule |
LC Resource Loads LC Resource Configuration File | LC Resource Duplicate Detection Profile | LC Resource Bulk Import Rules
Each week (usually on Monday) Peter Ward sends us an e-mail notification when files are loaded on his server and ready for us to retrieve. We receive two notifications, one for books, names, subjects, and serials and one for computer, map, music and visual formats. Once these files have been retrieved and recorded in the ISP logbook, some preprocessing is necessary before we can load them into production lcdb. File Processing 1) The name and subject files are copied and concatenated from deleon:/m1/bulk/LCRESOURCE to another directory in lcdb: deleon:/m1/voyager/lcdb/local/CONCAT. The two files are concatenated into one file named lcauth02.27 following the naming convention of P. Ward where 02 represents the year and .27 the twenty-seventh week. Similarly, we copy and concatenate the computer, map, music and visual format files into one file named nonbook02.27. 2) In some weeks the regular subjects file contains juvenile subject headings which we don't want. Peter Ward prepares a replacement subjects file for us that no longer contains the juvenile subject headings and mounts it on his server. He notifies us when this has happened and we must retrieve this file and substitute it for the regular file. 3) Once the above files have been concatenated, we run each of the remaining four files through Prebulk to strip any 850 tags contained in the records and to verify the record count of each file. The Prebulk script is run from deleon:/m1/voyager/lcdb/sbin: $ Pprebulk -i ../local/CONCAT/nonbook02.27 -o ../local/LCPRE/nonbook02.27 -c ../local/SCRIPTS/lcresource.cfg $ Pprebulk -i ../local/CONCAT/lcauth02.27 -o ../local/LCPRE/lcauth02.27 -c ../local/SCRIPTS/lcresource.cfg $ Pprebulk -i /m1/bulk/LCRESOURCE/unbook02.27 -o ../local/LCPRE/unbook02.27 -c ../local/SCRIPTS/lcresource.cfg $ Pprebulk -i /m1/bulk/LCRESOURCE/unser02.27 -o ../local/LCPRE/unser02.27 -c ../local/SCRIPTS/lcresource.cfg Once the preprocessing is done, the files are ready to be loaded to production lcdb via Endeavor's Bulk Import program. ISP sends an e-mail to ITS letting them know that the files have been preprocessed and are ready to be loaded to production lcdb via Bulk Import. ITS loads the LC Resource records using the following Bulk Import scripts: $
Pbulkimport -f ../local/LCPRE/nonbook02.27 -i LCIMPORT -o LCNONBOOK Once these files have been loaded, ITS will notify ISP that the jobs have run and will include the names of the log files that contain the job output stats. ISP then checks the output stats to see that the files have loaded as expected and checks some records through the production lcdb cataloging module* to confirm that the records have loaded correctly. *To view records in the production lcdb cataloging module, change the port for [Cataloging] in the voyager.ini file to 7110. |