* Hint - use the SWDI web services to examine the inventory log which shows the presence of data by day as well as the last date processed for each day. Example: http://www.ncdc.noaa.gov/swdiws/csv/nx3hail:inv/20140107:20300101 The current data sources in SWDI are archived as daily files (sometimes bundles of smaller time units) 2016/03/15 ---- reloaded SWDI data for 03/24/2006, 04/02/2006, 12/12/2008, 07/30/2015, 09/14/2015, 09/15/2015, 10/22/2015, 10/23/2015, and regenerated yearly CSV file. (sansari) Old File Sizes and Last-Modified Dates: -rw-r--r-- 1 ftp aftp 180566358 Oct 7 2014 hail-2006.csv.gz -rw-r--r-- 1 ftp aftp 130700 Oct 7 2014 mda-2006.csv.gz -rw-r--r-- 1 ftp aftp 63216146 Oct 7 2014 meso-2006.csv.gz -rw-r--r-- 1 ftp aftp 858956031 Oct 7 2014 structure-2006.csv.gz -rw-r--r-- 1 ftp aftp 1410426 Oct 7 2014 tvs-2006.csv.gz -rw-r--r-- 1 ftp aftp 174817470 Oct 8 2014 hail-2008.csv.gz -rw-r--r-- 1 ftp aftp 25375442 Oct 8 2014 mda-2008.csv.gz -rw-r--r-- 1 ftp aftp 88116242 Oct 8 2014 meso-2008.csv.gz -rw-r--r-- 1 ftp aftp 751856021 Oct 8 2014 structure-2008.csv.gz -rw-r--r-- 1 ftp aftp 1775208 Oct 8 2014 tvs-2008.csv.gz -rw-r--r-- 1 ftp aftp 173709311 Jan 15 02:49 hail-2015.csv.gz -rw-r--r-- 1 ftp aftp 18610198 Jan 15 02:52 mda-2015.csv.gz -rw-r--r-- 1 ftp aftp 175 Jan 15 02:50 meso-2015.csv.gz -rw-r--r-- 1 ftp aftp 820182373 Jan 15 05:34 structure-2015.csv.gz -rw-r--r-- 1 ftp aftp 1397937 Jan 15 02:49 tvs-2015.csv.gz 2015/08/05 ---- regenerated CSV files for months of 02/03/04/05 of 2015 for the Radar-based layers to fill in data gaps caused by delays in processing. (sansari) Old File Sizes and Last-Modified Dates: -rw-r--r-- 1 ftp aftp 300913 Mar 5 02:07 hail-201502.csv.gz -rw-r--r-- 1 ftp aftp 2042066 Apr 5 02:07 hail-201503.csv.gz -rw-r--r-- 1 ftp aftp 16085313 May 13 17:55 hail-201504.csv.gz -rw-r--r-- 1 ftp aftp 12998627 Jun 5 02:10 hail-201505.csv.gz New: -rw-r--r-- 1 ftp aftp 391491 Aug 5 00:14 hail-201502.csv.gz -rw-r--r-- 1 ftp aftp 2108363 Aug 5 00:10 hail-201503.csv.gz -rw-r--r-- 1 ftp aftp 16085314 Aug 4 23:56 hail-201504.csv.gz -rw-r--r-- 1 ftp aftp 28348580 Aug 4 23:30 hail-201505.csv.gz Old: -rw-r--r-- 1 ftp aftp 7416499 Mar 5 02:08 structure-201502.csv.gz -rw-r--r-- 1 ftp aftp 20761554 Apr 5 02:12 structure-201503.csv.gz -rw-r--r-- 1 ftp aftp 68484078 May 13 18:24 structure-201504.csv.gz -rw-r--r-- 1 ftp aftp 53061175 Jun 5 02:20 structure-201505.csv.gz New: -rw-r--r-- 1 ftp aftp 10382641 Aug 5 04:16 structure-201502.csv.gz -rw-r--r-- 1 ftp aftp 23557163 Aug 5 04:14 structure-201503.csv.gz -rw-r--r-- 1 ftp aftp 68484080 Aug 5 04:10 structure-201504.csv.gz -rw-r--r-- 1 ftp aftp 113637832 Aug 5 03:51 structure-201505.csv.gz Old: -rw-r--r-- 1 ftp aftp 62744 Mar 5 07:07 tvs-201502.csv.gz -rw-r--r-- 1 ftp aftp 80176 Apr 5 06:07 tvs-201503.csv.gz -rw-r--r-- 1 ftp aftp 193466 May 13 21:55 tvs-201504.csv.gz -rw-r--r-- 1 ftp aftp 124740 Jun 5 06:10 tvs-201505.csv.gz New: -rw-r--r-- 1 ftp aftp 70519 Aug 5 04:16 tvs-201502.csv.gz -rw-r--r-- 1 ftp aftp 81922 Aug 5 04:14 tvs-201503.csv.gz -rw-r--r-- 1 ftp aftp 193529 Aug 5 04:10 tvs-201504.csv.gz -rw-r--r-- 1 ftp aftp 250262 Aug 5 03:51 tvs-201505.csv.gz Old: -rw-r--r-- 1 ftp aftp 505785 Mar 5 07:07 mda-201502.csv.gz -rw-r--r-- 1 ftp aftp 872869 Apr 5 06:08 mda-201503.csv.gz -rw-r--r-- 1 ftp aftp 2691072 May 13 21:56 mda-201504.csv.gz -rw-r--r-- 1 ftp aftp 1673773 Jun 5 06:11 mda-201505.csv.gz New: -rw-r--r-- 1 ftp aftp 609692 Aug 5 04:14 mda-201502.csv.gz -rw-r--r-- 1 ftp aftp 897373 Aug 5 04:10 mda-201503.csv.gz -rw-r--r-- 1 ftp aftp 2691073 Aug 5 03:56 mda-201504.csv.gz -rw-r--r-- 1 ftp aftp 3373232 Aug 5 03:30 mda-201505.csv.gz 2015/08/04 ---- reprocessed the month of 2015/06 for the Radar-based layers and replaced the 2015/06 CSV files. (sansari) Old File Sizes and Last-Modified Dates: -rw-r--r-- 1 ftp aftp 17284419 Jun 26 02:15 hail-201506.csv.gz -rw-r--r-- 1 ftp aftp 1118933 Jun 26 02:15 mda-201506.csv.gz -rw-r--r-- 1 ftp aftp 174 Jun 26 02:15 meso-201506.csv.gz -rw-r--r-- 1 ftp aftp 68449970 Jun 26 02:40 structure-201506.csv.gz -rw-r--r-- 1 ftp aftp 69411 Jun 26 02:15 tvs-201506.csv.gz New File Sizes and Last-Modified Dates: -rw-r--r-- 1 ftp aftp 37107153 Aug 4 03:54 hail-201506.csv.gz -rw-r--r-- 1 ftp aftp 2156510 Aug 4 03:54 mda-201506.csv.gz -rw-r--r-- 1 ftp aftp 176 Aug 4 03:54 meso-201506.csv.gz -rw-r--r-- 1 ftp aftp 138648833 Aug 4 04:20 structure-201506.csv.gz -rw-r--r-- 1 ftp aftp 137370 Aug 4 04:20 tvs-201506.csv.gz 2014/05/27 ---- reprocessed 2014/04/21 to 2014/04/27, loaded to SWDI database and reprocessed 201404 monthly CSV files to add missing data. Data was missing due to NCDC downtime. Log info: http://www.ncdc.noaa.gov/swdiws/csv/nx3hail:inv/20140416:20300101 (sansari) 2014/03/25 ---- reprocessed 2014/01/31 to 2014/03/16, loaded to SWDI database and reprocessed 2014 monthly CSV files to add 04/06. (sansari) 2013/07/30 ---- reprocessed 2003/04/06, loaded to SWDI and reprocessed 2003 yearly CSV files to add 04/06. (sansari)