Releases: tedsmith/NSRL-Stripper
NSRL Stripper v1.2 Released
The current (Sept 2021) NSRL RDS hash set seems to include some 0x1A values, which was causing all previous versions of NSRL Stripper to abort parsing because it thought it had reached the end of the file, because 0x1A is the DOS char for End of File.
Using a compiler directive, I have corrected this. I'm not sure the hash sets should contain 0x1A in the filename fields, but who am I to argue. This new version seems to now work fully with RDS v2.74 - September 2021 (https://www.nist.gov/itl/ssd/software-quality-group/national-software-reference-library-nsrl/nsrl-download/current-rds) and it processed the entire set of 192,677,749 records and didn't exceed 5Mb of RAM use throughout. Tidy.
I am told that even in the DOS era, relying on ^Z was pretty unusual. It was a CP/M thing (hence also CCP/M, CDOS, MDOS and so on) since the original CP/M filesystem had a filesize granularity of 128 bytes (i.e. it didn't store an exact length). There are still rare situations where a (text) file can end up being padded with ^Z, e.g. if it's been through an X-Modem transfer. But I don't know what the process used by NIST is. Anyway, let us not continue to worry. This version should solve our issues.
Summary of updates
- Made the correction as described above
- Added the Open Source GNU General Public License statement
- Initialised a few variables that should have been initialised as default values for their type
- Corrected a few typos in the code and re-aligned some stuff as per my OCD.
- Made a few GUI tweaks to help keep user assured of progress etc
(PS Linux users can achieve similar results to what is done with this tool by just using cat with the uniq and cut parametrs, and because its Linux, it works pretty fast too. For example :
cat /media/me/DATA/NSRLFile.txt | cut -d '"' -f 4 | sort | uniq > NSRLFile.sorted
NSRL Stripper v1.1 Released
This new version includes a few minor fixes and a feature to allow the inclusion or exclusion of the header title. This is not a significant benefit for a normal text file, but with enormous hash list files, not having to try and open it to edit the first row is a handy feature. Also some other imprvoements - see changelog.
NSRL Stripper v1.0
This is the first and initial release of NSRL Stripper. If the structure of the NSRL hash set changes, so too will this utility have to do so. As of January 2017, it works fine in my tests for extracting SHA-1 or MD5 or CRC hash values from the NSRL hash set text file.
SHA-1 hash of the exe : 848445D02128C5CB979865F6D596177013EFAB94
SHA-1 hash of the zip : F029BD606740E1CA0D6745C04E907C5FFC4AD55E