Every once in a while, I do something which makes me realize how staggeringly large this project is. I’m running 2 programs right now… one will take about 45 hours, 22 minutes… the other has been running for a while and will take another 17 hours, 18 minutes… this is what happens when you crunch large amounts of data. How much data are we talking? The first program is running about 1 record/second… the second is running 8 records/second. And the sad thing is, this isn’t even the MAIN data. This is all stuff I am doing that supports the main data… but… with a project this large, you need to take steps to make sure that your foundation is solid. When results start coming, they won’t come in drips, it will come in waves!