Are you using a 'real' editing package currently? If not, you might want to head that direction. My workflow is based around Final Cut Pro (MacOS) but I believe others should be similar.
Basically, I pull all of my footage into FCP - optionally tagging it based on site/day/etc. Then I can quickly skim/scrub thru each clip, marking an "in" and "out" point and making it as a favorite. Depending on what my goals are (and how much material I"m working with) I make pretty quick decisions - is composition "OK", not too much shake, content might be interesting....
Once I've made the first pass, I can hide all of the non-Favorite clips, and usually just add them all to a new timeline, in whatever order they show up in (usually chronological assuming I have time set correctly)
Then I can actually watch the favorited clips in real-time, and start thinking about what works and what doesn't - things that I just don't like get kicked out of the timeline. For much of the material, this is the first time I've watch it closely, in real-time, which to me saves a lot of the headache of dealing with all of the footage that's now way to easy to accumulate.