There's now a page where you can see who you've unfollowed from your reports.

You can look by year, month and day.

If you've got a super huge account, it might be a little slow, and some of the really old data might be missing (for example, we didn't start recording the reasons for unfollowing until a few months back). Since you're digging through archives, it's a part of the system that's probably not worth optimising the heck out of.

Those caveats aside, it's a reasonably good summary and should make it easier to refollow people, if you so desire.