heres something for anyone interested in redis/perl. i've found that if your imageboard has a lot of images, the find_md5 function gets slower and slower. i've basically loaded all of the hashes as keys in redis and use it to perform the check, its a lot faster. the key is imageboardname:hash and the values are thread,post,file
this isnt a standard patch, my kareha setup is extremely different from stock (i've split all the posting functions from the main script and run that part in memory) but its only a few changes