I dont know if this is a good tip but..think about this. This only works if you have broken steel. Dont collect any bobble heads that affect your special. Wait till you get the almost perfect perk then collect them and you have 10 for every special  : ) hope it helps.