Easiest solution. Buff other traits and reduce the attack speed bonus of Swift Slaying from 20% to 10%, but also increase the base attack speed of ALL MELEE WEAPONS by 10%. This would make SS less mandatory and make other traits more viable.
I also made a list of potential new traits that could be added a while back. These would diversify builds even further.