If Google discovers any manual manipulation of ranking factors that would likely increase your rankings, and deems that work as innappropriate, you may suffer a decrease in ranking because of it.