When you say higher, do you mean higher as in setting the gain to 6v? If that is the case, then the amp will be expecting 6v to reach it's maximum output. Not as damaging as setting the gain lower than HU's output voltage. That will burn out your amp slowly.