Problem with H1 Highbeams

Starting last week, the H1 highbeams on my 06 MS6 only lights up on one side. I swapped the bulbs and tested the connectors, the bulbs and connectors on both sides are working. When I plug in both sides and tried to turn on the highbeam, only 1 side will light up, but once I unplug 1 side, the other side lights up.

Is it just loose connections? Should I check the fuse box?
Does direction matter when plugging in the H1 connectors?

I would really appreciate any help/info on this, thanks.

"once I unplug 1 side, the other side lights up."

sounds like a grounding issue. probably going to have to take it to the dealer