The parts manual says 4 of each in total required so yes, two of each per side.
My bike had no rubber parts on the odies at all.
I fitted them as you say but the Odies then won't reach the clip to hold on the panel, I may look at the Odies again and see if they are correct ones, starting to wonder if they are shorter than they should be. Not quite sure where you measure them, may have to order one to compare with what I have.
Just sorting out all these little bodges over the winter, there are always some that need to be fettled no matter how good any previous restoration was.