Is it easy to see why the two sides of this get confused?

There is certainly plenty of blame to go around. It is also a certainty that the majority of people on both sides want peace. To consistently take the side of Israel, or to take the side against Israel, either would be folly.