You'd probably have to run them via emulator, but Shinrei Jusatsushi Taromaru, Ninja Warriors Again, and Sengoku 3 are all pretty fun side-scrolling ninja games.
PS: I would add Nightshade for PS2, but since I just bought it myself, I don't really know if it's good or not. I hear good things, though!