Generally I know pretty quick. I have had some "UNO reverse cards" on a couple and one which I just wouldn't let it get the better of me. Yet it ultimately did.
Two games I didn't like right off the bat was Valkyrie Profile and Final Fantasy Tactics. I borrowed FFT off a school buddy put five hours into it that evening, gave it back the next day. On a whim borrowed it again month later and loved it, still do.
Another friend brought VP by the house raving about it. I played a coupe of hours of it, didn't like it. Was at a mutual friends house who had borrowed it and watched him play it for three hours, still didn't care for it.
I bought it for $20 at a Gamestop because I had money burning a hole in my pocket. Brought it home put it on the shelf for months. Took it down because it was one I hadn't played to death, or at all. It's among my top 5 Playstation games.
Games that I have put several hours into and haven't looked back, Grand Theft Auto III, I haven't played any of them since. I only own GTA V by chance. It came with the Xbox One I bought. I haven't even bothered to install it.
Unlimited Saga. Played it for 30 minutes and decided that was more than enough. Parasite Eve 2. I loved the first one, was looking forward to the sequel. Parasite Evil 2, more like. Too much like RE for my blood. I love RE but it just didn't feel right here.
The one I kept throwing myself at again and again was Saga Frontier II. I thought at first I just didn't understand it. Nope, I just didn't like it. I wasn't going to let it beat me though. It did, repeatedly. So I got one of those cheat adapters and maxed out my parties stats, bull dozed my way to what I presumed to be the final boss. Just to have it after a couple of turns pull some AoE wave attack that one shot my entire party. It wasn't a fluke. It done it regularly. I quit at that point. I traded it two days later. I was done.