Man, this is why I can't play Majora's Mask. I love the lore and music and everything, but that three day timer is just way too much of a turn-off for me. On the other hand, I can play games like the recently released NeoDash where there is a death wall chasing you while you race and have to execute everything flawlessly.
For me, I think short timers with fast replay times is key. Majora's timer is too long, and even though I know you can go back in time with the items you have currently and that's a key part of the game, there's some part of me that just gets too stressed thinking about restarting from the beginning if I'm not fast enough. With NeoDash, if you fail to execute correctly and die to the wall, you immediately get reset at the beginning of a level that is, at most, one minute long. No load screen, even.