I don't use the app, but if it is happening on both the phone and iPad I would suggest it's something with AppleTV or the app. Unplug the AppleTV to give it a reboot. If that doesn't work it may be a bug in the current version of the app.

Edit - Looking at the recent reviews in the app store it seems that the latest update killed swiping to navigate and scrolling, only finger presses work.