Geelong signalled their intentions when by defeating premiership favourite Hawthorn by 19 points at the MCG on Easter Monday.
The Adelaide Oval on Sunday will provide a similarly hot atmosphere, albeit the Cats will be the outsiders in the Power's hometown.
"No doubt Hawthorn was a big game for us, but Port are second on the ladder and we've got a big challenge to try to step up again and beat them over there," Rivers said on Friday.
"They're going to be very hard to beat over there with their crowd. No doubt we'll need to start well early and try to win the game from there."
Rivers was one of Geelong's best players against the Hawks, constantly providing support in the air for his teammates.
He admits it has taken him some time to settle into the Cats' line-up since crossing from Melbourne as an unrestricted free agent at the end of 2012.
Rivers is healthy again, after a series of knee injuries limited his first year at Geelong in 2013.
"Last year was a bit difficult for me, being injured for most of the time. The body wasn't great so this year I definitely feel more like a Geelong player and getting that confidence back in myself," Rivers said.
