Sure, do what you want!
With the Prius, we could get 50 MPG with an effort, 47 MPG without an effort. It really saves on fuel, but it is not fun to drive, a lot because of the transmission it has.
The RAV4 Hybrid has the same system and same transmission. I did not drive it, but assume it is...