Under the stairs near the temple you can go through the wall. Then you are trapped inside.
Not only one point where you can go into the wall. Near the river are many.