Let's try to customizing older and newer post links by replacing <data:newerPageTitle/>, <data:homeMsg/> and <data:olderPageTitle/> with whatever we want.
After you find those three scripts above on your template, you can change those three scripts above with text, image and or put text and image together.
Good luck !!!