See the post here: How to add custom icons
You will need to sign in to the remote. Then, hit Activities & Macros.
Then, select your activity (in my example, Watch Live TV)
Then, edit user interface
Then, make a button on the components tab using the Button with Icon option. Select your icon from the list.