Windows makes it easy (although not obvious) to customize the Taskbar with custom icons. You don’t need a third-party app, just the icon files to replace the defaults.

This guide explains how to add or remove Mouse Keys Icon on Taskbar in Windows 11 using Control Panel or Windows Settings.