Like many Windows 11/10 users who use the Sticky Notes app regularly, it might have also annoyed you that, at times, the Sticky Notes icon on the taskbar is not combined. For each sticky note created ...
You can change folder icons in Windows 11 by right-clicking and selecting "Properties" and "Customize." Desktop icons like the Recycle Bin are changed in the Settings under Personalization and Themes.