You may find all sidebars in Appearance > Widgets.
As for the WooCommerce products category page the ‘Sidebar for Shop. Product list’ is default for that page.
You may edit it and add an widgets you need to be displayed on the shop category page.
DFD Support Team