Not possible. It is one of the reasons I will replace advanced actions by shared actions whenever possible. Shared actions do appear as assets in the Library, with the Usage button just like other assets. Management is a lot easier in that case than the older workflow with advanced actions. I have been debugging many files for clients, know what a problem it is to strip out a file of the unused variables and actions without problems. If an advanced action name ever was used in a project, it can not be reused at all even if the action was deleted. That is NOT the case for shared actions, another advantage. Have a look at the presentation I used during a webinar about shared actions (wished they let me repeat that webinar for Adobe):
https://elearning.adobe.com/2018/03/intro-shared-actions/
It is not possible to embed the presentation in the portal, but you’ll find a link.

Is there a way, we can delete all the unused advanced action on a single click like we do for unused asset in library.

If the variable or advanced action is used don’t remove it. You can remove variables in the variables window by selecting it and using the remove button and delete advanced actions in the advanced actions window by selecting it in the existing actions list and them click the delete icon trash can)