Hi! Color Swatches Pro Extension is the right add-on for you to get the features you want. It allows to show all available colors and any other attributes of config products on category pages as well as product pages. See the image attached.
To know more details, see user guide and live demo please follow the link http://amasty.com/color-swatches-pro.html
Feel free to contact directly our support team to know about the details http://amasty.com/support.html