Seems a good way to find out is create a product or two and assign them mulitple categories, then export them to csv. Then you will see how they do it.
Because I met many problems with CSV files (compatibility, language coding, ...), I prefer use XML files to import products. It’s so simple and worked the first time.