Hey..there's a great "instructables" demo on cleaning vinyl records on this site www.findvinylrecords.com/Cleaning-Vinyl-Records if you want to check it out.
you can wash them with a mild detergent - DO NOT use scouring or scrubbing or abrasive soaps! a soft cloth or sponge and cool NOT HOT water. dry carefully with a smooth, soft cloth.