Great Wonders are kept, but no longer generate culture. If you recapture a lost town in which YOU built a Great Wonder, culture generation will resume.
Ordinary buildings generating culture (temples, libraries, etc.) are destroyed, when a city is conquered.
Other improvements (barracks, markets, harbor, etc.) are destroyed with a certain probability. I read an article once with more details, but can't remember them.