I examine the analyticity of the free energy of gauge theories with quarks at finite chemical potential and set up Taylor expansions for various physical quantities. Relations between various Taylor coefficients are obtained either as Maxwell identities or through chiral Ward identities. I also present some numerical results for QCD in its high temperature phase, which are relevant to present day experiments.