The sharp swings in gold and silver prices prompted ace investor Vijay Kedia to caution that the rally was driven largely by speculators rather than long-term investors.