In what consist the circuits you use for charging and discharging respectively? The times for charging and discharging depend, besides from the capacitance of the capacitor, on the other components of the circuit.
For example, in the circuit of a camera flash, you charge the capacitor from a battery which, at the rated voltage, can only debit a limited current. Then you discharge the capacitor on the flash lamp and the discharge current is limited by the flash lamp's resistance, but is far larger than the maximum current of the battery. So in this case the charging time is bigger than the discharging time.
In the general case, if your charging/discharging circuit is composed of the capacitor and some other (resistive) components which have an overall resistance R (seen at the capacitor's leads), the charging/discharging time will be equal to RC which is called the time constant of the circuit.
So, if you charge the capacitor through a resistance and then discharge it through a higher resistance the charging time will be lower than the discharging time in this case.