The dressing of two-level systems (qubits) by a resonant radiation field is one of the most common methods to actively protect quantum states from dephasing. Here, we study the dynamics of a continuously driven qubit in the presence of qubit-frequency fluctuations represented by an Orstein-Ulhenbeck process. Following a stochastic path integral approach, we analytically characterise the decay of coherence on function of the relevant parameters of the system, and identify the main differences between the different regimes.On top of that, we consider the effect of fluctuations in the amplitude of the driving field, which may become the main source of decoherence for strong drivings. Furthermore, we propose to combine the qubit dressing with refocusing techniques using fast phase flips in the driving field. We also derive analytical expressions that allow us to characterise the enhancement of coherence times by these phase flips, and identify the regimes with optimal performance. Finally, we benchmark our analytical results with exact numerical simulations.