Auras have the disableCooldown attribute.
https://github.com/oUF-wow/oUF/blob/.../auras.lua#L19
*edit* Ohhh by count text you do not mean the aura stack counter but the actual duration timer text.
You can use
button.cd:SetDrawSwipe(false) instead then.
https://github.com/oUF-wow/oUF/issues/447