Yes and No. Ozone in the high atmospheric layers (the one forming the ozono layer) is continuosly generated from oxygene due to hard solar UV radiation. In low atmospheric layers near the ground Ozono is generated through several mechanisms, for instance storms, or urban air polution + solar UV radiation. However this tropospheric ozone does not protect us against space UV radiation since it remains near the ground and never diffuses to the high atmosphere.