In one embodiment, the transparent growth substrate of an LED die is formed to have light scattering areas, such as voids formed by a laser. In another embodiment, the growth substrate is removed and replaced by another substrate that is formed with light scattering areas. In one embodiment, the light scattering areas are formed over the light absorbing areas of the LED die, to reduce the amount of incident light on those absorbing areas, and over the sides of the substrate to reduce light guiding. The replacement substrate may be formed to include reflective particles in selected areas. A 3D structure may be formed by stacking substrate layers containing the reflective areas. The substrate may be a transparent substrate or a phosphor tile that is affixed to the top of the LED.