It could be hydraulic lifters( tappets) that make this kind of noise. As you said once engine warms up noise goes away.
Oil goes into tappets and adjusts them to operate according to camshaft position, obviously cold oil is a bit slow at start untill warm, when it reaches its working temperature. Hence creating noise when engine is cold, dissapearing gradually as oil gets hotter.