The inadequate supply of oxygen during the combustion of the piece of paper produces solid carbon particles that rise up in the flame. They become hot and glow to give off yellowish light. This makes the piece of paper burn with a yellowish flame.