The present invention relates to a cosmetic composition, preferably for making up and/or caring for the lips, comprising: at least 6% by weight, expressed as solids, relative to the weight of the composition, of at least one organopolysiloxane elastomer conveyed in a first oil; at least one volatile or non-volatile non-phenyl silicone oil; at least one apolar hydrocarbon-based compound, which is liquid or solid at room temperature; at least one pasty fatty substance. The invention also relates to a process for making up and/or caring for the lips, comprising the application of the said composition to the lips; this composition being applied alone or before a pigmented or unpigmented composition. The invention also relates to the use of the composition for giving the lips a smooth appearance.