Yes. Electricity in cars comes from generators, which are driven by engines, and the energy source of the engine is oil. Turning on the headlights is equivalent to adding an electrical appliance, so it will consume more fuel. But the power of the headlights is not high, and the extra oil consumed is completely negligible.