I never did, so I do not know, but will it even oscillate without the load capacitors?

Built-in oscillators are often so 'friendly' (or unfriendly!!) that unavoidable input stray capacitance is sufficient to get them started and running, somehow. Sometimes, oscillator will not be able to start, also. But in any case, frequency is very unstable...

Kai