For circuits, like regulators particularly the older generation LDOs, the low ESR of ceramics will cause the pole to shift so much that the output becomes unstable, so the preference for electrolytics that too Al and not the tantalums.
In general Hi K ceramic caps are small for the value and cheaper but have piezo nature which appears like dielectric absorption, and can cause precision circuits to misbehave.