When attempting to use CustomModelData for items provided by a datapack, the items do not display their custom models. See the attached screenshot for an example of the bug.
Steps
Create a new world.
Install the datapack attached below (datapack taken from attachment on https://bugs.mojang.com/browse/MC-138892).
Use the following command to give yourself a water bucket with CustomModelData:
/give @s minecraft:water_bucket{CustomModelData:1}
The item that appears in your inventory will maintain the regular water bucket texture.
Can't reproduce, it appears as dirt for me. That is a resource pack, not a data pack. Did you equip it as a resource pack?