Cactus has simular hitboxes to chests and enderchests but it does not behave the same way

You can't break blocks under cactus even though their hit box is smaller than a full block like chests, anvils, ender chests, brewing stands, etc.