That’s what I do. Permanent marker like Sharpies gets sucked into the voids and seems to last very well for me, but sometimes I use acrylics, too. All depends on the use case and look I am going for. Play with different media and see.
FolkArt Enamel acrylic paints work great.