If it's a small app with simple styles and behaviours then you can certainly roll out your own. At a certain threshold of complexity, a React app requires building out your own component library which becomes too time consuming and you'd wish you started off with one.

You make your call for what the end game is of this product.