React Server Components, without a framework

Can we use React Server Components today, without a framework like Next.js? As our experiment shows, not without significant challenges - for now at least?