Closes #29130

What I did

We stopped prebundling jsdoc-type-pratt-parser because of a React native issue:
#29130

I re-enabled the bundling of this package, by not transpiling unicode escape characters.

Regex unicode escape character is an ES2018 feature, but esbuild is really strict here.
Since not all browser support the latest Unicode characters.
This feature also only works in older browsers in combination with a Regex polyfill that we don't load.

The Hermes engine of React Native doesn't support this feature,
but leaving the regex alone, actually allows Hermes to do its own thing,
without us having to load a RegExp polyfill.

Checklist for Contributors

Testing

The changes in this PR are covered in the following automated tests:

• stories
• unit tests
• integration tests
• end-to-end tests

Manual testing

This section is mandatory for all contributions. If you believe no manual test is necessary, please state so explicitly. Thanks!

Documentation

• Add or update documentation reflecting your changes
• If you are deprecating/removing a feature, make sure to update
  MIGRATION.MD

Checklist for Maintainers

• When this PR is ready for testing, make sure to add ci:normal, ci:merged or ci:daily GH label to it to run a specific set of sandboxes. The particular set of sandboxes can be found in code/lib/cli-storybook/src/sandbox-templates.ts

• Make sure this PR contains one of the labels below:

  Available labels

  • bug: Internal changes that fixes incorrect behavior.
  • maintenance: User-facing maintenance tasks.
  • dependencies: Upgrading (sometimes downgrading) dependencies.
  • build: Internal-facing build tooling & test updates. Will not show up in release changelog.
  • cleanup: Minor cleanup style change. Will not show up in release changelog.
  • documentation: Documentation only changes. Will not show up in release changelog.
  • feature request: Introducing a new feature.
  • BREAKING CHANGE: Changes that break compatibility in some way with current major version.
  • other: Changes that don't fit in the above categories.

🦋 Canary release

This PR does not have a canary release associated. You can request a canary release of this pull request by mentioning the @storybookjs/core team here.

core team members can create a canary release here or locally with gh workflow run --repo storybookjs/storybook canary-release-pr.yml --field pr=<PR_NUMBER>

Greptile Summary

Updates esbuild configuration to prevent unicode regex transpilation and moves jsdoc-type-pratt-parser to devDependencies in the core package.

• Modified code/core/scripts/prep.ts to enable 'regexp-unicode-property-escapes' support in esbuild, avoiding RegExp polyfill loading
• Moved 'jsdoc-type-pratt-parser' to devDependencies in code/core/package.json as it's only needed during build time
• Change improves React Native (Hermes engine) compatibility by allowing native handling of unicode regex patterns