Skip to content

Parser performance: 2-3x speedup via grammar preprocessing and interpreter optimisations #373

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
JanJakes wants to merge 20 commits into from
Closed

Parser performance: 2-3x speedup via grammar preprocessing and interpreter optimisations #373

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
f935d03
Inline terminal matching and defer parse node allocation
JanJakes Apr 24, 2026
0e34f25
Use per-branch FIRST sets to skip unreachable branches
JanJakes Apr 24, 2026
6df347a
Short-circuit nullable-fallback and inline single-branch fragments
JanJakes Apr 24, 2026
9eea849
Strip epsilon markers and cache grammar refs on the parser
JanJakes Apr 24, 2026
ddfe4b6
Return fragment results as children arrays, skip the intermediate node
JanJakes Apr 24, 2026
77756bf
Append end-of-input sentinel token to drop range checks
JanJakes Apr 24, 2026
daec1cb
Embed branch symbol sequences directly in the per-token selector
JanJakes Apr 24, 2026
2609898
Compare selectStatement by rule id instead of by name
JanJakes Apr 24, 2026
c4e7f8f
Add parse-only benchmark tool and fix coding-standard alignment
JanJakes Apr 24, 2026
cd0b609
Deduplicate identical selector entries to shrink grammar memory
JanJakes Apr 24, 2026
e8b006f
Cache branch symbol sequences in the deduplicated selector
JanJakes Apr 24, 2026
b5959e8
Add grammar compilation experiment and supporting benchmarks
JanJakes Apr 24, 2026
bf1b1fe
Pack switch case labels to halve compiled parser line count
JanJakes Apr 24, 2026
fa2fd65
Add fast path for rules with a single branch per token
JanJakes Apr 24, 2026
1e7e3cf
Direct-return fast path for single-candidate rules
JanJakes Apr 24, 2026
9fcfb27
Mark WP_Parser_Node as final
JanJakes Apr 24, 2026
b9b64a6
Add bench-final.php helper for multi-config parser benchmarking
JanJakes Apr 24, 2026
e0c09f8
Add regex-based grammar matcher experiment
JanJakes Apr 25, 2026
9d36df4
Add hybrid regex-pre-validate + parser experiment
JanJakes Apr 25, 2026
dea9df7
Document why PHP cannot expose PCRE2 callouts (the only way to get an…
JanJakes Apr 25, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion packages/mysql-on-sqlite/src/mysql/class-wp-mysql-parser.php
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ class WP_MySQL_Parser extends WP_Parser {
* @return bool Whether a query was successfully parsed.
*/
public function next_query(): bool {
if ( $this->position >= count( $this->tokens ) ) {
if ( $this->position >= $this->token_count ) {
return false;
}
$this->current_ast = $this->parse();
Expand Down
Loading
Loading