postgresql-parser
所属分类:PostgreSQL
开发工具:GO
文件大小:1683KB
下载次数:0
上传日期:2022-12-26 07:29:28
上 传 者:
sh-1993
说明: 纯果朗PostgreSQL(SQL:2011,SQL:2008,SQL:2003,SQL:1999和SQL-92标准)解析器
(Pure Golang PostgreSQL (SQL:2011, SQL:2008, SQL:2003, SQL:1999, and SQL-92 Standard) Parser)
文件列表:
.editorconfig (444, 2023-06-27)
LICENSE (593, 2023-06-27)
Makefile (6241, 2023-06-27)
example (0, 2023-06-27)
example\format (0, 2023-06-27)
example\format\format.go (6020, 2023-06-27)
example\walk (0, 2023-06-27)
example\walk\walk.go (576, 2023-06-27)
go.mod (1440, 2023-06-27)
go.sum (34179, 2023-06-27)
pkg (0, 2023-06-27)
pkg\sql (0, 2023-06-27)
pkg\sql\lex (0, 2023-06-27)
pkg\sql\lex\all_keywords.go (3930, 2023-06-27)
pkg\sql\lex\encode.go (10770, 2023-06-27)
pkg\sql\lex\encode_test.go.bak (7061, 2023-06-27)
pkg\sql\lex\experimental_keywords.go (834, 2023-06-27)
pkg\sql\lex\keywords.go (33897, 2023-06-27)
pkg\sql\lex\normalize.go (1494, 2023-06-27)
pkg\sql\lex\predicates.go (2750, 2023-06-27)
pkg\sql\lex\reserved_keywords.go (4383, 2023-06-27)
pkg\sql\lex\tokens.go (10086, 2023-06-27)
pkg\sql\parser (0, 2023-06-27)
pkg\sql\parser\base.go (355, 2023-06-27)
pkg\sql\parser\gen (0, 2023-06-27)
pkg\sql\parser\gen\sql-gen.y (218706, 2023-06-27)
pkg\sql\parser\gen\sql.go.tmp (806476, 2023-06-27)
pkg\sql\parser\gen\y.output (5449253, 2023-06-27)
pkg\sql\parser\help.awk (4423, 2023-06-27)
pkg\sql\parser\help.go (7340, 2023-06-27)
pkg\sql\parser\help_gen_test.sh (565, 2023-06-27)
pkg\sql\parser\help_messages.go (35624, 2023-06-27)
pkg\sql\parser\help_test.go.bak (15089, 2023-06-27)
pkg\sql\parser\helpmap_test.go (1564, 2023-06-27)
pkg\sql\parser\helpmap_test.go.bak (1564, 2023-06-27)
pkg\sql\parser\lexer.go (7643, 2023-06-27)
... ...
# What's this
PostgreSQL style Parser splitted from [CockroachDB](https://github.com/cockroachdb/cockroach)
See: [Complex SQL format example](example/format/format.go)
I tried to import `github.com/cockroachdb/cockroach/pkg/sql/parser`, but the dependencies is too complex to make it work.
To make things easy, I did these things:
1. Copy all the `pkg/sql/parser`, `pkg/sql/lex` and simplify the dependencies
2. Simplify the Makefile to just generate the goyacc stuff
3. Add the goyacc generated files in parser and lex to make `go get` work easily, see the `.gitignore` files
4. Trim the `etcd` dependency, see the `go.mod`
5. Rename all test file except some `pkg/sql/parser` tests
6. Add all necessary imports to vendor
7. Remove the `panic` of meeting unregistried functions, see the [WrapFunction](pkg/sql/sem/tree/function_name.go#L67)
8. Other nasty things make the parser just work that I forgot :p
# Who is using this
- [Atlas](https://github.com/ariga/atlas) 1.8k stars
- [ByteBase](https://github.com/bytebase/bytebase) 3.6k stars
- [More](https://github.com/auxten/postgresql-parser/network/dependents)
# Features
- Pure golang implementation
- *Almost* full support of PostgreSQL (`cockroachdb` style PostgreSQL)
- For SQL lineage analysis see [go-sql-lineage](https://github.com/auxten/go-sql-lineage)
## SQL Standard Compliance
The code is derived from CockroachDB v20.1.11 which supports most of the major features of SQL:2011. See:
- https://www.cockroachlabs.com/docs/v20.1/postgresql-compatibility
- https://www.postgresql.org/docs/9.5/features.html
# How to use
```go
package main
import (
"log"
"github.com/auxten/postgresql-parser/pkg/sql/parser"
"github.com/auxten/postgresql-parser/pkg/walk"
)
func main() {
sql := `select marr
from (select marr_stat_cd AS marr, label AS l
from root_loan_mock_v4
order by root_loan_mock_v4.age desc, l desc
limit 5) as v4
LIMIT 1;`
w := &walk.AstWalker{
Fn: func(ctx interface{}, node interface{}) (stop bool) {
log.Printf("node type %T", node)
return false
},
}
stmts, err := parser.Parse(sql)
if err != nil {
return
}
_, _ = w.Walk(stmts, nil)
return
}
```
# SQL parser
This project contains code that is automatically generated using `goyacc`.
`goyacc` reads the SQL expressions ([`sql.y`](https://github.com/auxten/postgresql-parser/blob/main/pkg/sql/parser/sql.y)) and generates a parser which could be used to tokenize a given input.
You could update the generated code using the `generate` target inside the project's Makefile.
```bash
$ make generate
```
# Progress
- 2021-02-16 `github.com/auxten/postgresql-parser/pkg/sql/parser` Unit tests works now!
- 2021-03-08 Add walker package.
- 2022-08-03 Remove vendored dependencies by @mostafa in https://github.com/auxten/postgresql-parser/pull/19
# Todo
- Fix more unit tests
- Make built-in function parsing work
近期下载者:
相关文件:
收藏者: