byzer-lang

所属分类:人工智能/神经网络/深度学习
开发工具:Scala
文件大小:5732KB
下载次数:0
上传日期:2023-04-24 08:32:38
上 传 者sh-1993
说明:  byzer lang,byzer(前MLSQL):一种用于数据管道、分析和人工智能的低代码开源编程语言。
(byzer-lang,Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.)

文件列表:
.travis.yml (1016, 2023-04-24)
LICENSE (11357, 2023-04-24)
RELEASES.md (166, 2023-04-24)
conf (0, 2023-04-24)
conf\byzer-server-log4j2.properties (3401, 2023-04-24)
conf\byzer-tools-log4j2.properties (2556, 2023-04-24)
conf\byzer.properties (2902, 2023-04-24)
conf\byzer.properties.all-in-one.example (608, 2023-04-24)
conf\byzer.properties.override (99, 2023-04-24)
conf\byzer.properties.server.example (586, 2023-04-24)
conf\byzer.properties.server.yarn-client.example (586, 2023-04-24)
db.sql (3765, 2023-04-24)
dev (0, 2023-04-24)
dev\bootstrap.sh (9545, 2023-04-24)
dev\byzer.sh (1410, 2023-04-24)
dev\change-scala-version.sh (2101, 2023-04-24)
dev\change-version-to-2.11.sh (1018, 2023-04-24)
dev\change-version-to-2.12.sh (1018, 2023-04-24)
dev\check-1000-os.sh (1248, 2023-04-24)
dev\check-1100-java.sh (1159, 2023-04-24)
dev\check-1200-ports.sh (1534, 2023-04-24)
dev\check-env.sh (3412, 2023-04-24)
dev\empty.json (0, 2023-04-24)
dev\fetchPR.sh (224, 2023-04-24)
dev\get-properties.sh (1358, 2023-04-24)
dev\header.sh (5082, 2023-04-24)
dev\kill-process-tree.sh (1592, 2023-04-24)
dev\make-distribution.sh (1521, 2023-04-24)
dev\mlsql_cluster_cloud (0, 2023-04-24)
jar-to-slaves.sh (973, 2023-04-24)
dev\mlsql_cluster_cloud\run-mlsql-cluster.sh (12462, 2023-04-24)
dev\mlsql_cluster_cloud\start-slaves.sh (724, 2023-04-24)
... ...

![CI](https://github.com/byzer-org/byzer-lang/actions/workflows/build_and_test.yml/badge.svg) [![License](https://img.shields.io/badge/License-Apache_2.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)

drawing

## Byzer-lang **Byzer** (former MLSQL) is a low-code, open-sourced and distributed programming language for data pipeline, analytics and AI in cloud native way. **Deisgn protocol: Everything is a table.** Byzer is a SQL-like language, to simplify data pipeline, analytics and AI, combined with built-in algorithms and extensions. We believe that everything is a table, a simple and powerful SQL-like language can significantly reduce human efforts of data development without switching different tools. ### Byzer Architecture ![Byzer-lang Arch](images/Byzer-arch.png) You can build a data product based on Byzer engine & Byzer-lang without interacting with computing framework directly like Spark in your data APP. Thus will simplify your data app significantly. For example, Byzer org contributes a data app [Byzer Notebook](https://github.com/byzer-org/byzer-notebook), which provides notebook interaction & workflow GUI interaction. ### BIP (Byzer Improvement Proposal) Byzer project uses the [BIP](https://github.com/byzer-org/byzer-lang/wiki) for the community collaboration, you can checkout the feature design or architecture design in BIP. ### Online Trial You can access the official website [https://www.byzer.org/](https://www.byzer.org/) and try Byzer-lang & Byzer Notebook online. ### Download You can download Byzer engine via: - [https://download.byzer.org/](https://download.byzer.org/) - [Byzer Docker Hub](https://hub.docker.com/u/byzer) - [Github Release](https://github.com/byzer-org/byzer-lang/releases) For more details, please refer to the [docs](https://docs.byzer.org/#/byzer-lang/zh-cn/installation/README) ### Install For **dev/test** purpose, you can download [Byzer All In One Package](https://docs.byzer.org/#/byzer-lang/zh-cn/installation/server/byzer-all-in-one-deployment), extract and then execute the command below ``` $ cd {BYZER_HOME} $ ./bin/byzer.sh start ``` And for **production** purpose, we recommend to use [Byzer Server Package](https://docs.byzer.org/#/byzer-lang/zh-cn/installation/server/binary-installation) and deploy it on Hadoop. You can also install [Byzer VSCode Extension](https://docs.byzer.org/#/byzer-lang/zh-cn/installation/vscode/byzer-vscode-extension-installation) to use Byzer-lang. For the Docker Image or , please refer to the [docs](https://docs.byzer.org/#/byzer-lang/zh-cn/installation/README) ### Byzer Code Example Below list an example that how to process Github API as a table to get the information of Byzer Org ```sql -- Get Github Organization Info -- set API URL and params SET org_name="byzer-org"; SET GITHUB_ORGANIZATION_URL="https://api.github.com/orgs/${org_name}"; -- Load Github Organization API as table LOAD Rest.`$GITHUB_ORGANIZATION_URL` where `config.connect-timeout`="10s" and `config.method`="GET" and `header.accept`="application/vnd.github.v3+json" as github_org; -- decode API response from binary to a json string select string(content) as content from github_org as response_content; -- expand the json string run response_content as JsonExpandExt.`` where inputCol="content" and structColumn="true" as github_org; -- retrieve user infomation and process as a table select content.* from github_org as org_info; -- save the table to delta lake save overwrite org_info as delta.`github_info_db.byzer_org`; ``` For more details about the Byzer-lang grammer, please refer to the user manaual [Byzer-lang Grammar](https://docs.byzer.org/#/byzer-lang/zh-cn/grammar/outline) ### Development 1. Fork this repository and clone to local machine ``` git clone https://github.com/{YOUR_GITHUB}/byzer-lang.git ``` 2. Use Intellj Idea to open the project, choose the scala version `2.12.10` 3. In Intellj Idea Maven Setting, check the profile below - gpg - local - scala-2.12 - spark-3.0.0 - streamingpro-spark-3.0.0-adaptor 4. Click Maven Refresh and wait for Idea load finished 5. Find the class `tech.mlsql.example.app.LocalSparkServiceApp`, click Debug button then Byzer Engine will be started, then you can access the Byzer Web Console in [http://localhost:9003/](http://localhost:9003/#/) ### Build You can refer to the project [byzer-org/byzer-build](https://github.com/byzer-org/byzer-build) to check how to build the Byzer engine binary packages and images ### How to contribute to Byzer-Lang If you are planning to contribute to this project, please create an issue at [our Issue page](https://github.com/byzer-org/byzer-lang/issues) even if the topic is not related to source code itself (e.g., documentation, new idea and proposal). This is an active open source project for everyone, and we are always open to people who want to use this system or contribute to it. For more details about how to contribute to the Byzer Org, please refer to [How to Contribute](https://docs.byzer.org/#/byzer-lang/zh-cn/appendix/contribute) ### Contributors Made with [contrib.rocks](https://contrib.rocks). ### Community - **Slack**: [byzer-org.slack.com](https://byzer-org.slack.com) - **Wechat Official Account:** Byzer Community

近期下载者

相关文件


收藏者