echo-grpc-triton
所属分类:微服务
开发工具:GO
文件大小:0KB
下载次数:0
上传日期:2022-11-16 08:22:52
上 传 者:
sh-1993
说明: 使用echo和gRPC推断API服务器到triton服务器(golang),
(Inference API server with echo and gRPC to triton server (golang),)
文件列表:
Dockerfile (241, 2022-11-16)
LICENSE (1075, 2022-11-16)
Makefile (86, 2022-11-16)
docker-compose.yml (566, 2022-11-16)
docs/ (0, 2022-11-16)
docs/docs.go (31480, 2022-11-16)
docs/swagger.json (30747, 2022-11-16)
docs/swagger.yaml (24550, 2022-11-16)
go.mod (1643, 2022-11-16)
go.sum (20832, 2022-11-16)
main.go (2118, 2022-11-16)
models/ (0, 2022-11-16)
models/identity/ (0, 2022-11-16)
models/identity/1/ (0, 2022-11-16)
models/identity/1/dummy (0, 2022-11-16)
models/identity/config.pbtxt (455, 2022-11-16)
models/identity_core/ (0, 2022-11-16)
models/identity_core/1/ (0, 2022-11-16)
models/identity_core/1/model.pt (1280, 2022-11-16)
models/identity_core/config.pbtxt (237, 2022-11-16)
proto/ (0, 2022-11-16)
proto/gen_go_stubs.sh (217, 2022-11-16)
proto/grpc_service.proto (46242, 2022-11-16)
proto/model_config.proto (68161, 2022-11-16)
tritonserver/ (0, 2022-11-16)
tritonserver/grpc_service.pb.go (228282, 2022-11-16)
tritonserver/grpc_service_api.go (7780, 2022-11-16)
tritonserver/grpc_service_grpc.pb.go (43469, 2022-11-16)
tritonserver/model_config.pb.go (248512, 2022-11-16)
# echo-grpc-triton
A simple API server for Triton inference server powered by echo and gRPC.
## Prerequisites
- Install [docker](https://docs.docker.com/engine/install/).
- Install [go](https://go.dev/doc/install) (Optional: If you want to run this project without Docker).
## Commands
```bash
docker-compose up # Run all services (API + Triton)
docker-compose kill # Kill all services
```
Open http://localhost:8080/docs/index.html to see the API documents and to send a single request.
Press `Try it out` button to call any API.
## References
- https://github.com/triton-inference-server/client/tree/main/src/grpc_generated/go
- https://github.com/sunhailin-Leo/triton-service-go
- https://echo.labstack.com/guide/
- https://github.com/swaggo/swag#api-operation
近期下载者:
相关文件:
收藏者: