echo-grpc-triton

所属分类:微服务
开发工具:GO
文件大小:0KB
下载次数:0
上传日期:2022-11-16 08:22:52
上 传 者sh-1993
说明:  使用echo和gRPC推断API服务器到triton服务器(golang),
(Inference API server with echo and gRPC to triton server (golang),)

文件列表:
Dockerfile (241, 2022-11-16)
LICENSE (1075, 2022-11-16)
Makefile (86, 2022-11-16)
docker-compose.yml (566, 2022-11-16)
docs/ (0, 2022-11-16)
docs/docs.go (31480, 2022-11-16)
docs/swagger.json (30747, 2022-11-16)
docs/swagger.yaml (24550, 2022-11-16)
go.mod (1643, 2022-11-16)
go.sum (20832, 2022-11-16)
main.go (2118, 2022-11-16)
models/ (0, 2022-11-16)
models/identity/ (0, 2022-11-16)
models/identity/1/ (0, 2022-11-16)
models/identity/1/dummy (0, 2022-11-16)
models/identity/config.pbtxt (455, 2022-11-16)
models/identity_core/ (0, 2022-11-16)
models/identity_core/1/ (0, 2022-11-16)
models/identity_core/1/model.pt (1280, 2022-11-16)
models/identity_core/config.pbtxt (237, 2022-11-16)
proto/ (0, 2022-11-16)
proto/gen_go_stubs.sh (217, 2022-11-16)
proto/grpc_service.proto (46242, 2022-11-16)
proto/model_config.proto (68161, 2022-11-16)
tritonserver/ (0, 2022-11-16)
tritonserver/grpc_service.pb.go (228282, 2022-11-16)
tritonserver/grpc_service_api.go (7780, 2022-11-16)
tritonserver/grpc_service_grpc.pb.go (43469, 2022-11-16)
tritonserver/model_config.pb.go (248512, 2022-11-16)

# echo-grpc-triton A simple API server for Triton inference server powered by echo and gRPC. ## Prerequisites - Install [docker](https://docs.docker.com/engine/install/). - Install [go](https://go.dev/doc/install) (Optional: If you want to run this project without Docker). ## Commands ```bash docker-compose up # Run all services (API + Triton) docker-compose kill # Kill all services ``` Open http://localhost:8080/docs/index.html to see the API documents and to send a single request. Press `Try it out` button to call any API. ## References - https://github.com/triton-inference-server/client/tree/main/src/grpc_generated/go - https://github.com/sunhailin-Leo/triton-service-go - https://echo.labstack.com/guide/ - https://github.com/swaggo/swag#api-operation

近期下载者

相关文件


收藏者