first commit
This commit is contained in:
sujune
commit
bcb7168824
|
|
@ -0,0 +1,54 @@
|
||||||
|
# 이 코드 템플릿은 SDT Cloud 환경에서 s3에 파일을 업로드하는 MQTT 메세지를 발행하는 코드입니다.
|
||||||
|
|
||||||
|
# 패키지 설치
|
||||||
|
- 코드는 sdtclouds3, sdtcloudpubsub 패키지를 사용합니다. 아래 명령어로 패키지를 다운로드 해야합니다.
|
||||||
|
```bash
|
||||||
|
$ pip install sdtclouds3 sdtcloudpubsub
|
||||||
|
```
|
||||||
|
|
||||||
|
# 환경 셋팅
|
||||||
|
- 코드를 실행하기 전에, 장비에 sdtcloud 로그인 작업을 수행해야 합니다. !!
|
||||||
|
```bash
|
||||||
|
sudo bwc-cli login
|
||||||
|
```
|
||||||
|
|
||||||
|
# 코드 작성
|
||||||
|
## s3 코드 작성
|
||||||
|
- 코드는 runAction 함수에서 동작하고자 하는 기능을 작성합니다.
|
||||||
|
- uploadFile 변수는 s3에 업로드할 파일의 위치입니다. 반드시 파일의 위치와 파일명을 함께 작성해야 합니다.
|
||||||
|
```bash
|
||||||
|
uploadFile = "filepath/text.txt"
|
||||||
|
```
|
||||||
|
- 업로드가 완료되면 파일의 URL 값이 반환됩니다.
|
||||||
|
```bash
|
||||||
|
result = sdtcloudClient.uploadData(uploadFile)
|
||||||
|
print(result)
|
||||||
|
----------
|
||||||
|
https://<s3_bucket>/path/text.txt
|
||||||
|
```
|
||||||
|
- 만약 업로드하는 파일이 PNG 파일이며, URL를 클릭했을 때 이미지가 바로 보이도록 설정하고 싶다면 다음과 같이 수정합니다.
|
||||||
|
```bash
|
||||||
|
result = sdtcloudClient.uploadData(uploadFile, {“ContentType”: “image/png”})
|
||||||
|
```
|
||||||
|
- 이외에 여러 옵션이 있으므로 [참고 페이지](https://boto3.amazonaws.com/v1/documentation/api/latest/guide/s3-uploading-files.html)를 클릭하세요.
|
||||||
|
|
||||||
|
|
||||||
|
## mqtt 코드 작성
|
||||||
|
- 다음 변수로 메세지를 발행하는 코드를 작성하면...
|
||||||
|
```bash
|
||||||
|
msg = {
|
||||||
|
"message": "Hello World",
|
||||||
|
"uploadFile": result
|
||||||
|
}
|
||||||
|
```
|
||||||
|
- 실제로 발행되는 메세지은 다음과 같습니다.
|
||||||
|
```bash
|
||||||
|
msg = {
|
||||||
|
"data": {
|
||||||
|
"message": "Hello World",
|
||||||
|
"uploadFile": "https://<s3_bucket>/path/text.txt"
|
||||||
|
},
|
||||||
|
"timestamp": 12312311...
|
||||||
|
}
|
||||||
|
|
||||||
|
```
|
||||||
|
|
@ -0,0 +1,13 @@
|
||||||
|
{
|
||||||
|
"model": {
|
||||||
|
"seed": 0,
|
||||||
|
"name": "vit_base_patch32_384",
|
||||||
|
"num_classes": 6,
|
||||||
|
"device": "cuda:0",
|
||||||
|
"ckpt_path": "./weights/vit_base_patch32_384_1.pth"},
|
||||||
|
"minio_bucket": "inference-app-models",
|
||||||
|
"minio_url": "http://43.200.53.170:31191",
|
||||||
|
"minio_access_key":"shWhLpEhJA8mlMLcldCT",
|
||||||
|
"minio_secret_key":"QONntgD3bww2CGVKKDz5Qtg3CWzP1FMqWyatBU5P",
|
||||||
|
"minio_region_name": "us-east-1"
|
||||||
|
}
|
||||||
|
|
@ -0,0 +1,17 @@
|
||||||
|
version: bwc/v2 # bwc 버전 정보입니다.
|
||||||
|
spec:
|
||||||
|
appName: inference-app # 앱의 이름입니다.
|
||||||
|
appType: inference
|
||||||
|
runFile: main.py # 앱의 실행 파일입니다.
|
||||||
|
env:
|
||||||
|
bin: python3 # 앱을 실행할 바이너라 파일 종류입니다.(장비에 따라 다르므로 확인 후 정의해야 합니다.)
|
||||||
|
virtualEnv: inference-app-env # 사용할 가상환경 이름입니다.
|
||||||
|
package: requirement.txt # 설치할 Python 패키지 정보 파일입니다.(기본 값은 requirement.txt 입니다.)
|
||||||
|
runtime: python3.11.4
|
||||||
|
stackbase:
|
||||||
|
tagName: v1.0.6 # Stackbase(gitea)에 릴리즈 태그명 입니다.
|
||||||
|
repoName: inference-app # Stackbase(gitea)에 저장될 저장소 이릅니다.
|
||||||
|
inference:
|
||||||
|
weightFile: vit_base_patch32_384_type.pth
|
||||||
|
bucket: inference-app-models
|
||||||
|
path: vit_base_patch32_384
|
||||||
|
|
@ -0,0 +1,153 @@
|
||||||
|
2024-07-09 14:37:27,415 - grpc._server - ERROR - Exception calling application: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
Traceback (most recent call last):
|
||||||
|
File "/etc/sdt/venv/inference-app-env/lib/python3.11/site-packages/grpc/_server.py", line 494, in _call_behavior
|
||||||
|
response_or_iterator = behavior(argument, context)
|
||||||
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 141, in UploadImage
|
||||||
|
runAction(request.filename, pred)
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 82, in runAction
|
||||||
|
sdtcloudMqttClient.pubMessage(mqttClient, data)
|
||||||
|
TypeError: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
2024-07-09 14:37:28,681 - grpc._server - ERROR - Exception calling application: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
Traceback (most recent call last):
|
||||||
|
File "/etc/sdt/venv/inference-app-env/lib/python3.11/site-packages/grpc/_server.py", line 494, in _call_behavior
|
||||||
|
response_or_iterator = behavior(argument, context)
|
||||||
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 141, in UploadImage
|
||||||
|
runAction(request.filename, pred)
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 82, in runAction
|
||||||
|
sdtcloudMqttClient.pubMessage(mqttClient, data)
|
||||||
|
TypeError: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
2024-07-09 14:37:55,566 - grpc._server - ERROR - Exception calling application: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
Traceback (most recent call last):
|
||||||
|
File "/etc/sdt/venv/inference-app-env/lib/python3.11/site-packages/grpc/_server.py", line 494, in _call_behavior
|
||||||
|
response_or_iterator = behavior(argument, context)
|
||||||
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 141, in UploadImage
|
||||||
|
runAction(request.filename, pred)
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 82, in runAction
|
||||||
|
sdtcloudMqttClient.pubMessage(mqttClient, data)
|
||||||
|
TypeError: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
2024-07-09 14:38:00,446 - grpc._server - ERROR - Exception calling application: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
Traceback (most recent call last):
|
||||||
|
File "/etc/sdt/venv/inference-app-env/lib/python3.11/site-packages/grpc/_server.py", line 494, in _call_behavior
|
||||||
|
response_or_iterator = behavior(argument, context)
|
||||||
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 141, in UploadImage
|
||||||
|
runAction(request.filename, pred)
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 82, in runAction
|
||||||
|
sdtcloudMqttClient.pubMessage(mqttClient, data)
|
||||||
|
TypeError: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
2024-07-09 14:38:01,173 - grpc._server - ERROR - Exception calling application: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
Traceback (most recent call last):
|
||||||
|
File "/etc/sdt/venv/inference-app-env/lib/python3.11/site-packages/grpc/_server.py", line 494, in _call_behavior
|
||||||
|
response_or_iterator = behavior(argument, context)
|
||||||
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 141, in UploadImage
|
||||||
|
runAction(request.filename, pred)
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 82, in runAction
|
||||||
|
sdtcloudMqttClient.pubMessage(mqttClient, data)
|
||||||
|
TypeError: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
2024-07-09 14:38:13,599 - grpc._server - ERROR - Exception calling application: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
Traceback (most recent call last):
|
||||||
|
File "/etc/sdt/venv/inference-app-env/lib/python3.11/site-packages/grpc/_server.py", line 494, in _call_behavior
|
||||||
|
response_or_iterator = behavior(argument, context)
|
||||||
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 141, in UploadImage
|
||||||
|
runAction(request.filename, pred)
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 82, in runAction
|
||||||
|
sdtcloudMqttClient.pubMessage(mqttClient, data)
|
||||||
|
TypeError: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
2024-07-09 14:38:14,483 - grpc._server - ERROR - Exception calling application: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
Traceback (most recent call last):
|
||||||
|
File "/etc/sdt/venv/inference-app-env/lib/python3.11/site-packages/grpc/_server.py", line 494, in _call_behavior
|
||||||
|
response_or_iterator = behavior(argument, context)
|
||||||
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 141, in UploadImage
|
||||||
|
runAction(request.filename, pred)
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 82, in runAction
|
||||||
|
sdtcloudMqttClient.pubMessage(mqttClient, data)
|
||||||
|
TypeError: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
2024-07-09 14:38:14,962 - grpc._server - ERROR - Exception calling application: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
Traceback (most recent call last):
|
||||||
|
File "/etc/sdt/venv/inference-app-env/lib/python3.11/site-packages/grpc/_server.py", line 494, in _call_behavior
|
||||||
|
response_or_iterator = behavior(argument, context)
|
||||||
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 141, in UploadImage
|
||||||
|
runAction(request.filename, pred)
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 82, in runAction
|
||||||
|
sdtcloudMqttClient.pubMessage(mqttClient, data)
|
||||||
|
TypeError: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
2024-07-09 14:39:29,783 - grpc._server - ERROR - Exception calling application: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
Traceback (most recent call last):
|
||||||
|
File "/etc/sdt/venv/inference-app-env/lib/python3.11/site-packages/grpc/_server.py", line 494, in _call_behavior
|
||||||
|
response_or_iterator = behavior(argument, context)
|
||||||
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 142, in UploadImage
|
||||||
|
runAction(request.filename, pred)
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 84, in runAction
|
||||||
|
sdtcloudMqttClient.pubMessage(mqttClient, data)
|
||||||
|
TypeError: sdtcloudpubsub.pubMessage() takes 2 positional arguments but 3 were given
|
||||||
|
2024-07-09 14:40:29,903 - grpc._server - ERROR - Exception calling application: runAction() missing 1 required positional argument: 'mqttClient'
|
||||||
|
Traceback (most recent call last):
|
||||||
|
File "/etc/sdt/venv/inference-app-env/lib/python3.11/site-packages/grpc/_server.py", line 494, in _call_behavior
|
||||||
|
response_or_iterator = behavior(argument, context)
|
||||||
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 142, in UploadImage
|
||||||
|
runAction(request.filename, pred)
|
||||||
|
TypeError: runAction() missing 1 required positional argument: 'mqttClient'
|
||||||
|
2024-07-09 14:40:33,019 - grpc._server - ERROR - Exception calling application: runAction() missing 1 required positional argument: 'mqttClient'
|
||||||
|
Traceback (most recent call last):
|
||||||
|
File "/etc/sdt/venv/inference-app-env/lib/python3.11/site-packages/grpc/_server.py", line 494, in _call_behavior
|
||||||
|
response_or_iterator = behavior(argument, context)
|
||||||
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 142, in UploadImage
|
||||||
|
runAction(request.filename, pred)
|
||||||
|
TypeError: runAction() missing 1 required positional argument: 'mqttClient'
|
||||||
|
2024-07-09 14:40:35,817 - grpc._server - ERROR - Exception calling application: runAction() missing 1 required positional argument: 'mqttClient'
|
||||||
|
Traceback (most recent call last):
|
||||||
|
File "/etc/sdt/venv/inference-app-env/lib/python3.11/site-packages/grpc/_server.py", line 494, in _call_behavior
|
||||||
|
response_or_iterator = behavior(argument, context)
|
||||||
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||||
|
File "/home/sdt/Workspace/app_store_mlapp/inference-app/1.0.1/main.py", line 142, in UploadImage
|
||||||
|
runAction(request.filename, pred)
|
||||||
|
TypeError: runAction() missing 1 required positional argument: 'mqttClient'
|
||||||
|
2024-12-02 20:02:33,749 - root - INFO - DEVICE: cuda:0
|
||||||
|
2024-12-02 20:03:05,621 - root - INFO - DEVICE: cuda:0
|
||||||
|
2024-12-02 20:03:09,049 - root - INFO - 2024-12-02 20:03:08: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 자갈
|
||||||
|
2024-12-02 20:03:22,873 - root - INFO - 2024-12-02 20:03:22: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 자갈
|
||||||
|
2024-12-02 20:03:52,855 - root - INFO - DEVICE: cuda:0
|
||||||
|
2024-12-02 20:03:56,205 - root - INFO - 2024-12-02 20:03:56: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 자갈
|
||||||
|
2024-12-02 20:04:09,480 - root - INFO - DEVICE: cuda:0
|
||||||
|
2024-12-02 20:04:12,045 - root - INFO - 2024-12-02 20:04:11: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:18,297 - root - INFO - 2024-12-02 20:04:18: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:18,429 - root - INFO - 2024-12-02 20:04:18: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:18,574 - root - INFO - 2024-12-02 20:04:18: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:18,729 - root - INFO - 2024-12-02 20:04:18: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:18,878 - root - INFO - 2024-12-02 20:04:18: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:19,039 - root - INFO - 2024-12-02 20:04:19: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:19,155 - root - INFO - 2024-12-02 20:04:19: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:19,284 - root - INFO - 2024-12-02 20:04:19: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:19,446 - root - INFO - 2024-12-02 20:04:19: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:19,579 - root - INFO - 2024-12-02 20:04:19: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:19,733 - root - INFO - 2024-12-02 20:04:19: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:19,884 - root - INFO - 2024-12-02 20:04:19: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:20,031 - root - INFO - 2024-12-02 20:04:19: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:20,160 - root - INFO - 2024-12-02 20:04:20: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:20,302 - root - INFO - 2024-12-02 20:04:20: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-02 20:04:20,447 - root - INFO - 2024-12-02 20:04:20: filename = /home/sdt-dev1/Workspace/kimdy/request-app/data/test_1.jpg, predicted class = 모래
|
||||||
|
2024-12-03 09:39:36,395 - root - INFO - DEVICE: cuda:0
|
||||||
|
2024-12-03 10:01:28,013 - root - INFO - DEVICE: cuda:0
|
||||||
|
2024-12-03 10:01:48,534 - root - INFO - DEVICE: cuda:0
|
||||||
|
2024-12-03 10:02:40,259 - grpc._server - ERROR - Exception calling application: name 'runAction' is not defined
|
||||||
|
Traceback (most recent call last):
|
||||||
|
File "/etc/sdt/venv/inference-app-env/lib/python3.11/site-packages/grpc/_server.py", line 494, in _call_behavior
|
||||||
|
response_or_iterator = behavior(argument, context)
|
||||||
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||||
|
File "/home/sdt-dev1/Workspace/kimdy/inference-app/main.py", line 122, in UploadImage
|
||||||
|
runAction(request.filename, pred)
|
||||||
|
^^^^^^^^^
|
||||||
|
NameError: name 'runAction' is not defined
|
||||||
|
2024-12-03 10:04:13,292 - root - INFO - DEVICE: cuda:0
|
||||||
|
2024-12-03 10:05:07,064 - root - INFO - 2024-12-03 10:05:06: filename = ./data/test_1.jpg, predicted class = 자갈
|
||||||
|
2024-12-03 10:06:08,233 - root - INFO - 2024-12-03 10:06:08: filename = ./data/test_1.jpg, predicted class = 자갈
|
||||||
|
|
@ -0,0 +1,141 @@
|
||||||
|
import grpc
|
||||||
|
from concurrent import futures
|
||||||
|
import utils.image_pb2 as pb2
|
||||||
|
import utils.image_pb2_grpc as pb2_grpc
|
||||||
|
from PIL import Image
|
||||||
|
import io
|
||||||
|
import datetime
|
||||||
|
from botocore.client import Config
|
||||||
|
import traceback
|
||||||
|
import logging
|
||||||
|
import logging.handlers
|
||||||
|
import boto3
|
||||||
|
import json
|
||||||
|
import timm
|
||||||
|
import os
|
||||||
|
import uuid
|
||||||
|
import random
|
||||||
|
|
||||||
|
import torch
|
||||||
|
from torchvision import models, transforms
|
||||||
|
|
||||||
|
|
||||||
|
###############################################
|
||||||
|
# Config #
|
||||||
|
###############################################
|
||||||
|
with open('./config.json','r') as f:
|
||||||
|
cfg = json.load(f)
|
||||||
|
|
||||||
|
SEED = cfg['model']['seed']
|
||||||
|
MODEL_NAME = cfg['model']['name']
|
||||||
|
NUM_CLASSES = cfg['model']['num_classes']
|
||||||
|
DEVICE_CFG = cfg['model']['device']
|
||||||
|
DEVICE = DEVICE_CFG if torch.cuda.is_available() else "cpu"
|
||||||
|
MODEL_CKPT = cfg['model']['ckpt_path']
|
||||||
|
MODEL_FILE_NAME = MODEL_CKPT.split('/')[-1]
|
||||||
|
CATEGORIES = {0: '모래',
|
||||||
|
1: '자갈',
|
||||||
|
2: '덮개',
|
||||||
|
3: '빈차',
|
||||||
|
4: '레미콘',
|
||||||
|
5: '차량없음'}
|
||||||
|
|
||||||
|
# bwc에서 모델 업로드/다운로드 가능해지면 사용 안할 예정
|
||||||
|
MINIO_BUCKET = cfg['minio_bucket']
|
||||||
|
MINIO_URL = cfg['minio_url']
|
||||||
|
MINIO_ACC_KEY = cfg['minio_access_key']
|
||||||
|
MINIO_SCR_KEY = cfg['minio_secret_key']
|
||||||
|
MINIO_REGION = cfg['minio_region_name']
|
||||||
|
|
||||||
|
###############################################
|
||||||
|
# Logger Setting #
|
||||||
|
###############################################
|
||||||
|
logger = logging.getLogger()
|
||||||
|
logger.setLevel(logging.INFO)
|
||||||
|
formatter = logging.Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s')
|
||||||
|
|
||||||
|
log_fileHandler = logging.handlers.RotatingFileHandler(
|
||||||
|
filename="./logs/log_inference.log",
|
||||||
|
maxBytes=1024000,
|
||||||
|
backupCount=3,
|
||||||
|
mode='a')
|
||||||
|
|
||||||
|
log_fileHandler.setFormatter(formatter)
|
||||||
|
logger.addHandler(log_fileHandler)
|
||||||
|
|
||||||
|
###############################################
|
||||||
|
# Model download #
|
||||||
|
###############################################
|
||||||
|
|
||||||
|
#model_storage = boto3.client('s3',
|
||||||
|
# endpoint_url=MINIO_URL,
|
||||||
|
# aws_access_key_id=MINIO_ACC_KEY,
|
||||||
|
# aws_secret_access_key=MINIO_SCR_KEY,
|
||||||
|
# config=Config(signature_version='s3v4'),
|
||||||
|
# region_name=MINIO_REGION)
|
||||||
|
#
|
||||||
|
## minio에서 model ckpt 파일 다운로드
|
||||||
|
#if not os.path.isfile(MODEL_CKPT):
|
||||||
|
# model_storage.download_file(MINIO_BUCKET,f'{MODEL_NAME}/{MODEL_FILE_NAME}', MODEL_CKPT)
|
||||||
|
# print('Model is downloaded')
|
||||||
|
|
||||||
|
###############################################
|
||||||
|
# Model Class #
|
||||||
|
###############################################
|
||||||
|
|
||||||
|
class Model:
|
||||||
|
def __init__(self, ckpt_path, num_classes, device):
|
||||||
|
logger.info(f"DEVICE: {device}")
|
||||||
|
self.model = timm.create_model(MODEL_NAME, pretrained=False, num_classes=num_classes).to(device)
|
||||||
|
self.model.load_state_dict(torch.load(ckpt_path, map_location=device))
|
||||||
|
self.device = device
|
||||||
|
self.transform = transforms.Compose([transforms.Resize((384, 384)),
|
||||||
|
transforms.ToTensor()])
|
||||||
|
|
||||||
|
def inference(self, image):
|
||||||
|
t_image = self.transform(image).unsqueeze(0)
|
||||||
|
|
||||||
|
with torch.no_grad():
|
||||||
|
self.model.eval()
|
||||||
|
|
||||||
|
inputs = t_image.to(self.device)
|
||||||
|
outputs = self.model(inputs)
|
||||||
|
|
||||||
|
preds = torch.argmax(outputs, dim=-1)
|
||||||
|
|
||||||
|
return preds.item()
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
class Inference_Agent(pb2_grpc.ImageServiceServicer):
|
||||||
|
def __init__(self, model):
|
||||||
|
self.model = model
|
||||||
|
|
||||||
|
def UploadImage(self, request, context):
|
||||||
|
image = Image.open(io.BytesIO(request.image_data)).convert("RGB")
|
||||||
|
now = datetime.datetime.now()
|
||||||
|
formatted_now = now.strftime("%Y-%m-%d %H:%M:%S")
|
||||||
|
|
||||||
|
with torch.no_grad():
|
||||||
|
pred = model.inference(image)
|
||||||
|
#runAction(request.filename, pred)
|
||||||
|
logger.info(f'{formatted_now}: filename = {request.filename}, predicted class = {CATEGORIES[pred]}')
|
||||||
|
print(f'{formatted_now}: filename = {request.filename}, predicted class = {CATEGORIES[pred]}')
|
||||||
|
|
||||||
|
result = f"Predicted class = {CATEGORIES[pred]}"
|
||||||
|
return pb2.ImageResponse(message="Image Result", inference_result = result)
|
||||||
|
|
||||||
|
def serve(model):
|
||||||
|
server = grpc.server(futures.ThreadPoolExecutor(max_workers=4))
|
||||||
|
pb2_grpc.add_ImageServiceServicer_to_server(Inference_Agent(model), server)
|
||||||
|
server.add_insecure_port('[::]:50051')
|
||||||
|
server.start()
|
||||||
|
print('Waitting for client...')
|
||||||
|
server.wait_for_termination()
|
||||||
|
|
||||||
|
|
||||||
|
if __name__ == "__main__":
|
||||||
|
model = Model(MODEL_CKPT,NUM_CLASSES, DEVICE)
|
||||||
|
print('Model is loaded')
|
||||||
|
serve(model)
|
||||||
|
|
@ -0,0 +1,16 @@
|
||||||
|
# Write package's name that need your app.
|
||||||
|
awscrt
|
||||||
|
awsiotsdk
|
||||||
|
grpcio==1.56.2
|
||||||
|
protobuf==4.25.0
|
||||||
|
Pillow==10.2.0
|
||||||
|
boto3
|
||||||
|
botocore
|
||||||
|
timm
|
||||||
|
numpy==1.24.4
|
||||||
|
pandas==2.0.3
|
||||||
|
opencv-python
|
||||||
|
torch==2.4.0 --index-url https://download.pytorch.org/whl/cu124
|
||||||
|
torchvision==0.19.0 --index-url https://download.pytorch.org/whl/cu124
|
||||||
|
torchaudio==2.4.0 --index-url https://download.pytorch.org/whl/cu124
|
||||||
|
pyyaml
|
||||||
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
|
|
@ -0,0 +1,18 @@
|
||||||
|
syntax = "proto3";
|
||||||
|
|
||||||
|
package image;
|
||||||
|
|
||||||
|
service ImageService {
|
||||||
|
rpc UploadImage (ImageRequest) returns (ImageResponse);
|
||||||
|
}
|
||||||
|
|
||||||
|
message ImageRequest{
|
||||||
|
string filename =1;
|
||||||
|
bytes image_data = 2;
|
||||||
|
}
|
||||||
|
|
||||||
|
message ImageResponse {
|
||||||
|
string message = 1;
|
||||||
|
string inference_result = 2;
|
||||||
|
}
|
||||||
|
|
||||||
|
|
@ -0,0 +1,30 @@
|
||||||
|
# -*- coding: utf-8 -*-
|
||||||
|
# Generated by the protocol buffer compiler. DO NOT EDIT!
|
||||||
|
# source: image.proto
|
||||||
|
# Protobuf Python Version: 4.25.0
|
||||||
|
"""Generated protocol buffer code."""
|
||||||
|
from google.protobuf import descriptor as _descriptor
|
||||||
|
from google.protobuf import descriptor_pool as _descriptor_pool
|
||||||
|
from google.protobuf import symbol_database as _symbol_database
|
||||||
|
from google.protobuf.internal import builder as _builder
|
||||||
|
# @@protoc_insertion_point(imports)
|
||||||
|
|
||||||
|
_sym_db = _symbol_database.Default()
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
DESCRIPTOR = _descriptor_pool.Default().AddSerializedFile(b'\n\x0bimage.proto\x12\x05image\"4\n\x0cImageRequest\x12\x10\n\x08\x66ilename\x18\x01 \x01(\t\x12\x12\n\nimage_data\x18\x02 \x01(\x0c\":\n\rImageResponse\x12\x0f\n\x07message\x18\x01 \x01(\t\x12\x18\n\x10inference_result\x18\x02 \x01(\t2H\n\x0cImageService\x12\x38\n\x0bUploadImage\x12\x13.image.ImageRequest\x1a\x14.image.ImageResponseb\x06proto3')
|
||||||
|
|
||||||
|
_globals = globals()
|
||||||
|
_builder.BuildMessageAndEnumDescriptors(DESCRIPTOR, _globals)
|
||||||
|
_builder.BuildTopDescriptorsAndMessages(DESCRIPTOR, 'image_pb2', _globals)
|
||||||
|
if _descriptor._USE_C_DESCRIPTORS == False:
|
||||||
|
DESCRIPTOR._options = None
|
||||||
|
_globals['_IMAGEREQUEST']._serialized_start=22
|
||||||
|
_globals['_IMAGEREQUEST']._serialized_end=74
|
||||||
|
_globals['_IMAGERESPONSE']._serialized_start=76
|
||||||
|
_globals['_IMAGERESPONSE']._serialized_end=134
|
||||||
|
_globals['_IMAGESERVICE']._serialized_start=136
|
||||||
|
_globals['_IMAGESERVICE']._serialized_end=208
|
||||||
|
# @@protoc_insertion_point(module_scope)
|
||||||
|
|
@ -0,0 +1,66 @@
|
||||||
|
# Generated by the gRPC Python protocol compiler plugin. DO NOT EDIT!
|
||||||
|
"""Client and server classes corresponding to protobuf-defined services."""
|
||||||
|
import grpc
|
||||||
|
|
||||||
|
import utils.image_pb2 as image__pb2
|
||||||
|
|
||||||
|
|
||||||
|
class ImageServiceStub(object):
|
||||||
|
"""Missing associated documentation comment in .proto file."""
|
||||||
|
|
||||||
|
def __init__(self, channel):
|
||||||
|
"""Constructor.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
channel: A grpc.Channel.
|
||||||
|
"""
|
||||||
|
self.UploadImage = channel.unary_unary(
|
||||||
|
'/image.ImageService/UploadImage',
|
||||||
|
request_serializer=image__pb2.ImageRequest.SerializeToString,
|
||||||
|
response_deserializer=image__pb2.ImageResponse.FromString,
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
class ImageServiceServicer(object):
|
||||||
|
"""Missing associated documentation comment in .proto file."""
|
||||||
|
|
||||||
|
def UploadImage(self, request, context):
|
||||||
|
"""Missing associated documentation comment in .proto file."""
|
||||||
|
context.set_code(grpc.StatusCode.UNIMPLEMENTED)
|
||||||
|
context.set_details('Method not implemented!')
|
||||||
|
raise NotImplementedError('Method not implemented!')
|
||||||
|
|
||||||
|
|
||||||
|
def add_ImageServiceServicer_to_server(servicer, server):
|
||||||
|
rpc_method_handlers = {
|
||||||
|
'UploadImage': grpc.unary_unary_rpc_method_handler(
|
||||||
|
servicer.UploadImage,
|
||||||
|
request_deserializer=image__pb2.ImageRequest.FromString,
|
||||||
|
response_serializer=image__pb2.ImageResponse.SerializeToString,
|
||||||
|
),
|
||||||
|
}
|
||||||
|
generic_handler = grpc.method_handlers_generic_handler(
|
||||||
|
'image.ImageService', rpc_method_handlers)
|
||||||
|
server.add_generic_rpc_handlers((generic_handler,))
|
||||||
|
|
||||||
|
|
||||||
|
# This class is part of an EXPERIMENTAL API.
|
||||||
|
class ImageService(object):
|
||||||
|
"""Missing associated documentation comment in .proto file."""
|
||||||
|
|
||||||
|
@staticmethod
|
||||||
|
def UploadImage(request,
|
||||||
|
target,
|
||||||
|
options=(),
|
||||||
|
channel_credentials=None,
|
||||||
|
call_credentials=None,
|
||||||
|
insecure=False,
|
||||||
|
compression=None,
|
||||||
|
wait_for_ready=None,
|
||||||
|
timeout=None,
|
||||||
|
metadata=None):
|
||||||
|
return grpc.experimental.unary_unary(request, target, '/image.ImageService/UploadImage',
|
||||||
|
image__pb2.ImageRequest.SerializeToString,
|
||||||
|
image__pb2.ImageResponse.FromString,
|
||||||
|
options, channel_credentials,
|
||||||
|
insecure, call_credentials, compression, wait_for_ready, timeout, metadata)
|
||||||
Loading…
Reference in New Issue