이승준
Seungjun Lee
henry174 at ajou.ac.kr
After graduation
SK Planet
Publications
2023
11.
Lee, Seungjun; Yu, Miri; Yoon, Daegun; Oh, Sangyoon
Can hierarchical client clustering mitigate the data heterogeneity effect in federated learning?🌏 InternationalConference
2023 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), 2023, ISBN: 979-8-3503-1200-3.
@conference{nokey,
title = {Can hierarchical client clustering mitigate the data heterogeneity effect in federated learning?},
author = {Seungjun Lee and Miri Yu and Daegun Yoon and Sangyoon Oh},
url = {10.1109/IPDPSW59300.2023.00134},
doi = {10.1109/IPDPSW59300.2023.00134},
isbn = {979-8-3503-1200-3},
year = {2023},
date = {2023-05-15},
urldate = {2023-05-15},
booktitle = {2023 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)},
abstract = {Federated learning (FL) was proposed for training a deep neural network model using millions of user data. The technique has attracted considerable attention owing to its privacy-preserving characteristic. However, two major challenges exist. The first is the limitation of simultaneously participating clients. If the number of clients increases, the single parameter server easily becomes a bottleneck and is prone to have stragglers. The second is data heterogeneity, which adversely affects the accuracy of the global model. Because data should remain at user devices to preserve privacy, we cannot use data shuffling, which is used to homogenize training data in traditional distributed deep learning. We propose a client clustering and model aggregation method, CCFed, to increase the number of simultaneously participating clients and mitigate the data heterogeneity problem. CCFed improves the learning performance using set partition modeling to let data be evenly distributed between clusters and mitigate the effect of a non-IID environment. Experiments show that we can achieve a 2.7-14% higher accuracy using CCFed compared with FedAvg, where CCFed requires approximately 50% less number of rounds compared with FedAvg training on benchmark datasets.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
Federated learning (FL) was proposed for training a deep neural network model using millions of user data. The technique has attracted considerable attention owing to its privacy-preserving characteristic. However, two major challenges exist. The first is the limitation of simultaneously participating clients. If the number of clients increases, the single parameter server easily becomes a bottleneck and is prone to have stragglers. The second is data heterogeneity, which adversely affects the accuracy of the global model. Because data should remain at user devices to preserve privacy, we cannot use data shuffling, which is used to homogenize training data in traditional distributed deep learning. We propose a client clustering and model aggregation method, CCFed, to increase the number of simultaneously participating clients and mitigate the data heterogeneity problem. CCFed improves the learning performance using set partition modeling to let data be evenly distributed between clusters and mitigate the effect of a non-IID environment. Experiments show that we can achieve a 2.7-14% higher accuracy using CCFed compared with FedAvg, where CCFed requires approximately 50% less number of rounds compared with FedAvg training on benchmark datasets.
2022
10.
Lee, Seungjun; Jeong, Minjoong; Oh, Sangyoon
Is Ant Colony System better than FFD for VM placement in a heterogeneous cluster?🌏 InternationalConference
2022 IEEE International Conference on Cloud Engineering (IC2E), 2022, ISBN: 978-1-6654-9116-7.
@conference{Seungjun2022Ant,
title = {Is Ant Colony System better than FFD for VM placement in a heterogeneous cluster?},
author = {Seungjun Lee and Minjoong Jeong and Sangyoon Oh},
url = {https://ieeexplore.ieee.org/document/9946320},
doi = {10.1109/IC2E55432.2022.00038},
isbn = {978-1-6654-9116-7},
year = {2022},
date = {2022-09-22},
urldate = {2022-06-11},
booktitle = {2022 IEEE International Conference on Cloud Engineering (IC2E)},
pages = {277-278},
abstract = {First fit decreasing (FFD) is the most popular heuristic for virtual machine (VM) placement problems. However, FFD does not perform well in a heterogeneous cluster environment in which physical machines have different capacities. Moreover, FFD and other heuristics, such as best fit decreasing (BFD), do not effectively handle the VM placement problem if multiple resources are considered together. In this study, we analyze the reason why the ant colony system performs better than FFD for VM placement in a heterogeneous cluster. We verified our logical observations through experimental comparisons with other heuristics.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
First fit decreasing (FFD) is the most popular heuristic for virtual machine (VM) placement problems. However, FFD does not perform well in a heterogeneous cluster environment in which physical machines have different capacities. Moreover, FFD and other heuristics, such as best fit decreasing (BFD), do not effectively handle the VM placement problem if multiple resources are considered together. In this study, we analyze the reason why the ant colony system performs better than FFD for VM placement in a heterogeneous cluster. We verified our logical observations through experimental comparisons with other heuristics.
9.
이승준,; 윤대건,; 오상윤,
SDN 정책엔진의 사용자 모듈을 위한 분석 요청 정의 언어🇰🇷 DomesticJournal Article
In: 한국통신학회 논문지, vol. 47, no. 9, pp. 1360-1369, 2022.
@article{이승준2022SDN,
title = {SDN 정책엔진의 사용자 모듈을 위한 분석 요청 정의 언어},
author = {이승준 and 윤대건 and 오상윤},
url = {https://www.kci.go.kr/kciportal/ci/sereArticleSearch/ciSereArtiView.kci?sereArticleSearchBean.artiId=ART002877194},
year = {2022},
date = {2022-09-01},
urldate = {2022-09-01},
journal = {한국통신학회 논문지},
volume = {47},
number = {9},
pages = {1360-1369},
abstract = {현대전에서 작전 수행은 네트워크 중심전의 양상을 띄고 있으며, 이에 따라 군 전술망 자원을 효과적으로 사용하기 위한 여러 연구가 진행되고 있다. 단일 연구 결과가 아닌 여러 연구의 결과를 복합적으로 적용했을 때의 효과를 분석하기 위한 노력의 일환으로 통합 테스트베드가 구축되고, 여기에서 여러 네트워크 알고리즘을 동시에 수행하고 성능을 분석하기 위한 정책 엔진도 설계되었다. 하지만 이종 네트워크 환경에서는 사용자들이 요구하는 서른 다른 데이터 구조의 성능 지표와 이를 처리할 각 알고리즘의 서로 다른 실행 환경에 적응적으로 대응하기 어려운 문제가 있었다. 이에 본 연구에서는 프로그래밍 언어와 실행 환경 등 특정 기술에 종속되지 않는 정책 엔진을 위한 XML 기반의 인터페이스 포맷을 정의하고 그 스키마를 제안한다. 제안된 스키마를 사용하여 메시지는 특정 프로그래밍 언어에 종속되지 않고 인코딩과 디코딩을 할 수 있으며 Open Container Initiative 표준을 기반으로실행 환경을 정의하는 컨테이너를 기술할 수 있다.
In modern warfare environment, the well defined networks becomes important to the operations. Thus, researchers study on how to use the military tactical network resources effectively. To analyze effectiveness of the results from multiple studies together, an integrated testbed is critical as well as the design and the implementation of a policy engine that performs multiple network algorithms and analyze performance simultaneously. However, when the network environment is heterogeneous, it is hard to respond adaptively to the performance indicators of the different data structures and the different execution environments of each user algorithm. To address this issue, we propose an XML-based interface format and its schema for the policy engine, which is independent from specific technologies such as programming languages and execution environments. A message from and to the policy engine and the testbed can be encoded and decoded regardless of the programming language. Furthermore, it can describe containers of the execution environment based on the Open Container Initiative standard.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
현대전에서 작전 수행은 네트워크 중심전의 양상을 띄고 있으며, 이에 따라 군 전술망 자원을 효과적으로 사용하기 위한 여러 연구가 진행되고 있다. 단일 연구 결과가 아닌 여러 연구의 결과를 복합적으로 적용했을 때의 효과를 분석하기 위한 노력의 일환으로 통합 테스트베드가 구축되고, 여기에서 여러 네트워크 알고리즘을 동시에 수행하고 성능을 분석하기 위한 정책 엔진도 설계되었다. 하지만 이종 네트워크 환경에서는 사용자들이 요구하는 서른 다른 데이터 구조의 성능 지표와 이를 처리할 각 알고리즘의 서로 다른 실행 환경에 적응적으로 대응하기 어려운 문제가 있었다. 이에 본 연구에서는 프로그래밍 언어와 실행 환경 등 특정 기술에 종속되지 않는 정책 엔진을 위한 XML 기반의 인터페이스 포맷을 정의하고 그 스키마를 제안한다. 제안된 스키마를 사용하여 메시지는 특정 프로그래밍 언어에 종속되지 않고 인코딩과 디코딩을 할 수 있으며 Open Container Initiative 표준을 기반으로실행 환경을 정의하는 컨테이너를 기술할 수 있다.
In modern warfare environment, the well defined networks becomes important to the operations. Thus, researchers study on how to use the military tactical network resources effectively. To analyze effectiveness of the results from multiple studies together, an integrated testbed is critical as well as the design and the implementation of a policy engine that performs multiple network algorithms and analyze performance simultaneously. However, when the network environment is heterogeneous, it is hard to respond adaptively to the performance indicators of the different data structures and the different execution environments of each user algorithm. To address this issue, we propose an XML-based interface format and its schema for the policy engine, which is independent from specific technologies such as programming languages and execution environments. A message from and to the policy engine and the testbed can be encoded and decoded regardless of the programming language. Furthermore, it can describe containers of the execution environment based on the Open Container Initiative standard.
In modern warfare environment, the well defined networks becomes important to the operations. Thus, researchers study on how to use the military tactical network resources effectively. To analyze effectiveness of the results from multiple studies together, an integrated testbed is critical as well as the design and the implementation of a policy engine that performs multiple network algorithms and analyze performance simultaneously. However, when the network environment is heterogeneous, it is hard to respond adaptively to the performance indicators of the different data structures and the different execution environments of each user algorithm. To address this issue, we propose an XML-based interface format and its schema for the policy engine, which is independent from specific technologies such as programming languages and execution environments. A message from and to the policy engine and the testbed can be encoded and decoded regardless of the programming language. Furthermore, it can describe containers of the execution environment based on the Open Container Initiative standard.
8.
정현석,; 유미리,; 윤대건,; 이승준,; 오상윤,
재난 대응 기계학습 모델의 Data Drift 문제에 대한 MLOps 기반 대응 기법🇰🇷 DomesticConference
2022 한국차세대컴퓨팅학회 춘계학술대회, 한국차세대컴퓨팅학회, 2022.
@conference{정현석2022재난,
title = {재난 대응 기계학습 모델의 Data Drift 문제에 대한 MLOps 기반 대응 기법},
author = {정현석 and 유미리 and 윤대건 and 이승준 and 오상윤},
url = {https://www.earticle.net/Article/A412404},
year = {2022},
date = {2022-05-21},
urldate = {2022-05-21},
booktitle = {2022 한국차세대컴퓨팅학회 춘계학술대회},
pages = {pp.473-476},
publisher = {한국차세대컴퓨팅학회},
abstract = {기계학습에서 Data Drift는 정확도에 큰 영향을 주는 중요한 문제이며, 재난 대응과 같이 모델의 잘못된 예측 피해가 큰 분야에서 더 중요하다. 본 논문에서는 재난 분야 Data Drift 문제에 대해 MLOps를 이용하여 모델의 재학습을 효과적으로 수행할 수 있는 방안으로 MLOps 기법과 툴들을 사용하는 것을 제안하고, Kaggle 데이터와 MLFlow를 기반으로 정확도 실험을 수행하여 주장을 검증하였다.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
기계학습에서 Data Drift는 정확도에 큰 영향을 주는 중요한 문제이며, 재난 대응과 같이 모델의 잘못된 예측 피해가 큰 분야에서 더 중요하다. 본 논문에서는 재난 분야 Data Drift 문제에 대해 MLOps를 이용하여 모델의 재학습을 효과적으로 수행할 수 있는 방안으로 MLOps 기법과 툴들을 사용하는 것을 제안하고, Kaggle 데이터와 MLFlow를 기반으로 정확도 실험을 수행하여 주장을 검증하였다.
2021
7.
Lee, Seungjun; Yoon, Daegun; Yeo, Sangho; Oh, Sangyoon
Mitigating Cold Start Problem in Serverless Computing with Function Fusion🌏 InternationalJournal Article
In: Sensors, vol. 21, no. 24, 2021, ISSN: 1424-8220.
@article{s21248416,
title = {Mitigating Cold Start Problem in Serverless Computing with Function Fusion},
author = {Seungjun Lee and Daegun Yoon and Sangho Yeo and Sangyoon Oh},
url = {https://www.mdpi.com/1424-8220/21/24/8416},
doi = {10.3390/s21248416},
issn = {1424-8220},
year = {2021},
date = {2021-12-23},
urldate = {2021-12-16},
journal = {Sensors},
volume = {21},
number = {24},
abstract = {As Artificial Intelligence (AI) is becoming ubiquitous in many applications, serverless computing is also emerging as a building block for developing cloud-based AI services. Serverless computing has received much interest because of its simplicity, scalability, and resource efficiency. However, due to the trade-off with resource efficiency, serverless computing suffers from the cold start problem, that is, a latency between a request arrival and function execution. The cold start problem significantly influences the overall response time of workflow that consists of functions because the cold start may occur in every function within the workflow. Function fusion can be one of the solutions to mitigate the cold start latency of a workflow. If two functions are fused into a single function, the cold start of the second function is removed; however, if parallel functions are fused, the workflow response time can be increased because the parallel functions run sequentially even if the cold start latency is reduced. This study presents an approach to mitigate the cold start latency of a workflow using function fusion while considering a parallel run. First, we identify three latencies that affect response time, present a workflow response time model considering the latency, and efficiently find a fusion solution that can optimize the response time on the cold start. Our method shows a response time of 28%–86% of the response time of the original workflow in five workflows.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
As Artificial Intelligence (AI) is becoming ubiquitous in many applications, serverless computing is also emerging as a building block for developing cloud-based AI services. Serverless computing has received much interest because of its simplicity, scalability, and resource efficiency. However, due to the trade-off with resource efficiency, serverless computing suffers from the cold start problem, that is, a latency between a request arrival and function execution. The cold start problem significantly influences the overall response time of workflow that consists of functions because the cold start may occur in every function within the workflow. Function fusion can be one of the solutions to mitigate the cold start latency of a workflow. If two functions are fused into a single function, the cold start of the second function is removed; however, if parallel functions are fused, the workflow response time can be increased because the parallel functions run sequentially even if the cold start latency is reduced. This study presents an approach to mitigate the cold start latency of a workflow using function fusion while considering a parallel run. First, we identify three latencies that affect response time, present a workflow response time model considering the latency, and efficiently find a fusion solution that can optimize the response time on the cold start. Our method shows a response time of 28%–86% of the response time of the original workflow in five workflows.
6.
Yu, Miri; Lee, Seungjun; Oh, Sangyoon
Energy-aware container migration scheme in edge computing for fault-tolerant fire-disaster response system🌏 InternationalConference 📃 In press
The 7th International Conference on Next Generation Computing 2021, 2021.
@conference{Yu2021container,
title = {Energy-aware container migration scheme in edge computing for fault-tolerant fire-disaster response system},
author = {Miri Yu and Seungjun Lee and Sangyoon Oh},
year = {2021},
date = {2021-11-05},
urldate = {2021-11-05},
booktitle = {The 7th International Conference on Next Generation Computing 2021},
abstract = {In light of the recent advancements made in IT, many researchers are studying and exploring ways to minimize damage from fire disasters using artificial intelligence and cloud technology. With the introduction of edge computing, fire-disaster response software systems have made significant progress. However, existing studies often do not consider the response to a sudden power supply cut-off due to fire. In this study, we propose a container migration scheme based on the first-fit-decreasing algorithm of bin-packing problem and 0-1 knapsack algorithm to provide fault tolerance for containers running on edge servers that are powered off.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
In light of the recent advancements made in IT, many researchers are studying and exploring ways to minimize damage from fire disasters using artificial intelligence and cloud technology. With the introduction of edge computing, fire-disaster response software systems have made significant progress. However, existing studies often do not consider the response to a sudden power supply cut-off due to fire. In this study, we propose a container migration scheme based on the first-fit-decreasing algorithm of bin-packing problem and 0-1 knapsack algorithm to provide fault tolerance for containers running on edge servers that are powered off.
5.
Lee, Seungjun; Yoon, Daegun; Oh, Sangyoon
Imitation learning for VM placement problem using demonstration data generated by heuristics🌏 InternationalConference 📃 In press
17th Int. Conference on Data Science (ICDATA’21), 2021.
@conference{lee2021imitation,
title = {Imitation learning for VM placement problem using demonstration data generated by heuristics},
author = {Seungjun Lee and Daegun Yoon and Sangyoon Oh},
url = {https://youtu.be/CmG3E1rWroQ},
year = {2021},
date = {2021-07-26},
urldate = {2021-07-26},
booktitle = {17th Int. Conference on Data Science (ICDATA’21)},
abstract = {Data centers are key components of cloud computing to run virtual machines. For saving the cost to operate data centers, it is important to decide how to allocate each virtual machine to a certain physical machine. Because the virtual machine placement problem is NP-Hard, there are many heuristics to obtain near-optimal solutions as quickly as possible. The reinforcement learning technique can be applied for virtual machine placement problem. However, if the problem size gets bigger, the convergence speed of reinforcement learning gets slower. The possible solution is that the agent imitates the behavior of given demonstration, called imitation learning. In this paper, we propose a method combining reinforcement learning with imitation learning. In our proposed approach, demonstration data is generated by simple heuristics not human experts.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
Data centers are key components of cloud computing to run virtual machines. For saving the cost to operate data centers, it is important to decide how to allocate each virtual machine to a certain physical machine. Because the virtual machine placement problem is NP-Hard, there are many heuristics to obtain near-optimal solutions as quickly as possible. The reinforcement learning technique can be applied for virtual machine placement problem. However, if the problem size gets bigger, the convergence speed of reinforcement learning gets slower. The possible solution is that the agent imitates the behavior of given demonstration, called imitation learning. In this paper, we propose a method combining reinforcement learning with imitation learning. In our proposed approach, demonstration data is generated by simple heuristics not human experts.
4.
이승준,; 여상호,; 오상윤,
Edge AI의 추론 과정을 위한 계층적 작업 분할 배치 기법🇰🇷 DomesticConference
2021 한국차세대컴퓨팅학회 춘계학술대회, 한국차세대컴퓨팅학회, 2021.
@conference{이승준2021edge,
title = {Edge AI의 추론 과정을 위한 계층적 작업 분할 배치 기법},
author = {이승준 and 여상호 and 오상윤},
url = {https://www.earticle.net/Article/A409319},
year = {2021},
date = {2021-05-13},
urldate = {2021-05-13},
booktitle = {2021 한국차세대컴퓨팅학회 춘계학술대회},
pages = {26-29},
publisher = {한국차세대컴퓨팅학회},
abstract = {머신러닝 모델을 엣지 디바이스에 안정적으로 배포하기 위해서 기존 클라우드 기반의 머신 러닝 모델 배포는 높은 지연 시간으로 인해 머신 러닝 서비스의 질을 떨어트리는 문제를 야기한다. 또한, 추론을 위한 입력 데이터의 전송 과정은 개인 정보의 유출을 야기한다. 이러한 문제를 해결하기 위해서 개인 정보 유출 및 통신 부하 문제를 해결할 수 있는 엣지 서버 및 엣지 디바이스를 활용한 추론 과정의 정의가 요구된다. 본 연구팀은 효과적인 추론 과정의 정의를 위해 기존 분산 딥러닝의 모델 및 데이터 병렬화 파이프라인 기법에 기반하는 단일 추론 모델에 대한 엣지 서버-디바이스 간 모델 분할 기법 및 엣지에서 요청되는 독립된 다중 작업들에 대한 효과적인 스케쥴링 기법을 제안한다.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
머신러닝 모델을 엣지 디바이스에 안정적으로 배포하기 위해서 기존 클라우드 기반의 머신 러닝 모델 배포는 높은 지연 시간으로 인해 머신 러닝 서비스의 질을 떨어트리는 문제를 야기한다. 또한, 추론을 위한 입력 데이터의 전송 과정은 개인 정보의 유출을 야기한다. 이러한 문제를 해결하기 위해서 개인 정보 유출 및 통신 부하 문제를 해결할 수 있는 엣지 서버 및 엣지 디바이스를 활용한 추론 과정의 정의가 요구된다. 본 연구팀은 효과적인 추론 과정의 정의를 위해 기존 분산 딥러닝의 모델 및 데이터 병렬화 파이프라인 기법에 기반하는 단일 추론 모델에 대한 엣지 서버-디바이스 간 모델 분할 기법 및 엣지에서 요청되는 독립된 다중 작업들에 대한 효과적인 스케쥴링 기법을 제안한다.
3.
여상호,; 이승준,; 오상윤,
도시 재난 대응을 위한 Multi Objective 강화학습 모델 설계🇰🇷 DomesticConference
2021 한국차세대컴퓨팅학회 춘계학술대회, 한국차세대컴퓨팅학회, 2021.
@conference{여상호2021도시,
title = {도시 재난 대응을 위한 Multi Objective 강화학습 모델 설계},
author = {여상호 and 이승준 and 오상윤},
url = {https://www.earticle.net/Article/A409315},
year = {2021},
date = {2021-05-13},
urldate = {2021-05-13},
booktitle = {2021 한국차세대컴퓨팅학회 춘계학술대회},
pages = {11-15},
publisher = {한국차세대컴퓨팅학회},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
2.
여상호,; 이승준,; 오상윤,
학습 성능 향상을 위한 차원 축소 기법 기반 재난 시뮬레이션강화학습 환경 구성 및 활용🇰🇷 DomesticJournal Article
In: 정보처리학회논문지. 소프트웨어 및 데이터 공학, vol. 10, no. 7, pp. 263–270, 2021.
@article{여상호2021학습,
title = {학습 성능 향상을 위한 차원 축소 기법 기반 재난 시뮬레이션강화학습 환경 구성 및 활용},
author = {여상호 and 이승준 and 오상윤},
url = {https://kiss.kstudy.com/thesis/thesis-view.asp?key=3898295},
year = {2021},
date = {2021-01-01},
journal = {정보처리학회논문지. 소프트웨어 및 데이터 공학},
volume = {10},
number = {7},
pages = {263--270},
abstract = {
강화학습은 학습을 통해 최적의 행동정책을 탐색하는 기법으로써, 재난 상황에서 효과적인 인명 구조 및 재난 대응 문제 해결을 위해 많이 활용되고 있다. 그러나, 기존 재난 대응을 위한 강화학습 기법은 상대적으로 단순한 그리드, 그래프와 같은 환경 혹은 자체 개발한 강화학습 환경을 통해 평가를 수행함에 따라 그 실용성이 충분히 검증되지 않았다. 본 논문에서는 강화학습 기법을 실세계 환경에서 사용하기 위해 기존 개발된 재난 시뮬레이션 환경의 복잡한 프로퍼티를 활용하는 강화학습 환경 구성과 활용 결과를 제시하고자 한다. 본 제안 강화학습 환경의 구성을 위하여 재난 시뮬레이션과 강화학습 에이전트 간 강화학습 커뮤니케이션 채널 및 인터페이스를 구축하였으며, 시뮬레이션 환경이 제공하는 고차원의 프로퍼티 정보의 활용을 위해 비-이미지 피쳐 벡터(non-image feature vector)에 이미지 변환방식을 적용하였다. 실험을 통해 본 제안 방식이 건물 화재 피해도를 기준으로 한 평가에서 기존 방식 대비 가장 낮은 건물 화재 피해를 기록한 것을 확인하였다.
},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
강화학습은 학습을 통해 최적의 행동정책을 탐색하는 기법으로써, 재난 상황에서 효과적인 인명 구조 및 재난 대응 문제 해결을 위해 많이 활용되고 있다. 그러나, 기존 재난 대응을 위한 강화학습 기법은 상대적으로 단순한 그리드, 그래프와 같은 환경 혹은 자체 개발한 강화학습 환경을 통해 평가를 수행함에 따라 그 실용성이 충분히 검증되지 않았다. 본 논문에서는 강화학습 기법을 실세계 환경에서 사용하기 위해 기존 개발된 재난 시뮬레이션 환경의 복잡한 프로퍼티를 활용하는 강화학습 환경 구성과 활용 결과를 제시하고자 한다. 본 제안 강화학습 환경의 구성을 위하여 재난 시뮬레이션과 강화학습 에이전트 간 강화학습 커뮤니케이션 채널 및 인터페이스를 구축하였으며, 시뮬레이션 환경이 제공하는 고차원의 프로퍼티 정보의 활용을 위해 비-이미지 피쳐 벡터(non-image feature vector)에 이미지 변환방식을 적용하였다. 실험을 통해 본 제안 방식이 건물 화재 피해도를 기준으로 한 평가에서 기존 방식 대비 가장 낮은 건물 화재 피해를 기록한 것을 확인하였다.
2020
1.
Yeo, Sangho; Lee, Seungjun; Choi, Boreum; Oh, Sangyoon
Integrate multi-agent simulation environment and multi-agent reinforcement learning (MARL) for real-world scenario🌏 InternationalConference
2020 International Conference on Information and Communication Technology Convergence (ICTC), IEEE 2020.
@conference{yeo2020integrate,
title = {Integrate multi-agent simulation environment and multi-agent reinforcement learning (MARL) for real-world scenario},
author = {Sangho Yeo and Seungjun Lee and Boreum Choi and Sangyoon Oh},
url = {https://ieeexplore.ieee.org/abstract/document/9289369},
doi = {10.1109/ICTC49870.2020.9289369},
year = {2020},
date = {2020-01-01},
booktitle = {2020 International Conference on Information and Communication Technology Convergence (ICTC)},
pages = {523--525},
organization = {IEEE},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}