2024-10-04 14:31:22 +02:00
|
|
|
# USD
|
|
|
|
|
|
2024-10-27 20:21:37 +01:00
|
|
|
## Task:
|
|
|
|
|
Zapoznaj się z [MetaDrive](https://github.com/metadriverse/metadrive/). Wytrenuj co najmniej dwóch różnych agentów
|
|
|
|
|
wykorzystując algorytmy **wieloagentowe** (MA), na co
|
|
|
|
|
najmniej trzech różnych mapach. Omów otrzymane wyniki oraz zwizualizuj działanie
|
|
|
|
|
wytrenowanych agentów.
|
|
|
|
|
|
2024-10-27 21:14:26 +01:00
|
|
|
|
2025-01-25 17:57:51 +01:00
|
|
|
## Setup
|
2024-10-27 21:14:26 +01:00
|
|
|
```
|
2025-01-25 17:57:51 +01:00
|
|
|
conda create -n copo python=3.7
|
|
|
|
|
conda activate copo
|
|
|
|
|
|
|
|
|
|
# Install MetaDrive version 0.2.5
|
|
|
|
|
pip install git+https://github.com/metadriverse/metadrive.git@releases/0.2.5
|
|
|
|
|
|
|
|
|
|
pip install torch
|
|
|
|
|
|
|
|
|
|
git clone https://github.com/decisionforce/CoPO
|
|
|
|
|
cd CoPO/copo_code
|
|
|
|
|
pip install -e .
|
|
|
|
|
|
|
|
|
|
pip install -U ray==1.2.0 "ray[rllib]==1.2.0"
|
2025-01-25 18:55:58 +01:00
|
|
|
pip install -U "numpy<1.19.0"
|
2025-01-25 17:57:51 +01:00
|
|
|
pip uninstall opencv-python
|
|
|
|
|
pip uninstall opencv-python-headless
|
|
|
|
|
pip install opencv-python==4.5.5.64
|
|
|
|
|
pip install pydantic==1.9.0
|
2024-10-27 21:14:26 +01:00
|
|
|
```
|
|
|
|
|
|
2025-01-25 17:57:51 +01:00
|
|
|
## How to train a RL agents
|
2024-10-27 21:14:26 +01:00
|
|
|
|
2025-01-25 18:31:39 +01:00
|
|
|
```
|
|
|
|
|
cd CoPo/copo_code/copo/
|
|
|
|
|
python train_all_cl.py --exp-name my_cl
|
|
|
|
|
```
|
|
|
|
|
Training process 4.7h
|
|
|
|
|
```
|
|
|
|
|
python train_all_ippo.py --exp-name my_ippo
|
|
|
|
|
```
|
|
|
|
|
Training process 7.3h
|
2025-01-25 18:34:45 +01:00
|
|
|
|
2025-01-25 18:43:24 +01:00
|
|
|
## How to evaluate
|
2025-01-25 18:34:45 +01:00
|
|
|
```
|
|
|
|
|
python eval.py --root my_cl
|
|
|
|
|
python eval.py --root my_ippo
|
|
|
|
|
```
|