Skip to content

Commit

Permalink
Update the main code and reedme
Browse files Browse the repository at this point in the history
  • Loading branch information
Necolsy authored Nov 7, 2022
1 parent becd004 commit 607654b
Show file tree
Hide file tree
Showing 71 changed files with 8,066 additions and 1 deletion.
68 changes: 67 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1 +1,67 @@
# project-iris-dataset
## Infrared Image Dataset (IRIS) Preprocessing

This is a colloction of *infrared image dataset* **(IRIS)** preprocessing python code.

### Introduction

Infrared thermography provides non-contact technique to analyze the build environment in various aspects. While most of studies focus on a city and building scale, rooftop observatory provides high resolution with dynamical interactions on neighborhood scale. The first rooftop thermal observatory with a multi-modal platform capable of assessing a wide range of dynamical processes in urban systems was deployed in Singapore. The thermal observatory was placed on the top of a building that overlooks several educational buildings on the campus of the National University of Singapore. The platform collects remote sensing data from tropical areas on a temporal scale, allowing users to determine the temperature trend of individual features such as buildings, roads, and vegetation. To manage and analyze the obtained raw data and allow scientific users to utilize the data as they saw fit, demonstration code with data preprocessing such as segmentation was provided.

In this repository, we use several examples to show the process of data preprocessing, including *file convert*, *data visualization* and basic *data analysis*. We hope this can provide a basic idea to those who want to explor more on this dataset. If you have further contribution to this repository, welcome to [contact]([email protected]) us.

### Environment

- Softwares: `Python`, [`Labelme`](https://github.com/wkentaro/labelme);

- Python Packages: `numpy`, `pandas`, `flirextractor`, `matplotlib`, `PIL`;

### Structure

```
.
├── data/
│ ├── original/
│ │ ├── 2022-08-03
│ │ └── ...
│ ├── convert/
│ │ ├── snap-2022-08-03
│ │ └── ...
│ ├── processed/
│ │ ├── 2022-08-03
│ │ └── ...
│ └── README.md
├── notebook/
│ ├── 01_file_convert.ipynb
│ ├── 02_visualization.ipynb
│ └── 03_analysis.ipynb
├── src/
│ └── imageconvert.py
└── README.md
```

- `data`: all the original data and converted/processed data are here, for more details you may refer to the readme file under this folder `data/README.md`;
- `notebook`: three notebooks contain preprocess steps;
- `src`: runable preprocessing scripts are here;

### Quick Start

Before you start to do the preprocessing, pleaser refer to `data/README.md` to prepare the original data, including downloading the data and organizing the data in a proper structure.

**Step 1**. Check the `notebook/01_file_convert.ipynb`, this notebook contain the process of converting the original data file (in `.jpg` format) to `.csv` files, for better analysis in the following steps. This process can also be done by the script `src/imageconvert.py`, but before running please double check the prepared original data files structure.

**Step 2**. If you want to see the visualizaiton of the data, you can check the `notebook/02_visualization.ipynb`;

**Step 3**. Now you can use the [`Labelme`](https://github.com/wkentaro/labelme) to select the object in the figure to follow as a mask. It will looks like this:

<img src="fig/segment.png" width="90%">

For more details of `Labelme`, you may refer to the [official tutorial](https://github.com/wkentaro/labelme/tree/main/examples/tutorial#tutorial-single-image-example).

**Step 4**. After you get the output from the Labelme, you can use the `notebook/03_analysis.ipynb` to analysis the value change of your selected domain. For more analysis details, you can refer to the notebook.

<img src="fig/analysis.png" width="50%">

After this you can do further custom experiments.

### Contact

If you have any questions or find any bugs, feel free to raise an issue. If you have ideas to contribute to this repo, welcome to pull request or contact [[email protected]]([email protected]). Thanks for your interest in our work!
Empty file added data/README.md
Empty file.
Binary file added data/convert/snap-2022-08-03T13-48-18.19/img.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/convert/snap-2022-08-03T13-48-18.19/label_names.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
_background_
Tree1
Tree2
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading

0 comments on commit 607654b

Please sign in to comment.