8000 Water Segmentation Models · Issue #62 · cc-ai/kdb · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Water Segmentation Models #62

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
bsahil29 opened this issue May 21, 2019 · 6 comments
Closed

Water Segmentation Models #62

bsahil29 opened this issue May 21, 2019 · 6 comments

Comments

@bsahil29
Copy link
Contributor

We are planning to work on segmentation models that have been designed specifically for the water scenario :

  • Train the network
  • Assert author performances
  • Comparison with deeplab
  • (optional) Fine-tuning on our flooded House dataset

The approach used is described in Single Image Water Detection. The net is designed to detect water on asphalt and country road using reflection unit.

The paper code : Github Link

@gcosne
Copy link
Member
gcosne commented May 22, 2019

Experiment 1 : Training on puddles & Infering on flooded scenes

  • GPU : Tesla k80 12GB
  • Batch size : 1
  • Training epochs : 50K
  • Training dataset : puddle dataset
  • Training time : 12 hours

Remark : We trained the network with the same parameters as given by the author of the paper except for the epoch number (50K vs 60K). Infering on flooded images while training on puddle dataset doesn't work well.

See qualitative results : puddle_detection                                        failed_case_flood_segmenter

Conclusion : I suggest we wait for the author to answer and deliver the supplementary materials where there is a detailed analysis on training time, robustness to over-fitting etc..

If we agree to spend more time testing this method, we should train it over our own flooded scene.

@gcosne
Copy link
Member
gcosne commented May 23, 2019

Here is a Link to the fork.

@gcosne
Copy link
Member
gcosne commented May 24, 2019

Experiment 2 : Initializing with the puddle model and training over 50 flooded segmented images

  • Training iteration : 250
  • Training dataset : Flood_images
  • Training time : 10 min

Remark 1 : This experiment aim to evaluate the ability of such a network to segment flood, results are promising for a fine-tuning.

We could try to extract soft segmentation mask and combine it with other methods with fuzzy theory.

Remark 2: The model hasn't been shown images without water so it is biased, one may want to train the latter with such images.

Qualitative evaluation on testing images
screen shot 2017-08-07 at 12 18 15 pm screen shot 2017-08-07 at 12 18 15 pm screen shot 2017-08-07 at 12 18 15 pm
screen shot 2017-08-07 at 12 18 15 pm screen shot 2017-08-07 at 12 18 15 pm screen shot 2017-08-07 at 12 18 15 pm
screen shot 2017-08-07 at 12 18 15 pm screen shot 2017-08-07 at 12 18 15 pm screen shot 2017-08-07 at 12 18 15 pm
Qualitative evaluation on training images
screen shot 2017-08-07 at 12 18 15 pm screen shot 2017-08-07 at 12 18 15 pm screen shot 2017-08-07 at 12 18 15 pm
screen shot 2017-08-07 at 12 18 15 pm screen shot 2017-08-07 at 12 18 15 pm screen shot 2017-08-07 at 12 18 15 pm
screen shot 2017-08-07 at 12 18 15 pm screen shot 2017-08-07 at 12 18 15 pm screen shot 2017-08-07 at 12 18 15 pm

Conclusion :
As we can see the network is still in early stage of training (it does not fit very well the training data).

@gcosne
Copy link
Member
gcosne commented May 24, 2019

To do :

  • Quantitative evaluation train/test
  • Fine tune really (not training the entire model)

@gcosne
Copy link
Member
gcosne commented Jul 4, 2019

Update : Reading this github issue

Starting A8F6 from the observation that GauGAN can draw pretty realistic water, I look deeper into their paper and github issue to find which was the semantic segmentation model used in their experiment with flickr landscape dataset. Following this github issue, they used DeepLab v2 on COCO-stuffs-164k .

Evaluating Results
Evaluating on our dataset of manually annotated 210 images of flood, without the CRF post processing, results appear very good, the mean IOU is about 79% with some example that totally fail.

A good way of using it would be to process our entire dataset and remove manually every image with less than 50% of water covered. If we do that post evaluation on the 210 images, we keep 88 % of them and increase the IOU to 86%.

Good Results:
output_crf_deeplab

im_output

Worst Results:
image (3)

image (2)

The algorithm fails to recognize water, when it recognize the road, it also happens when the image is in heavy rain condition (few centimeters over the road and we still see the lane)

@gcosne
Copy link
Member
gcosne commented Jul 18, 2019

Here is the implementation of the selected algorithm: https://github.com/cc-ai/deeplab-pytorch/

GitHub
PyTorch implementation of DeepLab v2 on COCO-Stuff - cc-ai/deeplab-pytorch

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants
0