|
1 | 1 | # <i>S</i><sup>3</sup>Gaussian: Self-Supervised Street Gaussians for Autonomous Driving
|
2 |
| -### [Paper]() | [Project Page](https://wzzheng.net/S3Gaussian) |
| 2 | +### [Paper](https://arxiv.org/abs/2405.20323) | [Project Page](https://wzzheng.net/S3Gaussian) |
3 | 3 |
|
4 | 4 | > <i>S</i><sup>3</sup>Gaussian: Self-Supervised Street Gaussians for Autonomous Driving
|
5 | 5 |
|
|
9 | 9 |
|
10 | 10 | <i>S</i><sup>3</sup>Gaussian employs 3D Gaussians to model dynamic scenes for autonomous driving ***without*** other supervisions (e.g., 3D bounding boxes).
|
11 | 11 |
|
12 |
| -<p align="center"> |
13 |
| - <img src="./assets/compare.jpg" width=800> |
14 |
| -</p> |
| 12 | + |
15 | 13 |
|
16 | 14 | ## News
|
17 |
| -- **[2023/5/30]** Training & Evaluation code release!. |
18 |
| -- **[2024/5/30]** Paper released on [arXiv](https://arxiv.org/abs/2311.12754). |
| 15 | +- **[2023/5/31]** Training & evaluation code release! |
| 16 | +- **[2024/5/31]** Paper released on [arXiv](https://arxiv.org/abs/2405.20323). |
19 | 17 |
|
20 | 18 | ## Demo
|
21 | 19 |
|
|
24 | 22 | ## Overview
|
25 | 23 | 
|
26 | 24 |
|
27 |
| -To tackle the challenges in self-supervised street scene decomposition, we propose a multi-resolution hexplane-based encoder to encode 4D grid into feature planes and a multi-head Gaussian decoder to decode them into deformed 4D Gaussians. We optimize the over model without extra annotations in a self-supervised manner and achieve superior scene decomposition ability and rendering quality. |
| 25 | +To tackle the challenges in self-supervised street scene decomposition, we propose a multi-resolution hexplane-based encoder to encode 4D grid into feature planes and a multi-head Gaussian decoder to decode them into deformed 4D Gaussians. We optimize the overall model without extra annotations in a self-supervised manner and achieve superior scene decomposition ability and rendering quality. |
| 26 | + |
| 27 | +## Results |
| 28 | + |
| 29 | + |
28 | 30 |
|
29 | 31 | ## Getting Started
|
30 | 32 |
|
@@ -90,6 +92,10 @@ Thanks to these excellent open-sourced repos!
|
90 | 92 |
|
91 | 93 | If you find this project helpful, please consider citing the following paper:
|
92 | 94 | ```
|
93 |
| -@article{ |
94 |
| -} |
| 95 | +@article{huang2024s3gaussian, |
| 96 | + title={S3Gaussian: Self-Supervised Street Gaussians for Autonomous Driving}, |
| 97 | + author={Huang, Nan and Wei, Xiaobao and Zheng, Wenzhao and An, Pengju and Lu, Ming and Zhan, Wei and Tomizuka, Masayoshi and Keutzer, Kurt and Zhang, Shanghang}, |
| 98 | + journal={arXiv preprint arXiv:2405.20323}, |
| 99 | + year={2024} |
| 100 | + } |
95 | 101 | ```
|
0 commit comments