GeoBridge-NAS / README.md
kujimili's picture
docs: add arXiv paper badge to README
d68db93 verified
|
Raw History Blame Contribute Delete
4.62 kB
---
library_name: pytorch
pipeline_tag: depth-estimation
tags:
- computer-vision
- neural-architecture-search
- evolutionary-search
- monocular-depth-estimation
- novel-view-synthesis
- gaussian-splatting
- open-vocabulary-segmentation
---
<div align="center">
# GeoBridge: Evolving Transferable Decoder Topologies for Geometric Vision
**Rui Wang<sup>1</sup> 路 Haoyu Zhang<sup>1</sup> 路 Ran Cheng<sup>2</sup>**
<sup>1</sup>Hangzhou Normal University 路 <sup>2</sup>The Hong Kong Polytechnic University
**Evolve once. Reuse decoder topologies across geometric vision systems.**
<a href="https://arxiv.org/abs/2610.15280"><img src="https://img.shields.io/badge/arXiv-2610.15280-b31b1b" alt="arXiv"></a>
<a href="https://emi-group.github.io/GeoBridge-NAS/"><img src="https://img.shields.io/badge/Project-Page-green" alt="Project Page"></a>
<a href="https://github.com/EMI-Group/GeoBridge-NAS"><img src="https://img.shields.io/badge/GitHub-Code-black?logo=github" alt="GitHub Code"></a>
<a href="https://github.com/EMI-Group/GeoBridge-NAS#depth-evaluation"><img src="https://img.shields.io/badge/Quick-Start-orange" alt="Quick Start"></a>
</div>
## Model family
**GeoBridge** evolves decoder topologies within a fixed multi-scale scaffold. Residual, sequential, and parallel compositions are encoded as functional trees and selected through multi-objective evolution with the gradient sensitivity-alignment proxy (**GSAP**).
This repository provides the weights for **GeoBridgeNet-A1, GeoBridgeNet-A2, and GeoBridgeNet-A3**. Each target system reuses the selected topology and primitive configurations, with separately trained weights and prediction interfaces. The bundle covers monocular depth estimation, Gaussian novel view synthesis, and COS3D scene refinement and semantic grounding.
Earlier releases used the name **DDN**. Checkpoint filenames and architecture keys (`A1`, `A2`, `A3`) retain their existing layout. The code uses the `ddn` package and some legacy `DDN-A1/A2/A3` command-line labels for compatibility.
## Download weights
| Weights | A1 | A2 | A3 |
|:---|:---:|:---:|:---:|
| NYU Depth V2 | [Download](https://huggingface.co/kujimili/GeoBridge-NAS/resolve/main/nyu/a1.pth?download=true) | [Download](https://huggingface.co/kujimili/GeoBridge-NAS/resolve/main/nyu/a2.pth?download=true) | [Download](https://huggingface.co/kujimili/GeoBridge-NAS/resolve/main/nyu/a3.pth?download=true) |
| KITTI | [Download](https://huggingface.co/kujimili/GeoBridge-NAS/resolve/main/kitti/a1.pth?download=true) | [Download](https://huggingface.co/kujimili/GeoBridge-NAS/resolve/main/kitti/a2.pth?download=true) | [Download](https://huggingface.co/kujimili/GeoBridge-NAS/resolve/main/kitti/a3.pth?download=true) |
| RealEstate10K | [Download](https://huggingface.co/kujimili/GeoBridge-NAS/resolve/main/re10k/a1.ckpt?download=true) | [Download](https://huggingface.co/kujimili/GeoBridge-NAS/resolve/main/re10k/a2.ckpt?download=true) | [Download](https://huggingface.co/kujimili/GeoBridge-NAS/resolve/main/re10k/a3.ckpt?download=true) |
| COS3D 路 four scenes | [Browse](https://huggingface.co/kujimili/GeoBridge-NAS/tree/main/cos3d/a1) | [Browse](https://huggingface.co/kujimili/GeoBridge-NAS/tree/main/cos3d/a2) | [Browse](https://huggingface.co/kujimili/GeoBridge-NAS/tree/main/cos3d/a3) |
COS3D scenes: **Figurines 路 Teatime 路 Ramen 路 Waldo Kitchen**.
```bash
python -m pip install -U huggingface_hub
# Download the full bundle.
hf download kujimili/GeoBridge-NAS --local-dir ./weights/public
# Download only the NYU GeoBridgeNet-A3 checkpoint.
hf download kujimili/GeoBridge-NAS nyu/a3.pth --local-dir ./weights/public
```
## Evaluation
Use the matching architecture and task checkpoint with the scripts in the [code repository](https://github.com/EMI-Group/GeoBridge-NAS). Depth checkpoints include the student encoder. Novel-view synthesis and COS3D use separate environments described in their guides.
[Depth evaluation](https://github.com/EMI-Group/GeoBridge-NAS#depth-evaluation) 路 [Novel view synthesis](https://github.com/EMI-Group/GeoBridge-NAS#realestate10k) 路 [COS3D guide](https://github.com/EMI-Group/GeoBridge-NAS/blob/main/cos3d/README.md)
The code README documents [manuscript results](https://github.com/EMI-Group/GeoBridge-NAS#main-results). Follow the task-specific evaluation protocols when comparing results.
[All files](https://huggingface.co/kujimili/GeoBridge-NAS/tree/main) 路 [Training and search](https://github.com/EMI-Group/GeoBridge-NAS#workflow) 路 [Component licenses](https://github.com/EMI-Group/GeoBridge-NAS/blob/main/THIRD_PARTY_NOTICES.md)