Hybrid Mobile Vision for Emerging Applications

Nan Wu; Felix Xiaozhu Lin; Feng Qian; Bo Han

doi:10.1145/3508396.3512876

Hybrid Mobile Vision for Emerging Applications

Nan Wu, Felix Xiaozhu Lin, Feng Qian, Bo Han

Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Scopus citations

Abstract

While mobile applications have greatly benefited from 2D computer vision algorithms such as object detection and classification, there is limited research on exploring 3D vision that is enabled by the increasing availability of depth cameras and LiDAR scanners on mobile devices. In this paper, we propose a hybrid mobile vision system that intelligently combines 2D and 3D vision for improving the performance of emerging applications such as augmented and mixed reality and volumetric content analytics. Our research is motivated by and explores the key observation of the crucial latency-accuracy tradeoff between 2D and 3D vision. We present a research agenda with two principles for enhancing mobile vision stack, complementing 3D vision with its 2D counterpart by leveraging their diverse resource/accuracy profiles and processing 3D data (e.g., point clouds) with 2D vision cues for mitigating the high computation and storage costs.

Original language	English (US)
Title of host publication	HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications
Publisher	Association for Computing Machinery, Inc
Pages	61-67
Number of pages	7
ISBN (Electronic)	9781450392181
DOIs	https://doi.org/10.1145/3508396.3512876
State	Published - Mar 9 2022
Event	23rd Annual International Workshop on Mobile Computing Systems and Applications, HotMobile 2022 - Virtual, Online, United States Duration: Mar 9 2022 → Mar 10 2022

Publication series

Name	HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications

Conference

Conference	23rd Annual International Workshop on Mobile Computing Systems and Applications, HotMobile 2022
Country/Territory	United States
City	Virtual, Online
Period	3/9/22 → 3/10/22

Bibliographical note

Funding Information:
We thank the anonymous reviewers and our shepherd Urs Hen-gartner for their insightful comments. The research of Bo Han and Nan Wu was funded in part by 4-VA, a collaborative partnership for advancing the Commonwealth of Virginia. Felix Xiaozhu Lin was supported in part by NSF awards #1846102, #1919197, #2106893, and the Virginia’s Commonwealth Cyber Initiative.

Publisher Copyright:
© 2022 Owner/Author.

Keywords

hybrid mobile vision
mobile vision
object detection
point cloud
volumetric content process

Access

10.1145/3508396.3512876

OpenUrl availability

Full text

Cite this

Wu, N., Lin, F. X., Qian, F., & Han, B. (2022). Hybrid Mobile Vision for Emerging Applications. In HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications (pp. 61-67). (HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications). Association for Computing Machinery, Inc. https://doi.org/10.1145/3508396.3512876

Hybrid Mobile Vision for Emerging Applications. / Wu, Nan; Lin, Felix Xiaozhu; Qian, Feng et al.
HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications. Association for Computing Machinery, Inc, 2022. p. 61-67 (HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Wu, N, Lin, FX, Qian, F & Han, B 2022, Hybrid Mobile Vision for Emerging Applications. in HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications. HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications, Association for Computing Machinery, Inc, pp. 61-67, 23rd Annual International Workshop on Mobile Computing Systems and Applications, HotMobile 2022, Virtual, Online, United States, 3/9/22. https://doi.org/10.1145/3508396.3512876

Wu N, Lin FX, Qian F, Han B. Hybrid Mobile Vision for Emerging Applications. In HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications. Association for Computing Machinery, Inc. 2022. p. 61-67. (HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications). doi: 10.1145/3508396.3512876

Wu, Nan ; Lin, Felix Xiaozhu ; Qian, Feng et al. / Hybrid Mobile Vision for Emerging Applications. HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications. Association for Computing Machinery, Inc, 2022. pp. 61-67 (HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications).

@inproceedings{88f4633027ad410b8d31a574a7b2c883,

title = "Hybrid Mobile Vision for Emerging Applications",

abstract = "While mobile applications have greatly benefited from 2D computer vision algorithms such as object detection and classification, there is limited research on exploring 3D vision that is enabled by the increasing availability of depth cameras and LiDAR scanners on mobile devices. In this paper, we propose a hybrid mobile vision system that intelligently combines 2D and 3D vision for improving the performance of emerging applications such as augmented and mixed reality and volumetric content analytics. Our research is motivated by and explores the key observation of the crucial latency-accuracy tradeoff between 2D and 3D vision. We present a research agenda with two principles for enhancing mobile vision stack, complementing 3D vision with its 2D counterpart by leveraging their diverse resource/accuracy profiles and processing 3D data (e.g., point clouds) with 2D vision cues for mitigating the high computation and storage costs.",

keywords = "hybrid mobile vision, mobile vision, object detection, point cloud, volumetric content process",

author = "Nan Wu and Lin, {Felix Xiaozhu} and Feng Qian and Bo Han",

note = "Funding Information: We thank the anonymous reviewers and our shepherd Urs Hen-gartner for their insightful comments. The research of Bo Han and Nan Wu was funded in part by 4-VA, a collaborative partnership for advancing the Commonwealth of Virginia. Felix Xiaozhu Lin was supported in part by NSF awards #1846102, #1919197, #2106893, and the Virginia{\textquoteright}s Commonwealth Cyber Initiative. Publisher Copyright: {\textcopyright} 2022 Owner/Author.; 23rd Annual International Workshop on Mobile Computing Systems and Applications, HotMobile 2022 ; Conference date: 09-03-2022 Through 10-03-2022",

year = "2022",

month = mar,

day = "9",

doi = "10.1145/3508396.3512876",

language = "English (US)",

series = "HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications",

publisher = "Association for Computing Machinery, Inc",

pages = "61--67",

booktitle = "HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications",

}

TY - GEN

T1 - Hybrid Mobile Vision for Emerging Applications

AU - Wu, Nan

AU - Lin, Felix Xiaozhu

AU - Qian, Feng

AU - Han, Bo

N1 - Funding Information: We thank the anonymous reviewers and our shepherd Urs Hen-gartner for their insightful comments. The research of Bo Han and Nan Wu was funded in part by 4-VA, a collaborative partnership for advancing the Commonwealth of Virginia. Felix Xiaozhu Lin was supported in part by NSF awards #1846102, #1919197, #2106893, and the Virginia’s Commonwealth Cyber Initiative. Publisher Copyright: © 2022 Owner/Author.

PY - 2022/3/9

Y1 - 2022/3/9

N2 - While mobile applications have greatly benefited from 2D computer vision algorithms such as object detection and classification, there is limited research on exploring 3D vision that is enabled by the increasing availability of depth cameras and LiDAR scanners on mobile devices. In this paper, we propose a hybrid mobile vision system that intelligently combines 2D and 3D vision for improving the performance of emerging applications such as augmented and mixed reality and volumetric content analytics. Our research is motivated by and explores the key observation of the crucial latency-accuracy tradeoff between 2D and 3D vision. We present a research agenda with two principles for enhancing mobile vision stack, complementing 3D vision with its 2D counterpart by leveraging their diverse resource/accuracy profiles and processing 3D data (e.g., point clouds) with 2D vision cues for mitigating the high computation and storage costs.

AB - While mobile applications have greatly benefited from 2D computer vision algorithms such as object detection and classification, there is limited research on exploring 3D vision that is enabled by the increasing availability of depth cameras and LiDAR scanners on mobile devices. In this paper, we propose a hybrid mobile vision system that intelligently combines 2D and 3D vision for improving the performance of emerging applications such as augmented and mixed reality and volumetric content analytics. Our research is motivated by and explores the key observation of the crucial latency-accuracy tradeoff between 2D and 3D vision. We present a research agenda with two principles for enhancing mobile vision stack, complementing 3D vision with its 2D counterpart by leveraging their diverse resource/accuracy profiles and processing 3D data (e.g., point clouds) with 2D vision cues for mitigating the high computation and storage costs.

KW - hybrid mobile vision

KW - mobile vision

KW - object detection

KW - point cloud

KW - volumetric content process

UR - http://www.scopus.com/inward/record.url?scp=85127594623&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85127594623&partnerID=8YFLogxK

U2 - 10.1145/3508396.3512876

DO - 10.1145/3508396.3512876

M3 - Conference contribution

AN - SCOPUS:85127594623

T3 - HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications

SP - 61

EP - 67

BT - HotMobile 2022 - Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications

PB - Association for Computing Machinery, Inc

T2 - 23rd Annual International Workshop on Mobile Computing Systems and Applications, HotMobile 2022

Y2 - 9 March 2022 through 10 March 2022

ER -

Hybrid Mobile Vision for Emerging Applications

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this