{"id":98,"date":"2018-01-17T18:09:42","date_gmt":"2018-01-17T09:09:42","guid":{"rendered":"https:\/\/kaumediaprocessing.wordpress.com\/?page_id=98"},"modified":"2020-10-14T10:06:12","modified_gmt":"2020-10-14T10:06:12","slug":"depth","status":"publish","type":"page","link":"http:\/\/multimedia.kau.ac.kr\/?page_id=98","title":{"rendered":"Depth map processing"},"content":{"rendered":"<p><span style=\"color: #000000; font-size: 22px;\"><b>Depth map <\/b><\/span><\/p>\n<p><span style=\"color: #000000; font-size: 15px;\">\u00a0 Depth map is an image that contains information relating to the distance of the surface of scene objects from a view point.<\/span><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter wp-image-255\" src=\"http:\/\/rmclab.dothome.co.kr\/wp-content\/uploads\/2018\/01\/depthmap_1.png?w=300\" alt=\"\" width=\"500\" height=\"200\" \/><\/p>\n<p><span style=\"color: #000000; font-size: 22px;\"><b>Deep convolutional grid warping network for joint depth map upsampling<\/b><\/span><\/p>\n<p><span style=\"color: #000000; font-size: 15px;\">\u00a0 In this work, we propose a novel deep learning-based scheme to upsample a depth map. Conventional deep learning-based scheme tried to modify pixel values using high-resolution color image and low-resolution depth map. Unlike these methods, the proposed method tries to solve depth upsampling problem by pixel position shift. We implement this idea using two sub-networks. One is the displacement network which determines pixel shifting vectors. The other is fusion network which shifts pixels and reconstructs high-resolution depth map. <\/span><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter wp-image-576\" src=\"http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2020\/10\/Network_displacement_vector_warping.png\" alt=\"\" width=\"400\" height=\"250\" \/><\/p>\n<p><span style=\"color: #000000; font-size: 12px;\">[Y. Yang, D. Kim, B. T. Oh, \u201cDeep convolutional grid warping network for joint depth map upsampling,\u201d IEEE Access, Aug 2020.]<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"color: #000000; font-size: 22px;\"><b>Depth map upsampling with a confidence-based joint guided filter<\/b><\/span><\/p>\n<p><span style=\"color: #000000; font-size: 15px;\">\u00a0 Joint depth map upsampling is a problem which enhances the resolution of an image using color image. One of the difficult problems is to find accurate position of edges. Recently, onion-peel filtering method is proposed which removes pixels in unreliable region first and fills the removed pixels sequentially in unreliable region from outside to inside. But, the performance of this method depends on the order in which the pixels are filled. Focusing on this, we propose novel filtering method which find optimal order using the confidence map derived from the shape of unreliable region, depth and color pixel value.<\/span><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter wp-image-576\" src=\"http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2019\/07\/joint_depth_upsampling-300x189.png\" alt=\"\" width=\"609\" height=\"384\" srcset=\"http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2019\/07\/joint_depth_upsampling-300x189.png 300w, http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2019\/07\/joint_depth_upsampling-768x485.png 768w, http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2019\/07\/joint_depth_upsampling-1024x646.png 1024w, http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2019\/07\/joint_depth_upsampling.png 1687w\" sizes=\"(max-width: 609px) 100vw, 609px\" \/><\/p>\n<p><span style=\"color: #000000; font-size: 12px;\">[Y. Yang, H. S. Lee, and B. T. Oh, \u201cDepth map upsampling with a confidence-based joint guided filter,\u201d Signal Processing: Image Communication, Sep. 2019.]<\/span><\/p>\n<p><span style=\"color: #ffffff; font-size: 1px;\"><b>.<\/b><\/span><br \/>\n<span style=\"color: #000000; font-size: 22px;\"><b> Pre-\/Post-processing to improve the coding\u00a0 performance of multiview plus depth map<\/b><\/span><span style=\"color: #000000; font-size: 15px;\">\u00a0<\/span><\/p>\n<p><span style=\"color: #000000; font-size: 15px;\">\u00a0 In this work, we propose new system for improving coding performance of multi-view and depth map (MVD) system using properties of depth map. The proposed method consists of two stages. In the pre-processing stage, dept map is filtered selectively to reduce the bit-rate cost while minimizing quality degradation. In the post-processing stage, decoded depth map is restored.<\/span><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter wp-image-463 \" style=\"color: #2b2b2b; font-size: 16px;\" src=\"http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2018\/05\/depthmap_4-300x185.png\" alt=\"\" width=\"696\" height=\"429\" srcset=\"http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2018\/05\/depthmap_4-300x185.png 300w, http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2018\/05\/depthmap_4-768x473.png 768w, http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2018\/05\/depthmap_4-1024x630.png 1024w, http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2018\/05\/depthmap_4.png 1394w\" sizes=\"(max-width: 696px) 100vw, 696px\" \/><\/p>\n<p><span style=\"color: #000000; font-size: 12px;\">[\u200bD. Lee, Y. Yang, and B. T. Oh, \u201cPre-\/post-processing to improve the coding performance of multiview plus depth map,\u201d Signal Processing: Image Communication, Oct. 2017.]<\/span><br \/>\n<span style=\"color: #000000; font-size: 12px;\">[D. Lee, Y. Yang, and B. T. Oh,\u201cEnhancement of depth map post-processing for 3D video coding,\u201d International Workshop on Advanced Image Technology, 2016.]<\/span><\/p>\n<p><span style=\"color: #ffffff; font-size: 25px;\"><b>.<\/b><\/span><br \/>\n<span style=\"color: #000000; font-size: 22px;\"><b>Boundary artifacts reduction in view synthesis of 3D video system<\/b><\/span><\/p>\n<p><span style=\"color: #000000; font-size: 15px;\">\u00a0 In this work, we propose boundary artifacts reduction method for synthesized view in 3D video system. In this method, we analysis the property of boundary artifacts caused by compression noise. And, we set the convex set in pixel and frequency domain. Then, we find sub-optimal solution using projection onto convex sets method.<\/span><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter wp-image-465 \" style=\"color: #2b2b2b; font-size: 16px;\" src=\"http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2018\/05\/depthmap_5-300x182.png\" alt=\"\" width=\"706\" height=\"429\" srcset=\"http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2018\/05\/depthmap_5-300x182.png 300w, http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2018\/05\/depthmap_5-768x466.png 768w, http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2018\/05\/depthmap_5-1024x622.png 1024w, http:\/\/multimedia.kau.ac.kr\/wp-content\/uploads\/2018\/05\/depthmap_5.png 1828w\" sizes=\"(max-width: 706px) 100vw, 706px\" \/><\/p>\n<p><span style=\"color: #000000; font-size: 12px;\">[\uc774\ub3c4\ud6c8, \uc591\uc724\ubaa8, \uc624\ubcd1\ud0dc, \u201c3\ucc28\uc6d0 \ube44\ub514\uc624\uc758 \ud569\uc131\uc601\uc0c1 \uacbd\uacc4 \uc7a1\uc74c \uc81c\uac70,\u201d \ubc29\uc1a1\uacf5\ud559\ud68c\ub17c\ubb38\uc9c0, Nov. 2016.]<\/span><br \/>\n<span style=\"color: #000000; font-size: 12px;\">[\uc774\ub3c4\ud6c8, \uc591\uc724\ubaa8, \uc624\ubcd1\ud0dc, \u201c3\ucc28\uc6d0 \ube44\ub514\uc624\uc758 \ud569\uc131\uc601\uc0c1 \uacbd\uacc4 \uc7a1\uc74c \uc81c\uac70,\u201d \ud55c\uad6d\ubc29\uc1a1\ubbf8\ub514\uc5b4\uacf5\ud559\ud68c \ud558\uacc4\ud559\uc220\ub300\ud68c, 2016.]<\/span><br \/>\n<span style=\"color: #000000; font-size: 12px;\">[\uc774\ub3c4\ud6c8, \uc591\uc724\ubaa8, \uc624\ubcd1\ud0dc, \u201c\uae4a\uc774\uc601\uc0c1 \ud574\uc0c1\ub3c4 \uc870\uc808\uc5d0 \ub530\ub978 3\ucc28\uc6d0 \ube44\ub514\uc624 \ubd80\ud638\ud654 \uc131\ub2a5 \ubd84\uc11d,\u201d \ud55c\uad6d\ubc29\uc1a1\uacf5\ud559\ud68c \ud558\uacc4\ud559\uc220\ub300\ud68c, 2015.]<\/span><br \/>\n<span style=\"color: #000000; font-size: 12px;\">[\uc774\ub3c4\ud6c8, \uc624\ubcd1\ud0dc, \u201c\ub2e4\uc2dc\uc810 \uc601\uc0c1 \ubd80\ud638\ud654 \ud6a8\uc728 \ud5a5\uc0c1\uc744 \uc704\ud55c \uc804\ucc98\ub9ac \ubc0f \ud6c4\ucc98\ub9ac \uae30\ubc95,\u201d \uc601\uc0c1\ucc98\ub9ac \ubc0f \uc774\ud574\uc5d0 \uad00\ud55c \uc6cc\ud06c\uc0f5, 2015.]<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Depth map \u00a0 Depth map is an image that contains information relating to the distance of the surface of scene objects from a view point. Deep convolutional grid warping network for joint depth map upsampling \u00a0 In this work, we propose a novel deep learning-based scheme to upsample a depth map. Conventional deep learning-based scheme &hellip; <a href=\"http:\/\/multimedia.kau.ac.kr\/?page_id=98\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Depth map processing<\/span> <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"parent":16,"menu_order":3,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"http:\/\/multimedia.kau.ac.kr\/index.php?rest_route=\/wp\/v2\/pages\/98"}],"collection":[{"href":"http:\/\/multimedia.kau.ac.kr\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/multimedia.kau.ac.kr\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/multimedia.kau.ac.kr\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/multimedia.kau.ac.kr\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=98"}],"version-history":[{"count":26,"href":"http:\/\/multimedia.kau.ac.kr\/index.php?rest_route=\/wp\/v2\/pages\/98\/revisions"}],"predecessor-version":[{"id":733,"href":"http:\/\/multimedia.kau.ac.kr\/index.php?rest_route=\/wp\/v2\/pages\/98\/revisions\/733"}],"up":[{"embeddable":true,"href":"http:\/\/multimedia.kau.ac.kr\/index.php?rest_route=\/wp\/v2\/pages\/16"}],"wp:attachment":[{"href":"http:\/\/multimedia.kau.ac.kr\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=98"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}