À³¥Î©ó°ª¶¥²G´¹Åã¥Ü¾¹¤§°ª«~½èµe­±§ó·s²v´£¤ÉÂà´«§Þ³N

¤jºõ

     ¬°¤F¸Ñ¨M¦h´CÅé¸Ë¸m¶¡¤j¶qªº³s±µ½u¸ô¡A¦]¦¹¦hºØ®a¥ÎµL½u¶Ç¿é¨t²Î³Q´£¥X¡A¦pwireless HD©ÎªÌWHDIµ¥¡CµM¦Ó²{¦³µL½u¶Ç¿é¨t²Î¥D­n±Mª`©óÂI¹ïÂI°ª³t¼Æ¾Ú¶Ç¿é¡A¦Ó¥BÃö©ó¶Ç¿é¶ZÂ÷³¡¤À¤]¦³ÄY®æ­­¨î¡A¦]¦¹¦b¨Ï¥Î¤W·|¦³»Ý¦h­­¨î¡C¦]¦¹¤@­Ó¾ã¦Xºô¸ô¾÷¨î¡BµL½u¶Ç¿é¡B¥H¤Î¦h´CÅéÀ£ÁY¤§¨t²Î³Q´£¥X¡AºÙ¤§¬°WHDVIm¡C¦b¦¹¨t²Î¤¤¦³¨â­Ó­«­n¼Ò²Õ¡A¤À§O¬°µe­±§ó·s²v´£ª@§Þ³N¥H¤Î¥i©µ¦ù½s¸Ñ½X¡C

 

High Visual Quality Particle Based Frame Rate Up Conversion With Acceleration Assisted Motion Trajectory Calibration

     ­º¥ý¦b°ò©ó²É¤l¯S©Ê¤§µe­±§ó·s²v´£ª@§Þ³N¤¤¡A¦¹½×¤åÂǥѦh¶¥¼h°ÊºA¦ô´ú¥H¤Î°ò©ó²É¤l¯S©Ê¤§­y¸ñ®Õ¥¿¨Ó²£¥Í©Ò»Ý¤§¤º´¡¼v¹³¡C¥t¥~°£¤F§Q¥Î­y¸ñ»P²{¦³¤º´¡¤è¶ô¤§¶ZÂ÷¥~¡A²Ä¤@¶¥¬q²£¥Í¤§µ´¹ï»~®t©M»P²Ä¤G¶¥¬q²£¥Í¤§Âù¦Vµ´¹ï»~®t©M¥çÁp¦X¦Ò¶q¥Î¥H³Ì¤p¤Æ»~®t¡C®Ú¾Ú¹êÅçµ²ªG¡A¥»´£¥X¤§ºtºâªk¤ñ°_²{¦³ºtºâªk¡A¨äµe½è°ª¥X0.9~3.9 dB¡A¨ä¤¤©Ò¥]§t¤§¤ñ¸û¹ï¶H¥]§t³æ¶µ¦ô´ú¥H¤ÎÂù¦V¦ô´ú¤§ºtºâªk¡C¦¹¹êÅçµ²ªGÃÒ¹ê¨Ï¥Î³æ¶µ°ÊºA¦ô´ú©Ò±o¨ì¤§°ÊºA¦V¶q¤ñ°_Âù¦V¦ô´ú§ó¬°ºë·Ç¡C¥t¥~¤]ÃÒ¹ê°ò©ó­y¸ñ¤§°ÊºA¦ô´ú¤]¯à¦³®Äªº¿ï¾Ü¥¿½T°ÊºA¡C

     ±µ¤U¨Ó¦b²V¦X«¬µe­±§ó·s²v´£ª@§Þ³N(Hybrid FRUC)¤¤¡A±N°ÊºA¦ô´ú¿Å¶q¼Ð·Ç°µ¶i¤@¨Bªº±j¤Æ¡A¥Î¥H¥[±j­ì¨Ó°ò©ó¨Ò¤l¯S©Ê¤§µe­±§ó·s²v´£ª@§Þ³N¤¤¤§²Ä¤G¶¥¬q¡A¤]´N¬O­y¸ñ¨ú±o³¡¥÷¡C¥t¥~¡A­ì©lºtºâªk¤¤­«½Æ¹Bºâ§Q¥Î°O¾ÐÅé¦s¨úªº¤è¦¡¤ÆÂ²¡AÅý°õ¦æ®É¶¡§ó¥[§Ö³t¡C³Ì«á§ó¦b¤j¤Ø¤oµe­±¤¤¨Ï¥Î¸û¤jªº·j´M¤è¶ô¡C¥[¤j¤jµe­±¤§·j´M¤è¶ô¤£¦ýµe½è¤£·|¤U­°¡A¥B½ÆÂø«×·|«æÁØ­°§C¡C¥Ñ¹êÅçµ²ªGµo²{¡A¨äµe½è¤ñ°_²{¦³¤èªk°ª¥X0.3 dB¥H¤W¡A¦Ó¥B½ÆÂø«×­°§C¤F29~90%¡A¥i¥HÃҹꦹºtºâªk¤§®Ä²v¥H¤Îµe­±´£ª@ªº®ÄªG¡C

¡@

¡@

DEMO Video

 

Flower Video

Football Video

mobile Video

 

   

Hierachical MV field Flowchart

  

Motion trajectory calibration stage (PMTC)
Flowchart
 

 

PSNR Result 

 

 

 


 

 

Accurate Frame Rate Up-Conversion for Advanced Visual Quality(AFRUC)

 

Download:

exe

bat

Sequence1

Sequence2

Sequence3

 

l  a motion compensated FRUC algorithm is proposed, which is able to acquire more accurate motion vectors by referencing neighboring frames with hierarchical motion filed construction block size and an MV mapping stage.

l  The block size of hierarchical MV filed construction has been enlarged in order to acquire more motion information, and the size of the MV mapping and image interpolation stage has been reduced to obtain a more accurate interpolated result.

l  In order to smooth the motion vector, a median filter is considered with SAD (sum of absolute difference) value and constructed with an adaptive motion vector smoothing method.

l  For the purpose of suppressing the debris, a noise removal filter is applied after the interpolation operation.

l  According to the experimental result, the proposed approach is able to improve visual quality performance by 0.82 dB on average. Subjective analysis shows that annoying artifacts are significantly reduced.

 

The overall flowchart of Accurate Frame Rate Up-Conversion

 

 

AFRUC Result

Fig. The snapshot of Silent on frame no. 73 with (a) the original video, (b) PFRUC, (c) extend BME, (d) Multiple Hypotheses Bayesian FRUC, and (e) AFRUC

 

PSNR Result

 

TABLE THE EXPERIMENTAL RESULT BY PSNR

 

Download:

exe

bat

Sequence1

Sequence2

Sequence3