Next Article in Journal
Neutrosophic Portfolios of Financial Assets. Minimizing the Risk of Neutrosophic Portfolios
Next Article in Special Issue
Fractions and Pythagorean Tuning—An Interdisciplinary Study in Secondary Education
Previous Article in Journal
Bipolar Fuzzy Relations
Previous Article in Special Issue
Undergraduate Students’ Solutions of Modeling Problems in Algorithmic Graph Theory
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Image Interpolation Using a Rational Bi-Cubic Ball

by
Nur Atiqah Binti Zulkifli
1,
Samsul Ariffin Abdul Karim
2,*,
A’fza Binti Shafie
1,
Muhammad Sarfraz
3,
Abdul Ghaffar
4 and
Kottakkaran Sooppy Nisar
5,*
1
Fundamental and Applied Sciences Department, Universiti Teknologi PETRONAS, Bandar Seri Iskandar, Seri Iskandar 32610, Perak DR, Malaysia
2
Fundamental and Applied Sciences Department and Centre for Smart Grid Energy Research (CSMER), Institute of Autonomous System, Universiti Teknologi PETRONAS, Bandar Seri Iskandar, Seri Iskandar 32610, Perak DR, Malaysia
3
Department of Information Science, College of Computing Sciences & Engineering, Kuwait University, P.O. Box # 5969, Safat 13060, Kuwait
4
Department of Mathematical Sciences, BUITEMS, Quetta 87300, Pakistan
5
Department of Mathematics, College of Arts and Sciences, Prince Sattam bin Abdulaziz University, Wadi Aldawaser 11991, Saudi Arabia
*
Authors to whom correspondence should be addressed.
Mathematics 2019, 7(11), 1045; https://doi.org/10.3390/math7111045
Submission received: 21 August 2019 / Revised: 8 September 2019 / Accepted: 11 September 2019 / Published: 3 November 2019

Abstract

:
This study deals with the application of new rational bi-cubic Ball function with six parameters in image interpolation, especially for the grayscale image. These six free parameters can be modified to get better and quality image resolution, and refine the shape of the interpolating surface. This bivariate rational Ball function has been extended from univariate cases by using a tensor product approach. The proposed scheme is tested for image upscaling with factors of two and four through an efficient algorithm. The effectiveness of the proposed scheme is measured by using an image quality assessment (IQA), such as peak-signal-to-noise-ratio (PSNR), root mean square error (RMSE) or feature similarity (FSIM) index. Numerical and graphical results with comparisons against some existing scheme are presented by using MATLAB. The proposed scheme resulted in higher PSNR and FSIM, and smaller RMSE. Thus, the new rational bi-cubic Ball with six parameters is better than the existing scheme via an efficient algorithm.

1. Introduction

Image scaling (up/down) is the task of resizing a digital image, that requires an image interpolation to obtain better resolution. Image interpolation is important in digital signal and image processing [1]. It is a tool that is widely used in image processing tasks, such as zooming, shrinking, rotating and for geometric corrections [2]. In fact, the technology of image processing is widely implemented in many areas such as medical, geology and forensic. There are numerous studies related to image processing and image interpolation due to its benefit to the industry. The technology of digital image processing appeared in the early 1960s through the introduction of the first computer. The moon is the first image taken by Ranger 7 on 31 July 1964 that was used for geometric correction [2]. From then until present, this topic has grown vigorously and lead multifarious research areas.
The common method for image interpolation is bi-cubic spline interpolation that is well documented in MATLAB as interp2 and imresize built-in functions [1]. However, bi-cubic spline requires more computational cost and memory compared to cubic spline. However, for many images, bi-cubic spline gives a higher peak signal-to-noise ratio (PSNR) and root mean square error (RMSE) value. Without a free parameter in the spline description, the user cannot alter the surfaces and images. To overcome this issue, many researchers have suggested various types of rational spline, such as the rational quartic spline, a rational cubic spline with a linear denominator and a rational cubic spline with a quadratic denominator [3,4,5,6,7,8,9] However, these methods suffer from the fact that some of them require the modification of the first partial derivative [3,4,5,6,7]. Researchers in [3,4,7,8] only consider true function value, i.e., where the first derivative is not supplied, and use only, at most, two parameters [10,11].
In early 1974, Ball introduced the main usage of the function to design a Boeing fuselage, as it has the capability to produce a conic section [12]. Majeed et al. [13] have investigated the application of a rational cubic Ball with two parameters for craniofacial reconstruction by utilizing the rational cubic Ball (curve) and reconstructing the curve of the images after doing the image detection to the outer part of the given images [14]. The proposed scheme will be used for image interpolation; i.e., image upscaling through an efficient algorithm. For example, if the original image has a size of about 256 × 256 pixels, then the image output is upgraded by a factor of two; i.e., 512 × 512 pixels. This is an effective topic in image processing, with recent challenges being to find the best function for upscaling images to specific needs, such as PSNR, RMSE and a feature similarity (FSIM) index. Table 1 and Table 2 show works of the existing scheme. Table 3 shows the list of abbreviations used in this study.
Since the scheme with more free parameters gives the better quality of image interpolation (upscaling or downscaling), it motivated us to present a new rational bi-cubic Ball function with six parameters defined on rectangular meshes. The main objectives of study are stated as follows:
(a)
To propose a new rational bi-cubic Ball with six parameters.
(b)
To apply the proposed scheme in the application of image interpolation: image upscaling for grayscale images.
(c)
To compare the performance with the existing schemes, such as bi-cubic spline interpolation, nearest neighbor, bilinear interpolant and Karim and Saaban [11].
The remainder of this paper is structured as follows. Section 2 deals with construction of a bivariate rational Ball function with six parameters. The relevant research methodology is described in Section 3. The results and discussion are given in Section 4, while Section 5 is devoted to the conclusion.

2. Rational Bicubic Ball Function

This section discusses the construction of a bivariate rational Ball function with six parameters, which is actually the extension of a univariate rational Ball [18] by adopting tensor product technique.

2.1. A Rational Cubic Ball with Three Parameters

The data set { ( x i , f i ) ,   i = 1 ,   2 ,   ,   n } is given, where x 0 < x 1 < < x n with the first derivative d i ,   i = 1 ,   2 ,   ,   n . Let, h i = x i + 1 x i , Δ i = ( f i + 1 f i ) / h i and θ = ( x x i ) / h i , 0 θ 1 . On each subinterval [ x i , x i + 1 ] , i = 1 ,   2 ,   ,   n 1 . Thus, the rational cubic Ball interpolant with three parameters, α i , β i and γ i , i = 1 , 2 ,   ,   n 1 is defined as follows
S ( x ) S i ( θ ) = P i ( θ ) Q i ( θ )
where,
P i ( θ ) = α i f i ( 1 θ ) 2 + A i ( 1 θ ) 2 θ + B i ( 1 θ ) θ 2 + β i f i + 1 θ 2
Q i ( θ ) = α i ( 1 θ ) 2 + γ i ( 1 θ ) θ + β i θ 2
The rational function satisfies C 1 continuity as follows:
S ( x i ) = f i S ( x i + 1 ) = f i + 1
S ( x i ) = d i S ( x i + 1 ) = d i + 1
when x = x i ; then θ = 0 and x = x i + 1 ; then, θ = 1
A i = γ i f i + α i h i d i
B i = γ i f i + 1 β i h i d i + 1
Thus, the rational cubic Ball defined in Equation (1) can be written as:
S ( x ) = α i f i ( 1 θ ) 2 + ( γ i f i + α i h i d i ) ( 1 θ ) 2 θ + ( γ i f i + 1 β i h i d i + 1 ) ( 1 θ ) θ 2 + β i f i + 1 θ 2 α i ( 1 θ ) 2 + γ i ( 1 θ ) θ + β i θ 2

2.2. A Rational Bi-Cubic Ball with Six Parameters

The univariate Ball given in Equation (1) is extended to the bivariate case by adopting a similar approach to [11]. The rational bi-cubic functions over each rectangular patch [ x i ,   x i + 1 ] × [ y j ,   y j + 1 ] , where i = 0 ,   1 ,   ,   n 1 and j = 0 , 1 ,   ,   m 1 , with the first partial derivative at the starting point, on x -direction, y -direction (see Figure 1), and the mixed partial derivative with respective F i , j , F x i , j , F y i , j and F x y i , j . Let, h i = x i + 1 x i , h ^ j = y j + 1 y j , and θ = x x i h i and = y y i h ^ j , with 0 θ 1 and 0 1 . Thus, the rational bi-cubic Ball with six parameters addressed as α i , j , β i , j , γ i , j , α ^ i , j , β ^ i , j , γ ^ i , j > 0 , i = 0 ,   ,   n 1 and j = 0 ,   ,   m 1 , which is defined as below:
S i , j ( x , y ) = A i ( θ ) H i , j A j ( ) T
with
H i , j = [ F i , j F i , j + 1 F y i , j F y i , j + 1 F i + 1 , j F i + 1 , j + 1 F y i + 1 , j F y i + 1 , j + 1 F x i , j F x i , j + 1 F x y i + 1 , j F x y i , j + 1 F x i + 1 , j F x i + 1 , j + 1 F x y i + 1 , j F x y i + 1 , j + 1 ]
A i ( θ ) = [ a 0 ( θ ) a 1 ( θ ) a 2 ( θ ) a 3 ( θ ) ]
A j ( ) = [ a ^ 0 ( ) a ^ 1 ( ) a ^ 2 ( ) a ^ 3 ( ) ]
where,
a 0 ( θ ) = α i , j ( 1 θ ) 2 + γ i , j θ ( 1 θ ) 2 q i ( θ ) a 1 ( θ ) = β i , j θ 2 + γ i , j ( 1 θ ) θ 2 q i ( θ ) a 2 ( θ ) = α i , j h i ( 1 θ ) 2 θ q i ( θ ) a 3 ( θ ) = β i , j h i ( 1 θ ) θ 2 q i ( θ ) q i ( θ ) = α i , j ( 1 θ ) 2 + γ i , j ( 1 θ ) θ + β i , j θ 2
a ^ 0 ( ) = α ^ i , j ( 1 ) 2 + γ ^ i , j ( 1 ) 2 q j ( ) a ^ 1 ( ) = β ^ i , j 2 + γ ^ i , j ( 1 ) 2 q j ( ) a ^ 2 ( ) = α ^ i , j h ^ j ( 1 ) 2 q j ( θ ) a ^ 3 ( ) = β ^ i , j h ^ j ( 1 ) 2 q j ( ) q j ( ) = α ^ i , j ( 1 ) 2 + γ ^ i , j ( 1 ) + β ^ i , j 2
After some mathematical derivation, the proposed rational bi-cubic Ball surface satisfies Equation (6) below:
{ H i , j ( 0 , 0 ) = F i , j H i , j ( 1 , 0 ) = F i + 1 , j H i , j ( 0 , 1 ) = F i , j + 1 H i , j ( 1 , 1 ) = F i + 1 , j + 1
Based on the observation towards the image refinement when the value of six free parameters in the description were being modified, the proposed rational bi-cubic Ball in Equation (5) can be reduced to a standard bi-cubic Hermite interpolation, where α i , j , β i , j , α ^ i , j , β ^ i , j = 1 and γ i , j , γ ^ i , j = 2 .

3. Application in Image Processing

In this section, an efficient algorithm to apply the proposed scheme into application grayscale image upscaling with factors two and four is introduced. The algorithm is comprised of several steps which are elaborated in a flowchart, as shown in Figure 2.

3.1. An Efficient Algorithm for Image Upscaling Using a Rational Bi-Cubic Ball

An efficient algorithm was constructed to implement the proposed scheme in application of image interpolation with grayscale image upscaling. This algorithm requires an input image and parametric values to start the first step. The size of image in pixels can be read as m × n corresponding to vector form that refers to the pixel points that would be interpolated. Figure 2 displays the steps of image (up/down) scaling for factors with even numbers.

3.2. Image Quality Assessment

Image quality assessment (IQA) is used to perceive the quality of the image in many terms, such as peak-signal-to-noise-ratio (PSNR), root mean square error (RMSE) or feature similarity (FSIM) index. In addition, the standard mean square error (MSE) does not have the capability of the human visual system (HVS), to understand an image mainly according to its low-level features [19]. Table 4 provides the lists of terminologies and symbols used in Equations (7)–(9).
The value of PSNR, RMSE and FSIM is defined as follows:
(a)
Peak signal-to-noise ratio (PSNR)
P S N R = 10   log 10 255 2 M S E
where,
M S E = 1 m n i = 0 n j = 0 m | z i j z ¯ i j | 2
(b)
Root mean square error (RMSE)
R M S E = 1 m n i = 0 n j = 0 m | z i j z ¯ i j | 2
(c)
Feature similarity (FSIM) index on the domain Ω
F S I M = x Ω S P G C ( x ) · P C m ( x ) x Ω P C m ( x ) , x ϵ Ω
where,
S P C G ( x ) = [ S P C ( x ) ] · [ S G M ( x ) ]
with
S P C ( x ) = 2 P C O ( x ) · P C I ( x ) + T P P C O 2 ( x ) + P C I 2 ( x ) + T P ,   S G M ( x ) = 2 G M O ( x ) · G M I ( x ) + T G G M O 2 ( x ) + G M I 2 ( x ) + T G

3.3. Parameter Selection

The parametric values are required as inputs to run the proposed function that is used to interpolate the tested image. The parameter selection was done by simulation using MATLAB software version 2015 on version on an Intel® Core™ i5-8250U 1.60 GHz. The stopping criteria used was a PSNR value. If the PSNR value is higher, then the scheme gives a better interpolation image [1]. Figure 3 below shows the steps of parameter simulation:
The parametric values for α i , j , β i , j , γ i , j , α ^ i , j , β ^ i , j and γ ^ i , j are varied from lowest value, 0.1, to the highest (optimum value) until the highest PSNR is reached. The list of parameters with different values for the image of “fishing boat” are explained in Table 5, where P1–P27 are the parametric values, and the impact of the parameter set towards PSNR is illustrated graphically in Figure 4 and Figure 5. Based on the Figure 4 and Figure 5, the highest PSNR value obtained among the parameter set (P1–P27) is P10, with values 39.80 and 38.02 for the factors 2 and 4, respectively. Hence, parameter set P10 is used as reference to alter the value of each parameters as shown in Table 6. Table 7 displays the list of parametric values that used in proposed function for all tested images for image upscaling with the factors two and four respectively.

4. Result and Discussion

In this section, the proposed rational bi-cubic Ball image interpolation scheme as defined in Equation (5) is tested and compared with some existing scheme. Ten tested grayscale images with size 256 × 256 pixels were chosen, and are shown in Figure 6. The tested images were done with sampling with factors two or four first, to get low-resolution which later one re-upscale with the same factor using the proposed rational bi-cubic Ball function.
The comparison results in terms of PSNR, RMSE and FSIM between the proposed scheme and others are denoted BB. Some existing schemes, such as the conventional method for interpolation are denoted as follows: nearest neighbor (NN), bilinear (BL) and bi-cubic spline (BC), bi-cubic Hermite (BH) and Karim and Saaban [11] (KS). They are shown in Table 8, Table 9 and Table 10. Concerning overall results, we have concluded the proposed scheme gives better results for almost all images, as highlighted in the Table 8, Table 9 and Table 10, compared to existing schemes for various types of IQA used in this study.
Figure 7 and Figure 8 show the comparison of PSNR values between image upscaling with factors two and four. Meanwhile, Figure 9 and Figure 10, show the bar charts for the RMSE values for factors two and four, respectively. Figure 11 and Figure 12, show the FSIM values for image upscaling with factors two and four, respectively. Figure 7, Figure 8, Figure 9, Figure 10, Figure 11 and Figure 12 were obtained by using the information gathered in Table 8, Table 9 and Table 10.
From the numerical experiments by using ten different grayscale images, we found that the proposed scheme, i.e., the rational bi-cubic Ball function, gave higher PSNR values for all images compared with well-established schemes; i.e., bilinear, nearest neighbor, bi-cubic Hermite spline, bi-cubic spline and Karim and Saaban [11]. Image upscaling with a factor of two gave higher PSNR values compared with image upscaling with a factor of four. The main reason is that, to upscale the image four times, then the size of the images will be four times larger than the original image. This will result the low quality, to an extent, in the upscaled images. But the results still better than the other five schemes. In term of FSIM, we found that for all images the proposed scheme is better than the other schemes, as can be seen in Table 10. Finally, in terms of RMSE, we found that the proposed scheme gave smaller value for most images. The results were obtained by simulation to find the best parametric values that would give the best results. This can be considered a new finding, since in [11] there were no free parameters to refine the image interpolation.

5. Conclusions

The numerical comparison of the rational bi-cubic Ball with the existing schemes has been done in detail, and the results show that the proposed scheme gives comparable results, with some advantages. Based on Figure 13 and Figure 14, it can be seen clearly that the proposed scheme can improve the image quality after rescaling with factors of two and four, compared to existing schemes and conventional methods. Moreover, the proposed scheme is a good alternative to the existing scheme for all tested images and we can achieve a smaller error. We conclude that, based on PSNR, RMSE and FSIM, and comparison with all five schemes, the proposed scheme is better. For future research, we intend to apply the genetic algorithm (GA) to determine the optimum parameters automatically. Furthermore, the proposed scheme can be implemented in different applications of image interpolation, such as image zooming and image rotation.

Author Contributions

Conceptualization, N.A.B.Z. and, S.A.A.K.; formal analysis, M.S., A.G. and K.S.N.; software, N.A.B.Z., S.A.A.K., A.B.S. and M.S.; writing—original draft, N.A.B.Z., S.A.A.K., A.B.S. and M.S.; writing—review and editing, S.A.A.K., A.G. and K.S.N.

Funding

This study was fully supported by the Universitas Islam Riau (UIR), Pekan baru, Indonesia and the Universiti Teknologi PETRONAS (UTP), Malaysia, through International Collaborative Research Funding (ICRF): 015ME0-037, and Universiti Teknologi PETRONAS (UTP), through its research grant YUTP:0153AA-H24. The first author is sponsored by UTP’s under Graduate Assistant Scheme.

Acknowledgments

The authors would like to thanks to Universiti Teknologi PETRONAS (UTP) for providing MATLAB software for the implementation of the algorithm.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Charbit, M.; Blanchet, G. Digital Signal and Image Processing Using MATLAB (ISTE). Wiley-ISTE: Great Britain, UK, 2006. [Google Scholar]
  2. Wood, G.; Gonzalez, R.C. Digital Image Processing; Pearson Education Inc.: Upper Saddle River, NJ, USA, 2010. [Google Scholar]
  3. Gao, S.; Zhang, C.; Zhang, Y. A New Algorithm for Image Resizing Based on Bivariate Rational Interpolation. In International Conference on Computational Science; Springer: Berlin/Heidelberg, Germany, 2009; pp. 770–779. [Google Scholar] [Green Version]
  4. Gao, S.; Zhang, C.; Zhang, Y.; Zhou, Y. Medical image zooming algorithm based on bivariate rational interpolation. In International Symposium on Visual Computing; Springer: Berlin/Heidelberg, Germany, 2008; pp. 672–681. [Google Scholar]
  5. Wang, Q.; Tan, J. Multi-focus image fusion algorithm based on rational spline. In Proceedings of the 2007 10th IEEE International Conference on Computer-Aided Design and Computer Graphics, Beijing, China, 15–18 October 2007; pp. 225–229. [Google Scholar]
  6. Yao, X.; Zhang, Y.; Bao, F.; Zhang, C. Rational Spline Image Upscaling with Constraint Parameters. Math. Comput. Appl. 2016, 21, 48. [Google Scholar] [CrossRef]
  7. Zhang, C.Q.; Zhang, Y.N.; Zhang, C.M. Surface Constraint of a Rational Interpolation and the Application in Medical Image Processing. Res. J. Appl. Sci. Eng. Technol. 2012, 4, 3697–3703. [Google Scholar]
  8. Zhang, Y.; Gao, S.; Zhang, C.; Chi, J. Application of a bivariate rational interpolation in image zooming. Int. J. Innov. Comput. Inform. Cont. 2009, 5, 4299–4307. [Google Scholar]
  9. Lakshman, H.; Lim, W.-Q.; Schwarz, H.; Marpe, D.; Kutyniok, G.; Wiegand, T. Image interpolation using shearlet based iterative refinement. Signal Process. Image Commun. 2015, 36, 83–94. [Google Scholar] [CrossRef] [Green Version]
  10. Hussain, M.Z.; Abbas, S.; Irshad, M. Quadratic trigonometric B-spline for image interpolation using GA. PLoS ONE 2017, 12, e0179721. [Google Scholar] [CrossRef] [PubMed]
  11. Karim, S.A.A.; Saaban, A. Shape Preserving Interpolation Using Rational Cubic Ball Function and Its Application in Image Interpolation. Math. Probl. Eng. 2017, 2017, 7459218. [Google Scholar] [CrossRef]
  12. Ball, A. CONSURF. Part one: Introduction of the conic lofting tile. Comput. Des. 1974, 6, 243–249. [Google Scholar] [CrossRef]
  13. Majeed, A.; Piah, A.R.M.; Yahya, Z.R.; Abdullah, J.Y.; Rafique, M. Construction of occipital bone fracture using B-spline curves. Comput. Appl. Math. 2017, 37, 2877–2896. [Google Scholar] [CrossRef]
  14. Majeed, A.; Piah, A.R.M.; Yahya, Z.R. Surface Reconstruction from Parallel Curves with Application to Parietal Bone Fracture Reconstruction. PLoS ONE 2016, 11, e0149921. [Google Scholar] [CrossRef] [PubMed]
  15. Abbas, S.; Hussain, M.Z.; Irshad, M. GA Based Rational cubic B-Spline Representation for Still Image Interpolation. Pak. J. Stat. Oper. Res. 2016, 12, 753–763. [Google Scholar] [CrossRef]
  16. Abbas, S.; Hussain, M.Z.; Irshad, M. Image interpolation by rational ball cubic B-spline representation and genetic algorithm. Alex. Eng. J. 2018, 57, 931–937. [Google Scholar] [CrossRef]
  17. Saaban, A.; Kherd, A.; Jameel, A.F.; Akhadkulov, H.; Alipiah, F.M. Image enlargement using biharmonic Said-Ball surface. J. Phys. Conf. Ser. 2017, 890, 012086. [Google Scholar] [CrossRef] [Green Version]
  18. Karim, S.A.A. Shape preserving by using rational cubic ball interpolant. Far East J. Math. Sci. 2015, 96, 211. [Google Scholar]
  19. Zhang, L.; Zhang, L.; Mou, X.; Zhang, D. FSIM: A Feature Similarity Index for Image Quality Assessment. IEEE Trans. Image Process. 2011, 20, 2378–2386. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Pixel points of image.
Figure 1. Pixel points of image.
Mathematics 07 01045 g001
Figure 2. Flowchart steps of image scaling.
Figure 2. Flowchart steps of image scaling.
Mathematics 07 01045 g002
Figure 3. Flowchart steps of image scaling.
Figure 3. Flowchart steps of image scaling.
Mathematics 07 01045 g003
Figure 4. The impact of the parameter set towards PSNR for image upscaling with factor two.
Figure 4. The impact of the parameter set towards PSNR for image upscaling with factor two.
Mathematics 07 01045 g004
Figure 5. The impact of parameter set towards PSNR for image upscaling with factor four.
Figure 5. The impact of parameter set towards PSNR for image upscaling with factor four.
Mathematics 07 01045 g005
Figure 6. The original tested images used for image upscaling; (a) fishing boat; (b) baboon; (c) couple; (d) watch; (e) man; (f) girl; (g) city; (h) sails; (i) dome; (j) house.
Figure 6. The original tested images used for image upscaling; (a) fishing boat; (b) baboon; (c) couple; (d) watch; (e) man; (f) girl; (g) city; (h) sails; (i) dome; (j) house.
Mathematics 07 01045 g006
Figure 7. A comparison of schemes in regard to PSNR for image upscaling with a factor of two.
Figure 7. A comparison of schemes in regard to PSNR for image upscaling with a factor of two.
Mathematics 07 01045 g007
Figure 8. A comparison of schemes in regard to PSNR for image upscaling with a factor of four.
Figure 8. A comparison of schemes in regard to PSNR for image upscaling with a factor of four.
Mathematics 07 01045 g008
Figure 9. A comparison of schemes toward RMSE for image upscaling with a factor of two.
Figure 9. A comparison of schemes toward RMSE for image upscaling with a factor of two.
Mathematics 07 01045 g009
Figure 10. A comparison of schemes toward RMSE for image upscaling with a factor of four.
Figure 10. A comparison of schemes toward RMSE for image upscaling with a factor of four.
Mathematics 07 01045 g010
Figure 11. A comparison of schemes toward FSIM for image upscaling with a factor of four.
Figure 11. A comparison of schemes toward FSIM for image upscaling with a factor of four.
Mathematics 07 01045 g011
Figure 12. Comparison of schemes toward FSIM for image upscaling with a factor of four.
Figure 12. Comparison of schemes toward FSIM for image upscaling with a factor of four.
Mathematics 07 01045 g012
Figure 13. The interpolating image upscaling with a factor of two: (a) nearest neighbor; (b) bilinear; (c) bicubic; (d) bicubic Hermite; (e) Karim and Saaban [11]; (f) the proposed method.
Figure 13. The interpolating image upscaling with a factor of two: (a) nearest neighbor; (b) bilinear; (c) bicubic; (d) bicubic Hermite; (e) Karim and Saaban [11]; (f) the proposed method.
Mathematics 07 01045 g013
Figure 14. The interpolating image upscaling with a factor of four: (a) nearest neighbor; (b) bilinear; (c) bicubic; (d) bicubic Hermite; (e) Karim and Saaban [11]; (f) the proposed method.
Figure 14. The interpolating image upscaling with a factor of four: (a) nearest neighbor; (b) bilinear; (c) bicubic; (d) bicubic Hermite; (e) Karim and Saaban [11]; (f) the proposed method.
Mathematics 07 01045 g014
Table 1. Literature review.
Table 1. Literature review.
SchemeFeatures
Gao et al. [3]Advantage: Resizing image can preserve clear and sharp borders.
Disadvantage: Unable to interpolate the image data points with abrupt data change.
Gao et al. [4]Advantage: Can maintain clear border of zoomed image, the algorithm is simple and efficient in computation.
Disadvantage: Have no free parameters in description.
Wang and Tan [5]Advantage: Extend univariate rational quartic spline with linear denominator for image fusion.
Disadvantage: Modification of the first partial derivative at the respective knots must satisfy the monotonicity conditions.
Yao et al. [6]Advantage: Apply the parameter optimization to get the optimal shape parameters.
Disadvantage: The combination methods have complicated forms, and do not meet the needs of timeliness and practicality.
Zhang et al. [7]Advantage: Have free parameters to modify any point of interpolating region without changing the data.
Disadvantage: Have only 2 parameters in description.
Zhang et al. [8]Advantage: The simplicity of the method, gives high performance and able to maintain the borders of source images clearly.
Disadvantage: Have no free parameters in description.
Lakshman et al. [9]Advantage: For the sparse modelling, a shear let dictionary is chosen to yield a multiscale directional representation.
Disadvantage: Its concept is difficult to understand and to implement.
Hussain et al. [10]Advantage: Have free parameters to modify the interpolating image data points and using Genetic Algorithm (GA) to find the optimum value of parameters.
Disadvantage: Have only two parameters in description.
Karim and Saaban [11]Advantage: Have free parameters to modify the interpolating image data points.
Disadvantage: Have only two parameters in description.
Abbas et al. [15]Advantage: The scheme designed by using the rational cubic spline with 2 parameters in description and GA is used to optimal the value of parameters.
Disadvantage: Requires additional knots and extra computation times.
Abbas et al. [16]Advantage: Use GA to find the optimum value of parameters.
Disadvantage: More computation times are required in order to implement the GA method.
Saaban et al. [17]Advantage: The scheme is simple and easy to implement.
Disadvantage: Have no parameters to modify the interpolating image.
Table 2. Summary on some related literature review.
Table 2. Summary on some related literature review.
Scheme/FeaturesGASplineOthers
Gao et al. [3]
Gao et al. [4]
Wang and Tan [5]
Yao et al. [6]
Zhang et al. [7]
Zhang et al. [8]
Lakshman et al. [9] Wavelet based
Hussain et al. [10] B-spline
Karim and Saaban [11]
Abbas et al. [15]
Abbas et al. [16]
Saaban et al. [17] Biharmonic Said-Ball
Table 3. List of abbreviations.
Table 3. List of abbreviations.
AbbreviationDefinition
Image upscalingResizing the digital image by increase the pixels by certain factor.
Free parameterVariable in the proposed scheme used to refine the image resolution.
IQAThe final quality assessment of interpolating image that cannot be perceived by human eyes.
PSNRRatio between the maximal power of the reference image and the noise power of interpolated image.
RMSEAverage pixels error between the two images such as reference image and interpolating image.
FSIMSimilarity in features between two images such as reference image and interpolating image.
Table 4. List of symbols.
Table 4. List of symbols.
SymbolsDefinition
m ,   n Image pixels
z i , j Input pixel indexes for grayscale intensity
z ¯ i , j Interpolating input pixels
P C O Phase congruency of the original image.
P C I Phase congruency of the interpolation image.
G M O Gradient magnitude of the original image.
G M I Gradient magnitude of the interpolation image.
T P Constant to increase the stability of S P C .
T G Positive constant depending on the dynamic range of gradient magnitude values.
Ω Whole image spatial domain
Table 5. The impact of parametric values on the peak signal-to-noise ratio (PSNR) values.
Table 5. The impact of parametric values on the peak signal-to-noise ratio (PSNR) values.
ParameterFactor 2Factor 4
α i , j β i , j γ i , j α ^ i , j β ^ i , j γ ^ i , j PSNR α i , j β i , j γ i , j α ^ i , j β ^ i , j γ ^ i , j PSNR
P10.10.10.10.10.10.139.750.10.10.10.10.10.137.99
P20.10.20.20.20.20.239.750.10.20.20.20.20.237.99
P30.20.10.20.20.20.239.720.20.10.20.20.20.237.97
P40.20.20.10.20.20.239.780.20.20.10.20.20.238.01
P50.20.20.20.10.20.239.730.20.20.20.10.20.237.99
P60.20.20.20.20.10.239.740.20.20.20.20.10.237.99
P70.20.20.20.20.20.139.770.20.20.20.20.20.138.00
P80.10.20.20.10.20.239.720.10.20.20.10.20.237.98
P90.20.10.20.20.10.239.720.20.10.20.20.10.237.97
P100.20.20.10.20.20.139.800.20.20.10.20.20.138.02
P110.20.10.10.20.10.139.750.20.10.10.20.10.137.99
P120.10.20.10.10.20.139.780.10.20.10.10.20.138.01
P130.10.10.20.10.10.239.690.10.10.20.10.10.237.96
P140.10.10.10.20.20.239.750.10.10.10.20.20.237.99
P150.20.20.20.10.10.139.750.20.20.20.10.10.137.99
P160.20.10.10.10.10.139.740.20.10.10.10.10.137.99
P170.10.20.10.10.10.139.780.10.20.10.10.10.138.01
P180.10.10.20.10.10.139.720.10.10.20.10.10.137.97
P190.10.10.10.20.10.139.760.10.10.10.20.10.138.00
P200.10.10.10.10.20.139.760.10.10.10.10.20.137.99
P210.10.10.10.10.10.239.730.10.10.10.10.10.237.99
P220.10.20.30.40.50.639.710.10.20.30.40.50.637.97
P230.60.10.20.30.40.539.690.60.10.20.30.40.537.96
P240.40.50.10.20.30.439.780.40.50.10.20.30.438.01
P250.40.50.60.10.20.339.710.40.50.60.10.20.337.97
P260.30.40.50.60.10.239.740.30.40.50.60.10.237.98
P270.20.30.40.50.60.139.770.20.30.40.50.60.137.99
Table 6. The impact of parameter values on PSNR values.
Table 6. The impact of parameter values on PSNR values.
ParameterFactor 2Factor 4
α i , j β i , j γ i , j α ^ i , j β ^ i , j γ ^ i , j PSNR α i , j β i , j γ i , j α ^ i , j β ^ i , j γ ^ i , j PSNR
P100.20.20.10.20.20.139.800.20.20.10.20.20.138.02
A10.40.40.10.40.40.139.820.40.40.10.40.40.138.02
A20.60.60.10.60.60.139.830.60.60.10.60.60.138.02
A30.80.80.10.80.80.139.830.80.80.10.80.80.138.03
A4110.1110.139.83110.1110.138.03
A5110.01110.039.84110.01110.038.03
Table 7. Parameter value for image upscaling.
Table 7. Parameter value for image upscaling.
ImageParameter
Factor 2Factor 4
α i , j β i , j γ i , j α ^ i , j β ^ i , j γ ^ i , j α i , j β i , j γ i , j α ^ i , j β ^ i , j γ ^ i , j
Fishing boat1.01.00.011.01.00.011.01.00.011.01.00.01
Baboon1.01.00.011.01.00.010.60.60.010.60.60.01
Couple0.50.50.030.50.50.030.20.20.10.20.20.1
Watch1.01.00.011.01.00.010.60.60.010.60.60.01
Man0.20.20.20.20.20.10.60.60.010.60.60.01
Girl0.50.60.10.20.30.40.50.60.10.20.30.4
City1.01.00.011.01.00.010.10.20.20.20.20.2
Sails0.80.80.010.80.80.010.60.80.010.60.60.01
Dome0.80.80.010.80.80.010.10.20.10.10.10.1
House1.01.00.011.01.00.011.01.00.011.01.00.01
Table 8. Comparison results in terms of PSNR.
Table 8. Comparison results in terms of PSNR.
FactorFactor 2Factor 4
Image/MethodNNBLBCBHKSBBNNBLBCBHKSBB
Fishing boat39.4839.0739.5739.6939.6939.8537.9237.7037.9937.9637.9638.03
Baboon37.9637.7538.2638.2038.2038.3836.5436.5336.7036.6636.6636.70
Couple38.8038.4938.9839.0139.0139.1637.0837.0237.2437.3037.3037.38
Watch39.6839.3339.8239.8639.8640.0138.2338.0338.2838.2338.2338.34
Man38.7838.5039.1139.1739.1739.3237.0236.7637.1237.2337.2337.36
Girl41.6141.2741.7842.4042.4042.2839.5339.2539.7240.3240.3240.41
City37.2336.9537.3837.3437.3437.4535.8835.7235.9235.9035.9035.96
Sails37.5937.1937.6637.6637.6637.8036.0635.8236.0836.0036.0036.10
Dome40.9240.5540.9841.1541.1541.2739.3439.2239.4439.4839.4839.55
House39.9839.5640.0340.1040.1040.2538.4038.0838.0838.3638.3638.47
Table 9. Comparison results in terms of root mean square error (RMSE).
Table 9. Comparison results in terms of root mean square error (RMSE).
FactorFactor 2Factor 4
Image/MethodNNBLBCBHKSBBNNBLBCBHKSBB
Fishing boat2.712.842.682.642.642.593.243.323.213.233.233.20
Baboon3.223.303.113.143.143.073.803.803.733.753.753.73
Couple2.933.032.872.862.862.813.573.603.503.483.483.45
Watch2.642.752.602.592.592.553.133.203.113.133.133.09
Man2.933.032.832.812.812.763.593.703.553.513.513.46
Girl2.122.202.081.931.931.962.692.782.632.462.462.43
City3.513.623.453.463.463.424.104.174.084.094.094.06
Sails3.373.533.343.343.343.284.014.124.014.044.043.99
Dome2.292.392.282.232.232.202.752.792.722.712.712.69
House2.562.682.542.522.522.483.073.183.083.083.083.04
Table 10. Comparison results in terms of feature similarity (FSIM) index.
Table 10. Comparison results in terms of feature similarity (FSIM) index.
FactorFactor 2Factor 4
Image/MethodNNBLBCBHKSBBNNBLBCBHKSBB
Fishing boat0.87540.84890.87430.87130.87130.87900.68190.73510.75070.74490.74490.7494
Baboon0.85460.80630.85030.84830.84830.86220.62690.62450.66070.65750.65750.6763
Couple0.86600.83670.86530.86100.86100.86970.65280.70340.72570.71670.71670.7274
Watch0.87040.84210.86790.86490.86490.87150.70180.72640.74280.73330.73330.7377
Man0.88080.85350.88180.87550.87550.88410.67810.72530.75070.73730.73730.7491
Girl0.91620.89890.91490.91840.91840.92270.74490.80240.81350.82000.82000.8242
City0.83210.78480.82840.82380.82380.83720.59480.60140.63890.63110.63110.6515
Sails0.84480.80910.84520.83960.83960.85090.62530.64920.68210.67250.67250.6906
Dome0.87000.84490.87050.86850.86850.87700.69470.73820.75460.74640.74640.7549
House0.85760.83120.85690.85080.85080.85880.67400.71690.73300.72610.72610.7339

Share and Cite

MDPI and ACS Style

Zulkifli, N.A.B.; Karim, S.A.A.; Shafie, A.B.; Sarfraz, M.; Ghaffar, A.; Nisar, K.S. Image Interpolation Using a Rational Bi-Cubic Ball. Mathematics 2019, 7, 1045. https://doi.org/10.3390/math7111045

AMA Style

Zulkifli NAB, Karim SAA, Shafie AB, Sarfraz M, Ghaffar A, Nisar KS. Image Interpolation Using a Rational Bi-Cubic Ball. Mathematics. 2019; 7(11):1045. https://doi.org/10.3390/math7111045

Chicago/Turabian Style

Zulkifli, Nur Atiqah Binti, Samsul Ariffin Abdul Karim, A’fza Binti Shafie, Muhammad Sarfraz, Abdul Ghaffar, and Kottakkaran Sooppy Nisar. 2019. "Image Interpolation Using a Rational Bi-Cubic Ball" Mathematics 7, no. 11: 1045. https://doi.org/10.3390/math7111045

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop