3D Reconstruction of Fruit Shape based on Vision and Edge Sections

Authors

  • Nasr Abdalmanan Nasr Ali Faculty of Electrical Engineering Technology, Universiti Malaysia Perlis, Kampus Alam Pauh Putra, 02600 Arau, Perlis, Malaysia.
  • Kamarulzaman Kamarudin Universiti Malaysia Perlis
  • Chee Kiang Lam Faculty of Electrical Engineering Technology, Universiti Malaysia Perlis, Kampus Alam Pauh Putra, 02600 Arau, Perlis, Malaysia.
  • Muhamad Safwan Muhamad Azmi Faculty of Mechanical Engineering Technology, Universiti Malaysia Perlis, Kampus Alam Pauh Putra, 02600 Arau, Perlis, Malaysia.
  • Abdul Halim Ismail Faculty of Electrical Engineering Technology, Universiti Malaysia Perlis, Kampus Alam Pauh Putra, 02600 Arau, Perlis, Malaysia.
  • Norasmadi Abdul Rahim Faculty of Electrical Engineering Technology, Universiti Malaysia Perlis, Kampus Alam Pauh Putra, 02600 Arau, Perlis, Malaysia
  • Wan Mohd Nooriman Wan Yahya Faculty of Electrical Engineering Technology, Universiti Malaysia Perlis, Kampus Alam Pauh Putra, 02600 Arau, Perlis, Malaysia.
  • Goh Kheng Sneah Walta Engineering Sdn. Bhd., 13600 Prai, Pulau Pinang, Malaysia.
  • Moey Lip Seng Walta Engineering Sdn. Bhd., 13600 Prai, Pulau Pinang, Malaysia.
  • Teoh Phaik Hai Walta Engineering Sdn. Bhd., 13600 Prai, Pulau Pinang, Malaysia.
  • Ong Thean Lye Walta Engineering Sdn. Bhd., 13600 Prai, Pulau Pinang, Malaysia.
  • Noor Zafira Noor Hasnan Department of Process and Food Engineering, Faculty of Engineering, Universiti Putra Malay.

DOI:

https://doi.org/10.30564/jeisr.v4i1.4585

Abstract

The fruit industry has been known as one of the largest businesses in Malaysia, where most of the fruits pass through the peeling process well in advance before the final product as juice in a bottle or slices in a can. The current industrial fruit peeling techniques are passive and inefficient by cutting parts of the pulp of the fruit with peels leading to losses. To avoid this issue, a multi-axis CNC fruit peeler can be used to precisely peel the outer layer with the guidance of a 3D virtual model of fruit. In this work, a new cost-effective method of 3D image reconstruction was developed to convert 36 fruit images captured by a normal RGB camera to a 3D model by capturing a single image every 10 degrees of fruit rotation along a fixed axis. The point cloud data extracted with edge detection were passed to Blender 3D software for meshing in different approaches. The vertical link frame meshing method developed in this research proved a qualitative similarity between the output result and the scanned fruit in a processing time of less than 50 seconds.

Keywords:

3D Reconstruction; Machine vision; Fruit processing

References

[1] Kamarubahrin, A.F., Haris, A., Mohd Daud, S.N., et al., 2020. Indigenous alternate fruit for dates: Critical review on the selection criteria for local prophetic fruits in Malaysia. Journal of Tropical Agriculture and Food Science. 48(2), 43-58.

[2] Wong, S.S., Aini, M.S., 2017. Factors influencing purchase intention of organic meat among consumers in Klang Valley, Malaysia. International Food Research Journal. 24(2), 767-778.

[3] Kohli, D., Champawat, P.S., Mudgal, V.D., et al., 2021. Advances in peeling techniques for fresh produce. Journal of Food Process Engineering. 44(10), e13826.DOI: https://doi.org/10.1111/JFPE.13826

[4] Ham, H., Wesley, J., Hendra, H., 2019. Computer vision based 3D reconstruction: A review. International Journal of Electrical and Computer Engineering. 9(4), 2394-2402. DOI: https://doi.org/10.11591/ijece.v9i4

[5] Wijayanto, I., Hadiyoso, S., Gunawan, T.M., 2018. Video Processing for Dual Laser 3D Scanner Prototype based on Cloud to Cloud Method. In 2018 International Conference on Control, Electronics, Renewable Energy and Communications (ICCEREC). pp. 149-153. IEEE. DOI: https://doi.org/10.1109/ICCEREC.2018.8712107

[6] Zhang, S., 2018. High-speed 3D shape measurement with structured light methods: A review. Optics and Lasers in Engineering. 106, 119-131. DOI: https://doi.org/10.1016/j.optlaseng.2018.02.017

[7] Xie, Z., Lang, Y., Chen, L., 2021. Geometric Modeling of Rosa roxburghii Fruit Based on Three-Dimensional Point Cloud Reconstruction. Journal of Food Quality. DOI: https://doi.org/10.1155/2021/9990499

[8] Zabatani, A., Surazhsky, V., Sperling, E., et al., 2019. Intel® realsense™ sr300 coded light depth camera. IEEE transactions on pattern analysis and machine intelligence. 42(10), 2333-2345. DOI: https://doi.org/10.1109/TPAMI.2019.2915841

[9] Fu, Y., Yan, Q., Yang, L., et al., 2018. Texture mapping for 3d reconstruction with rgb-d sensor. In Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 4645-4653. DOI: https://doi.org/10.1109/CVPR.2018.00488

[10] Yamamoto, S., Karkee, M., Kobayashi, Y., et al., 2018. 3D reconstruction of apple fruits using consumer-grade RGB-depth sensor. Engineering in Agriculture, Environment and Food. 11(4), 159-168. DOI: https://doi.org/10.1016/J.EAEF.2018.02.005

[11] O’Riordan, A., Newe, T., Dooly, G., et al., 2018. Stereo vision sensing: Review of existing systems. In 2018 12th International Conference on Sensing Technology (ICST). pp. 178-184. IEEE. DOI: https://doi.org/10.1109/ICSensT.2018.8603605

[12] Feldmann, M.J., Tabb, A., 2021. Cost-effective, high-throughput phenotyping system for 3D reconstruction of fruit form. The Plant Phenome Journal. DOI: https://doi.org/10.1002/ppj2.20029

[13] Reljić, I., Dunđer, I., Seljan, S., 2019. Photogrammetric 3D scanning of physical objects: tools and workflow. TEM Journal. 8(2), 383. DOI: https://doi.org/10.18421/TEM82-09

[14] Dostal, C., Yamafune, K., 2018. Photogrammetric texture mapping: A method for increasing the Fidelity of 3D models of cultural heritage materials. Journal of Archaeological Science: Reports. 18, 430-436. DOI: https://doi.org/10.1016/j.jasrep.2018.01.024

[15] Li, J., Berglund, J., Auris, F., et al., 2018. Evaluation of Photogrammetry for Use in Industrial Production Systems. In 2018 IEEE 14th International Conference on Automation Science and Engineering (CASE). pp. 414-420. IEEE. DOI: https://doi.org/10.1109/COASE.2018.8560496

[16] Kochi, N., Tanabata, T., Hayashi, A., et al., 2018. A 3D shape-measuring system for assessing strawberry fruits. International Journal of Automation Technology. 12(3), 395-404. DOI: https://doi.org/10.20965/ijat.2018.p0395

[17] Oinosho, T., Kameyama, M., Taguchi, A., 2021. Color Conversion Formulae between RGB Color Space and HSI Color Space for Color Image Processing. In 2021 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS). pp. 1-2. IEEE. DOI: https://doi.org/10.1109/ISPACS51563.2021.9651118

Downloads

How to Cite

Ali, N. A. N., Kamarudin, K., Lam, C. K., Azmi, M. S. M., Ismail, A. H., Rahim, N. A., Yahya, W. M. N. W., Sneah, G. K., Seng, M. L., Hai, T. P., Lye, O. T., & Hasnan, N. Z. N. (2022). 3D Reconstruction of Fruit Shape based on Vision and Edge Sections. Journal of Electronic & Information Systems, 4(1), 26–32. https://doi.org/10.30564/jeisr.v4i1.4585

Issue

Article Type

Article