Academia.eduAcademia.edu

Outline

Fast Ecoding/Decoding Algorithms for Reed-Solomon Erasure Codes

Abstract

In this paper, we present a new basis of polynomial over finite fields of characteristic two and then apply it to the encoding/decoding of Reed-Solomon erasure codes. The proposed polynomial basis allows that h-point polynomial evaluation can be computed in O(h log 2 (h)) finite field operations with small leading constant. As compared with the canonical polynomial basis, the proposed basis improves the arithmetic complexity of addition, multiplication, and the determination of polynomial degree from O(h log 2 (h) log 2 log 2 (h)) to O(h log 2 (h)). Based on this basis, we then develop the encoding and erasure decoding algorithms for the (n = 2 r , k) Reed-Solomon codes. Thanks to the efficiency of transform based on the polynomial basis, the encoding can be completed in O(n log 2 (k)) finite field operations, and the erasure decoding in O(n log 2 (n)) finite field operations. To the best of our knowledge, this is the first approach supporting Reed-Solomon erasure codes over characteristic-2 finite fields while achieving a complexity of O(n log 2 (n)), in both additive and multiplicative complexities. As the complexity leading factor is small, the algorithms are advantageous in practical applications.

Key takeaways
sparkles

AI

  1. This work achieves O(n log2(n)) complexity for encoding/decoding Reed-Solomon codes over characteristic-2 fields.
  2. The new polynomial basis reduces arithmetic complexity from O(h log2(h) log2 log2(h)) to O(h log2(h)).
  3. Encoding requires O(n log2(k)) operations while erasure decoding takes O(n log2(n)) operations.
  4. The proposed algorithms significantly outperform existing approaches, showing a 17x speedup in practical applications.
  5. The findings suggest potential for parallel processing in Reed-Solomon algorithms, enhancing efficiency further.

References (28)

  1. I. S. Reed and G. Solomon, "Polynomial codes over certain finite fields," Journal of the Society for Industrial and Applied Mathematics, vol. 8, no. 2, pp. 300-304, 1960.
  2. D. A. Patterson, G. Gibson, and R. H. Katz, "A case for redundant arrays of inexpensive disks (RAID)," SIGMOD Rec., vol. 17, no. 3, pp. 109-116, Jun. 1988.
  3. A. Aliev and P. Trifonov, "Redundant disk encoding via erasure decoding," Jan. 2 2014, US Patent App. 13/784,000. [Online]. Available: http://www.google.com/ patents/US20140006850
  4. C. Huang, H. Simitci, Y. Xu, A. Ogus, B. Calder, P. Gopalan, J. Li, and S. Yekhanin, "Erasure coding in windows azure storage," in Proceedings of the 2012 USENIX Conference on Annual Technical Conference, Boston, MA, 2012, p. 2.
  5. M. Sathiamoorthy, M. Asteris, D. Papailiopoulos, A. G. Dimakis, R. Vadali, S. Chen, and D. Borthakur, "XORing elephants: Novel erasure codes for big data," Proc. VLDB Endow., vol. 6, no. 5, pp. 325-336, Mar. 2013.
  6. J. W. Byers, M. Luby, M. Mitzenmacher, and A. Rege, "A digital fountain approach to reliable distribution of bulk data," SIGCOMM Comput. Commun. Rev., vol. 28, no. 4, pp. 56-67, Oct. 1998.
  7. S. J. Lin and W. H. Chung, "An efficient (n, k) in- formation dispersal algorithm based on Fermat number transforms," IEEE Trans. Inf. Forensics Security, vol. 8, no. 8, pp. 1371-1383, 2013.
  8. D. G. Cantor, "On arithmetical algorithms over finite fields," Journal of Combinatorial Theory, Series A, vol. 50, no. 2, pp. 285-300, 1989.
  9. J. von zur Gathen and J. Gerhard, "Arithmetic and factorization of polynomial over F 2 (extended abstract)," in Proceedings of the 1996 International Symposium on Symbolic and Algebraic Computation, Zurich, Switzer- land, 1996, pp. 1-9.
  10. S. Gao and T. Mateer, "Additive fast Fourier transforms over finite fields," IEEE Trans. Inf. Theory, vol. 56, no. 12, pp. 6265-6272, Dec 2010.
  11. F. Didier, "Efficient erasure decoding of Reed-Solomon codes," CoRR, vol. abs/0901.1886, 2009.
  12. A. Schönhage, "Schnelle multiplikation von polynomen über körpern der charakteristik 2," Acta Informatica, vol. 7, no. 4, pp. 395-398, 1977. [Online]. Available: http://dx.doi.org/10.1007/BF00289470
  13. J. Justesen, "On the complexity of decoding Reed- Solomon codes (corresp.)," IEEE Trans. Inf. Theory, vol. 22, no. 2, pp. 237-238, Mar 1976.
  14. R. Blahut, "A recursive Berlekamp-Massey algorithm," in Theory and practice of error control codes. Boston: Addison-Wesley, 1983, ch. 11.7, pp. 336-340.
  15. F. MacWilliams and N. Sloane, "Generalized BCH codes," in The Theory of Error-correcting Codes. Ox- ford: North-Holland Publishing Company, 1977, ch. 12, pp. 332-369.
  16. I. S. Reed, T. K. Truong, and L. R. Welch, "The fast decoding of Reed-Solomon codes using number theoretic transforms," in The Deep Space Network 42-35, Jet Propulsion Laboratory, Pasadena, CA, July 1976, pp. 64- 78.
  17. I. S. Reed, R. Scholtz, T.-K. Truong, and L. Welch, "The fast decoding of Reed-Solomon codes using Fermat the- oretic transforms and continued fractions," IEEE Trans. Inf. Theory, vol. 24, no. 1, pp. 100-106, Jan 1978.
  18. A. Sora and J. Lacan, "FNT-based Reed-Solomon erasure codes," in Proceedings of the 7th IEEE Conference on Consumer Communications and Networking Conference, Las Vegas, Nevada, USA, 2010, pp. 466-470.
  19. S. J. Lin and W. H. Chung, "An efficient (n, k) informa- tion dispersal algorithm for high code rate system over Fermat fields," IEEE Commun. Lett., vol. 16, no. 12, pp. 2036-2039, December 2012.
  20. X. Wu, Y. Wang, and Z. Yan, "On algorithms and complexities of cyclotomic fast Fourier transforms over arbitrary finite fields," IEEE Trans. Signal Process., vol. 60, no. 3, pp. 1149-1158, March 2012.
  21. M. Luby, "LT codes," in The 43rd Annual IEEE Sym- posium on Foundations of Computer Science, 2002, pp. 271-280.
  22. A. Shokrollahi, "Raptor codes," IEEE Trans. Inf. Theory, vol. 52, no. 6, pp. 2551-2567, June 2006.
  23. Y. Wang and X. Zhu, "A fast algorithm for the Fourier transform over finite fields and its VLSI implementation," IEEE J. Sel. Areas Commun., vol. 6, no. 3, pp. 572-577, Apr 1988.
  24. J. M. Pollard, "The fast Fourier transform in a finite field," Mathematics of computation, vol. 25, no. 114, pp. 365-374, April 1971.
  25. D. Sarwate, "Semi-fast Fourier transforms over GF(2 m )." IEEE Trans. Comput., vol. C-27, no. 3, pp. 283-285, March 1978.
  26. J. E. Gibbs and F. Pichler, "Comments on transformation of Fourier power spectra into Walsh power spectra," IEEE Trans. Audio Electroacoust., vol. EMC-13, no. 3, pp. 51-54, Aug 1971.
  27. G. Robinson, "Logical convolution and discrete Walsh and Fourier power spectra," IEEE Trans. Audio Electroa- coust., vol. 20, no. 4, pp. 271-280, Oct 1972.
  28. B. Fino and V. Algazi, "Unified matrix treatment of the fast Walsh-Hadamard transform," IEEE Trans. Comput., vol. C-25, no. 11, pp. 1142-1146, Nov 1976.

FAQs

sparkles

AI

What computational complexity does the proposed encoding algorithm achieve for Reed-Solomon codes?add

The proposed encoding algorithm achieves a computational complexity of O(n lg(n)), enabling efficient processing of Reed-Solomon codes.

How does the new polynomial basis improve polynomial evaluations over characteristic-2 fields?add

The new polynomial basis allows polynomial evaluations in O(h lg(h)) time, which is more efficient than previous methods.

What role does the formal derivative play in the decoding algorithm for Reed-Solomon codes?add

The formal derivative is computed to aid in reconstructing the erased symbols, ensuring efficient decoding processes.

How do the proposed algorithms compare with existing Reed-Solomon decoding methods?add

The proposed algorithms are approximately 17 times faster than existing methods, improving overall decoding efficiency on characteristic-2 finite fields.

What supports the claim that the new method is the first to achieve O(n lg(n)) complexity?add

This assertion is based on empirical evidence showing no prior method has lower decoding complexity for Reed-Solomon codes over characteristic-2 fields.