Sigmoids based on Mittag-Leffler functions: Ideas, modeling, and computational experiments

Jordan Hristov

doi:10.65112/tcmis.10073

Authors

Jordan Hristov Department of Chemical Engineering, University of Chemical Technology and Metallurgy, Sofia, Bulgaria. https://orcid.org/0000-0002-7957-8192

DOI:

https://doi.org/10.65112/tcmis.10073

Keywords:

Sigmoidal curves, logistic models, Mittag-Leffler functions, fractional derivatives

Abstract

Progress has been made in developing sigmoids derived from the Mittag-Leffler function. Generally, the Mittag-Leffler functions of one and two parameters, as well as the Atangana-Baleanu formulation, are used to substitute the traditional exponential in the Verhulst model. Sigmoid formulations have been successfully demonstrated using numerous subcases of the Mittag-Leffler function. Maple and Mathematica computing have enabled us to successfully visualize the results and identify emerging computational problems.

Downloads

Download data is not yet available.

References

[1] P. Verhulst, “Recherches math´ematiques sur la loi de d’accrooissement de la population”, Nouv.Mem. Acad.R. Soc.Belle-Lettr., Bruxelles, vol.18, pp.1-38, 1845. DOI: https://doi.org/10.3406/marb.1845.3438

[2] F.R. Oliver, “Method of estimating the logistic growth function”, J. R. Stat. Soc, vol.13, pp.57–66, 1964. https://doi.org/10.2307/2985696. DOI: https://doi.org/10.2307/2985696

[3] N. Balakrishnan, Handbook of the logistic distribution, NY:Marcel Dekker, 1992. DOI: https://doi.org/10.1201/9781482277098

[4] A. Farzad, H. Mashayekhi, H. Hassanpour, “A comparative performance analysis of differ- ent activation functions in LSTM networks for classification” , Neural Comp. Applic., 31, 2507–2521,2019. https://doi.org/10.1007/s00521-017-3210-6. DOI: https://doi.org/10.1007/s00521-017-3210-6

[5] T. Szandala, “Review and comparison of commonly used activation functions for deep neural networks”, In: Bhoi, A., Mallick, P., Liu, CM., Balas, V. (eds) Bio-inspired Neurocomputing. Studies in Computational Intelligence, vol 903. Springer, Singapore. https://doi.org/10.1007/978-981-15-5495-7_11. DOI: https://doi.org/10.1007/978-981-15-5495-7_11

[6] S.R. Dubey, S.K. Singh, B.B., Chaudhuri, “Activation functions in deep learning: A com- prehensive survey and benchmark”, Neurocomputing, 503, 92-108, 2022. https://doi.org/10.1016/j.neucom.2022.06.111. DOI: https://doi.org/10.1016/j.neucom.2022.06.111

[7] A.J.Lotka, Elements of physical biology, Baltimor:Williams and Wilkins, 1925.

[8] J. Berny, “New concepts and applications in growth phenomena”, J. Appl. Stat., vol.21, pp.161-190, 1994. https://doi.org/10.1080/757583654. DOI: https://doi.org/10.1080/757583654

[9] F.J. Richards, “A flexible growth function for empirical use”, J. Exp. Botany, vol.10, pp.290- 300,1959. http://www.jstor.org/stable/23686557. DOI: https://doi.org/10.1093/jxb/10.2.290

[10] W. Feller, ”On the logistic law of growth and its empirical verification in biology”, Acta Biotheor., vol.5, pp.51-56,1940. https://doi.org/10.1007/BF01602862. DOI: https://doi.org/10.1007/BF01602862

[11] A. Tsoularis and J. Wallace, ”Analysis of logistic growth models”, Math. Biosci., vol 179, pp.21–55, 2002. https://doi.org/10.1016/S0025-5564(02)00096-2. DOI: https://doi.org/10.1016/S0025-5564(02)00096-2

[12] J. Hristov, “The logistic models and sigmoid functions: A variety of models and solution perspectives”, Transactions on Computational Modelling and Intelligent Systems, vol.1, pp.21- 55, 2025, Article 10002, https://doi.org/10.65112/tcmis.10002. DOI: https://doi.org/10.65112/tcmis.10002

[13] M.E. Turner Jr, B.A. Blumenstein and J. L.Sebaugh, “ A generalization of the logistic law of growth”, Biometrics, vol.25, pp.577-580, 1969. https://doi.org/10.2307/2528910. DOI: https://doi.org/10.2307/2528910

[14] M.E. Turner Jr, E.L. Bradley Jr, and K. Kirk, ”A theory of growth”, Math Biosciences, vol 29, pp.367–373, 1976. https://doi.org/10.1016/0025-5564(76)90112-7. DOI: https://doi.org/10.1016/0025-5564(76)90112-7

[15] J.A. Nelder, “ The fitting of a generalization of the logistic curve”, Biometrics, vol. 17, pp.89–110,1961. https://doi.org/10.2307/2527498. DOI: https://doi.org/10.2307/2527498

[16] H. Levenbach, “A generalization of the logistic growth function and its estimation”, Statistica Neederlandica, vol.27, pp.47–54, 1973. DOI: https://doi.org/10.1111/j.1467-9574.1973.tb00207.x

[17] H. Hotelling, ”Differential equation subject to error, and population estimates”, J. Am.Stat. Asoc, vo.22,pp.283–314, 1927. https://doi.org/10.2307/2276800. DOI: https://doi.org/10.1080/01621459.1927.10502963

[18] A.A. Blumberg, ”Logistic growth rate functions”, J. Theoret. Biol., vol.11, pp.42–44,1968. https://doi.org/10.1016/0022-5193(68)90058-1. DOI: https://doi.org/10.1016/0022-5193(68)90058-1

[19] P.S. Meyer, “Bi-logistic growth”, Techol.Forecast.Soc. Change, vol.47, pp.89–102, 1994. https://doi.org/10.1016/0040-1625(94)90042-6. DOI: https://doi.org/10.1016/0040-1625(94)90042-6

[20] D. Thissen, D. Bock, H. Wainer and A.F. Roche, “Individual growth in stature: a comparison of four growth studies in the U.S.A”, Annal of Human Biology, vol.3., pp.529–542, 1976. https://doi.org/10.1080/03014467600001791. DOI: https://doi.org/10.1080/03014467600001791

[21] P. Jolicoeur and J. Pontier, ”Population growth and decline: a four parameter generalization of the logistic curve”, J.Theor.Biol., vol.141, pp.563–571, 1989. https://doi.org/10.1016/S0022-5193(89)80237-1. DOI: https://doi.org/10.1016/S0022-5193(89)80237-1

[22] J.L. Fidalgo, I.M. Ortiz Rodriguez and W.K. Wong, “Design issues for population growth models”, J. Appl.Stat., vol.38, pp.501–512, 2011. https://doi.org/10.1080/ 02664760903521419. DOI: https://doi.org/10.1080/02664760903521419

[23] T. Modis, “Fractal aspects of natural growth”, Techol.Forecast.Soc. Change, vol.47, pp.63– 73,1994. https://doi.org/10.1016/0040-1625(94)90040-X. DOI: https://doi.org/10.1016/0040-1625(94)90040-X

[24] R.D. Bock and D. Tissen, “Statistical problems of fitting individual growth curves”, in Human Physical Growth and Maturation: methodologies and factors, F.E., Jonston, A.F. Roche and C. Susanne, Eds., New York and London: Plenum Press, 1980, pp. 265–290. DOI: https://doi.org/10.1007/978-1-4684-6994-3_16

[25] K. Fujii, “Connection between growth/development and mathematical function”, Int. J.Sport and Health Sci., vol.4, pp.216–232, 2016. https://doi.org/10.5432/ijshs.4.216. DOI: https://doi.org/10.5432/ijshs.4.216

[26] R. Pearl, L.J. Reed, “ A further note on the mathematical theory of population growth”, Proc.Nat. Acad. Sci. USA, vol.8., pp.365–368, 1922. https://doi.org/10.1073/pnas.8.12.36. DOI: https://doi.org/10.1073/pnas.8.12.365

[27] R. Buis, ”On the generalization of the logistic law of growth”, Acta Bioteoretica, vol.39, pp.185–195, 1991. https://doi.org/10.1007/BF00114174. DOI: https://doi.org/10.1007/BF00114174

[28] M. Artzrouni, “Une nouvelle famille de courbes de croissance application `a la transition demographique” , Population (French Edition), vol. 41,pp. 497-509, 1986. DOI: https://doi.org/10.3917/popu.p1986.41n3.0509

[29] G. Dattoli, R. Garra, “ A note on differential equations of logistic type”, Reports in Math. Phys., 93, 301-311, 2024. https://doi.org/10.1016/S0034-4877(24)00039-9. DOI: https://doi.org/10.1016/S0034-4877(24)00039-9

[30] G. Dattoli, Torre, “ Operational methods and two variable Laguerre polynomials,” Atti.Acad. Cl. Sci. Fis. Mat., 132,1-7, 1988.

[31] D.R. Cox, “The regression analysis of binary sequences”, J. Royal. Sta. Soc., Series B, vol.20, pp.215-242, 1958. DOI: https://doi.org/10.1111/j.2517-6161.1958.tb00292.x

[32] F. Mainardi , ”On some properties of the Mittag-Leffler function e Eα(−t alpha), completely monotone for t > 0 with 0 < alpha < 1”, Discret. Contin. Dyn. Syst. Ser. B, vol. 19,pp.2267- 2278, 2014. https://doi.org/10.3934/dcdsb.2014.19.2267. DOI: https://doi.org/10.3934/dcdsb.2014.19.2267

[33] T. Simon, “Comparing Frechet and positive stable laws” , Electr. J.Probab., vol.19, pp. 1-25, 2014. https://doi.org/10.1214/EJP.v19-3058. DOI: https://doi.org/10.1214/EJP.v19-3058

[34] D. Valerio and J.T. Machado, “ On the numerical computations of the Mittag-Leffler function ”, Commun. Nonlinear Sci. Simulat., vol.19, pp. 3419-3424, 2014. https://doi.org/10.1016/j.cmsns.2014.03.014. DOI: https://doi.org/10.1016/j.cnsns.2014.03.014

[35] B. Gompertz, “On the nature of the function expressive of the law of human mortality, and on a new model of determining the value of life contingencies”, Philos.Trans.R. Soc.Lond.,vol.115, pp.513-583, 1825. https://www.jstor.org/stable/107756. DOI: https://doi.org/10.1098/rstl.1825.0026

[36] R.N. Pillai, ”On Mittag-Leffler functions and related distributions”, Ann.Inst. Statist. Math, 42, pp.157-161, 1990, https://doi.org/10.1007/BF00050786. DOI: https://doi.org/10.1007/BF00050786

[37] A.M. Mathai, ”Some properties of Mittag-Leffler functions and matrix-variate analogues: A statistical perspective”, Frac. Calc. Appl. Anal., 13, pp.113-132, 2010.

[38] G.D. Lin, ”On the Mittag-Leffler distributions”, J. Stats. Planing Inference, 74, pp.1-9, 1998. https://doi.org/10.1016/S0378-3758(98)00096-2 DOI: https://doi.org/10.1016/S0378-3758(98)00096-2

[39] K. Jayakumar and R.N. Pillai, ”The first-order autoregressive Mittag-Leffler process”, J. Appl. Prob., 30, 462-466, 1993. DOI: https://doi.org/10.1017/S0021900200117474

[40] K. Jayakumar, ”Mittag-Leffler process”, Math. Comp. Modell. 37, pp.1427-1434, 2003. https://doi.org/10.1016/S0895-7177(03)90050-1 DOI: https://doi.org/10.1016/S0895-7177(03)90050-1

[41] S. Prossdorf and A.Rathsfeld, On the integral equation of the first kind arising from a cruciform crack problem, In: Integral Equations and inverse problems, V. Petkov, R.Lararov, Eds., Longman-Harlow, pp.210-219. 1991.

[42] P.R. Johnson, Semi-sigmoidal transformation for evaluating weakly singular boundary element integrals, Int. J.Numerng.Meth.Eng, 47, 1709-1730, 2000. DOI: https://doi.org/10.1002/(SICI)1097-0207(20000410)47:10<1709::AID-NME852>3.0.CO;2-V

[43] B.I. Yun, Sigmoidal-type series expansion, ANZIAM J., vol.49, 3, pp.431-450, 2008. https://doi.org/10.1017/S1446181108000060. DOI: https://doi.org/10.1017/S1446181108000060

[44] D.V. Widder, An inversion of the Lambert transform, Math. Mag., 23, pp.171-182, 1950. https://doi.org/10.2307/3029825. DOI: https://doi.org/10.2307/3029825

[45] R.R. Goldberg, Inversion of generalized Lambert transforms, Duke Math. J., 25, pp.459-476, 1958. https://doi.org/10.1215/S0012-7094-58-02540-7.

[46] E.S. Kennedy, ”Exponential analogues of the Lambert series”, Am. J. Math., 63, pp.443-460, (1941).https://doi.org/10.2307/2371537. DOI: https://doi.org/10.2307/2371537

[47] R.R. Goldberg, ”Inversion of generalized Lambert transforms”, Duke Math. J., 25, pp.459- 476, 1958. https://doi.org/10.1215/S0012-7094-58-02540-7. DOI: https://doi.org/10.1215/S0012-7094-58-02540-7

[48] N. Hayek, B.J. Gonzalez, E.R. Negrin, ”The generalized Lambert transform on distributions of compact support”, J. Math. Anal.Appl., 275, pp.938-944, 2002. https://doi.org/10.1016/S0022-247X(02)00241-X. DOI: https://doi.org/10.1016/S0022-247X(02)00241-X

[49] J. Hristov, ”New perspectives of the Lambert-Widder transform: Singular non-local oper- ators with exponential memory”, Progress in Fractional Differentiation and Applications, vol.11, pp.547-584, https://doi.org/10.18576/pfda/110309. DOI: https://doi.org/10.18576/pfda/110309

[50] W. Weibull, ”A statistical distribution function of wide applicability”, J. Applied Mechanics, vol.18, pp.293-297, 1951. https://doi.org/10.1115/1.4010337. DOI: https://doi.org/10.1115/1.4010337

[51] M. Avrami, ”Kinetics of phase change I: General theory”, J. Chem Phys., vol.7, pp.1103– 1112, 1939. https://doi.org/10.1063/1.1750380. DOI: https://doi.org/10.1063/1.1750380

[52] M. Avrami, ”Kinetics of phase change I: Transformation-time relations for random distri- bution of nuclei”, J. Chem Phys., vol.8, pp.212–224, 1940. https://doi.org/10.1063/1.1750631. DOI: https://doi.org/10.1063/1.1750631

[53] M. Avrami, ”Kinetics of phase change I: Granulation, phase change, and microstructure”, J. Chem Phys., vol.9, pp.177–184, 1941. https://doi.org/10.1063/1.1750872. DOI: https://doi.org/10.1063/1.1750872

[54] W.A. Johnson, R.F. Mehl, ”Reaction kinetics in processes of nucleation and growth”, Trans. Am. Inst. Mining, vol.135, pp.416-458, 1939.

[55] A.N. Kolmogorov, ”A statistical theory for the recrystallization of metals”, Reports of the USSR Academy of Sciences: Materials Series, vol.3, pp.355—359, 1937.

[56] B. Cantor, The equations of materials, Oxford Univ. Press, 2020. https://doi.org/10.1093/oso/9780198851875.001.0001 DOI: https://doi.org/10.1093/oso/9780198851875.001.0001

[57] J. Hristov, ”A note on the Johnson-Mehl-Avrami-Kolmogorov kinetic model: An Attempt aiming to introduce time non-locality”, Eng, vol.6, 242025, https://doi.org/10.3390/eng6020024 DOI: https://doi.org/10.3390/eng6020024

[58] M. Caputo and M. Fabrizio, “A new definition of fractional derivative without singular kernel” Prog. Fract. Differ. Appl., vol.1, pp.73-85, 2015. http://dx.doi.org/10.12785/pfda/010201.

[59] A. Atangana and D. Baleanu, New fractional derivatives with non-local and non-singular kernel: theory and application to heat transfer model, Thermal Sci.,20, 763-769, 2016. http://doi.org/10.2298/TSCI160111018A. DOI: https://doi.org/10.2298/TSCI160111018A

[60] I.A. Mirza, D. Vieru, “Fundamental solutions to advection-diffusion equation with time- fractional Caputo-Fabrizio derivative””, Comput. Math. Appl., vol.73 , pp.1-10, 2017. https://doi.org/10.1016/j.camwa.2016.09.026 DOI: https://doi.org/10.1016/j.camwa.2016.09.026

[61] H. Yepez-Martinez, J.F. Gomez-Aguilar “A new modified definition of Caputo–Fabrizio fractional-order derivative and their applications to the Multi Step Homotopy Analysis Method (MHAM)”, Journal of Comp. Appl. Math., vol.346, pp.247-260, 2019. DOI: https://doi.org/10.1016/j.cam.2018.07.023

[62] D. Avci and A. Yetim, ”Analytical solutions to the advection-diffusion equation with the Atangana-Baleanu derivative over a finite domain”, J. BAUN Inst. Sci. Technol., vol.20, pp.382-395, 2018. https://doi.org/10.25092/baunfbed.487074. DOI: https://doi.org/10.25092/baunfbed.487074

[63] I.A. Mirza, M.S. Akram, N.A, Shah, W. Imtiaz and J.D. Chung, “Analytical solutions to the advection-diffusion equation with Atangana-Baleanu time-fractional derivative and a concentrated loading”, Alexandria Eng. J., vol.60, pp.1199-1208, 2021. https://doi.org/10.1016/j.a1199-1208ej.2020.10.043. DOI: https://doi.org/10.1016/j.aej.2020.10.043

[64] D. Avci and A., Yetim, “Analysis of advective–diffusive transport phenomena modelled via non-singular Mittag-Leffler kernel”, Mathematical Modelling of Natural Phenomena, 14, 309, 2019. https://doi.org/10.1051/mmnp/2019011. DOI: https://doi.org/10.1051/mmnp/2019011

[65] J. Hristov , “The fading memory formalism with Mittag-Leffler-type kernels as a generator of non-local operators”, Appl.Sci., vol.13, 3065, 2023. https://doi.org/10.3390/app13053065. DOI: https://doi.org/10.3390/app13053065

[66] J. Hristov , “The integrals of fractional operators with non-singular kernels: a conceptual approach, formulations, and normalization functions”, Prog. Frac. Diff. Appl., vol. 10, pp:627-662, 2024. https://doi.org/10.18576/pfda/100409. DOI: https://doi.org/10.18576/pfda/100409

[67] N. Kyurkchiev and S. Markov, “Sigmoidal functions: Some computational and modeling aspects”, Biomath Commun., vol.1, pp.1-19, 2014. http://doi.org/10.1145/j.bmc.2015.03.81. DOI: https://doi.org/10.11145/j.bmc.2015.03.081

[68] B. Sendov, Hausdorff Approximations, Boston: Kluwer, 1990. DOI: https://doi.org/10.1007/978-94-009-0673-0

[69] M. Concezzi and R.Spigler, “Some analytical and numerical properties of the Mittag-Leffler functions”, Frac. Calc. Appl. Anal., vol.18, pp.64-94, 2015. https://doi.org/10.1515/fca-2015-0006. DOI: https://doi.org/10.1515/fca-2015-0006

[70] K. Diethelm, N.J. Ford and A.D., Freed, “Detailed error analysis for a fractional Adams method“, Numer. Algorithms, vol.1, pp.31-52, 2004. https://doi.org/10.1023/B:NUMA.0000027736.85078.be. DOI: https://doi.org/10.1023/B:NUMA.0000027736.85078.be

[71] R. Gorenflo, J. Loutchko and Y. Luchko, “Computation of the Mittag-Leffler function and its derivatives”, Frac. Calc. Appl. Anal., 5, 491-518, 2002.

[72] H.J. Seybold, R. Hilfer, “Numerical algorithm for calculating the generalized Mittag-Leffler function”, SIAM J. Numer.Anal., 47, 69-88. 2008. https://doi.org/10.1137/070700280. DOI: https://doi.org/10.1137/070700280

[73] R. Garrappa, M. Popolizio, “ Evaluation of generalized Mittag-Leffler functions on the real line, Adv. Comp. Math., 39, 205-225, 2013. https://doi.org/10.1007/s10444-012-9274-z. DOI: https://doi.org/10.1007/s10444-012-9274-z

[74] R. Garrappa, “Numerical evaluation of two and three parameter Mittag-Leffler functions”, SIAM J. Numer. Anal., 53, 1350—1369, 2015. https://doi.org/10.1137/140971191. DOI: https://doi.org/10.1137/140971191

[75] N. ¨Ozdemir, F. Evirgen, “A dynamic system approach to quadratic programming problems with penalty method”, Bull. Malays. Math. Sci. Soc., 33, 1, 79–91, 2010.

[76] F. Evirgen, N. ¨Ozdemir, “ Multistage adomian decomposition method for solving NLP problems over a nonlinear fractional dynamical system”, J. Comput. Nonlinear Dynam., 6, 021003, 2011. https://doi.org/10.1115/1.4002393 DOI: https://doi.org/10.1115/1.4002393

[77] I. Podlubny, I. Petras, T. Skovranek, “ Fitting experimental data using Mittag-Leffler func- tion”, in: Proc 13th Int. Carpathian Control Conf. (ICCC), 28-31 May 2012, High Tatras, Slovakia,pp. 578–581, IEEE. https://doi.org/10.1109/CarpathianCC.2012.6228711. DOI: https://doi.org/10.1109/CarpathianCC.2012.6228711

[78] C. Fang, H. Sub and J. Gu, “Powell’s method-based nonlinear least-square data fitting for the Mittag-Leffler relaxation function”, Math.Mech.Solids, 22, 1058-1067, 2017. https://doi.org/10.1177/10812865156162. DOI: https://doi.org/10.1177/1081286515616284

[79] T. Skovranek, “The Mittag-Leffler Fitting of the Phillips Curve “, Mathematics, 7, 589, 2019. https://doi.org/10.3390/math7070589. DOI: https://doi.org/10.3390/math7070589

[80] P.A. Ryapolov, E.B. Postnikov, “Mittag–Leffler function as an approximant to the concen- trated ferrofluid’s magnetization curve”, Fractal Fract., 5, 147, 2021. https://doi.org/10.3390/fractalfract5040147. DOI: https://doi.org/10.3390/fractalfract5040147

[81] K.B. Oldham, J. Spanier, The fractional Calculus, Academic Press, New York, USA, 1974.

[82] S. Samko, A. Kilbas, O. Marichev, O., Fractional integrals and derivatives: Theory and Applications, Gordon and Breach Science Publishers, Amsterdam , 1993.

[83] M. Caputo, 1966 Estimates of anelastic dissipation in the Earth’s torsional modes, Annali Geofis., 19, 75-94, 1966. https://doi.org/10.4401/ag-5038. DOI: https://doi.org/10.4401/ag-5038

[84] M. Caputo, ”Linear model of dissipation whose Q is almost frequency independent-II”, Geophys. J.R. Astr. Soc., 13, 529–539, 1967. https://doi.org/10.1111/j.1365-246X.1967.tb02303.x. DOI: https://doi.org/10.1111/j.1365-246X.1967.tb02303.x

[85] F. Mainardi, ”Why the Mittag-Leffler function can be considered the queen of the fractional calculus?” Entropy, 22, 1359, 2020. https://doi.org/10.3390/e22121359. DOI: https://doi.org/10.3390/e22121359

[86] N.H.T. Lemes, J.P.C. dos Santos, J.P. Braga, ”A generalized Mittag-Leffler function to describe nonexponential chemical effects”, Appl. Math. Modelling, vol.40, pp.7971-7976, 2016. https://doi.org/10.1016/j.apm.2016.04.021. DOI: https://doi.org/10.1016/j.apm.2016.04.021

[87] I. Podlubny, Fractional Differential Equations, Academic Press, San Diego-Boston-New York–London-Tokyo-Toronto, 1999.

[88] R. Gorenflo, A.A. Kilbas, F. Mainardi, S.V. Rogosin, Mittag-Leffler functions, Related topics and applications, Berlin-Heidelberg, 2014 DOI: https://doi.org/10.1007/978-3-662-43930-2