Open Access. Powered by Scholars. Published by Universities.®
- Discipline
-
- Computer Sciences (465)
- Engineering (22)
- Education (19)
- Physics (18)
- Applied Mathematics (13)
-
- Statistics and Probability (13)
- Social and Behavioral Sciences (10)
- Economics (7)
- Life Sciences (6)
- Computer Engineering (5)
- Science and Mathematics Education (5)
- Electrical and Computer Engineering (4)
- Aerospace Engineering (3)
- Electrical and Electronics (3)
- Mechanical Engineering (3)
- Algebra (2)
- Artificial Intelligence and Robotics (2)
- Biochemistry, Biophysics, and Structural Biology (2)
- Bioinformatics (2)
- Biology (2)
- Civil Engineering (2)
- Civil and Environmental Engineering (2)
- Discrete Mathematics and Combinatorics (2)
- Operational Research (2)
- Operations Research, Systems Engineering and Industrial Engineering (2)
- Software Engineering (2)
- Algebraic Geometry (1)
- Applied Statistics (1)
- Keyword
-
- Technical Reports (367)
- UTEP Computer Science Department (367)
- Interval uncertainty (17)
- Fuzzy logic (11)
- Machine learning (7)
-
- Optimization (6)
- Data processing (5)
- Decision making (5)
- Interval computations (5)
- Invariance (5)
- Neural networks (5)
- Algebra (4)
- Combinatorics (4)
- Uncertainty (4)
- Causality (3)
- Classification (3)
- Explainable AI (3)
- Fuzzy control (3)
- Fuzzy uncertainty (3)
- NP-hard (3)
- Topology (3)
- Analytic (2)
- Barrett Impulsivity Scale (2)
- Cantor Set (2)
- Clustering (2)
- Complex engineering systems (2)
- Constraints (2)
- Decision making under uncertainty (2)
- Deep Learning (2)
- F-transform (2)
- Publication Year
- Publication
- Publication Type
Articles 31 - 60 of 659
Full-Text Articles in Mathematics
Why Kolmolgorov-Arnold Networks (Kan) Work So Well: A Qualitative Explanation, Hung T. Nguyen, Vladik Kreinovich, Olga Kosheleva
Why Kolmolgorov-Arnold Networks (Kan) Work So Well: A Qualitative Explanation, Hung T. Nguyen, Vladik Kreinovich, Olga Kosheleva
Departmental Technical Reports (CS)
In the usual deep neural network, weights are adjusted during training, but the activation function remains the same. Lately, it was experimentally shown that if, instead of using the same activation function always, we train the activation functions as well, we get a much better results -- i.e., for the networks with the same number of parameters, we get a much better accuracy. Such networks are called Kolmogorov-Arnold networks. In this paper, we provide a general explanation of why these new networks work so well.
How To Check Continuity Based On Approximate Measurement Results, Inese Bula, Vladik Kreinovich
How To Check Continuity Based On Approximate Measurement Results, Inese Bula, Vladik Kreinovich
Departmental Technical Reports (CS)
In many practical situations, a reasonable conjecture is that, e.g., the dependence of some quantity on the spatial location is continuous, with an appropriate bounds on the difference between the values at nearby points. If we knew the exact values of the corresponding quantity, checking this conjecture would be very straightforward. In reality, however, measurement results are only approximations to the actual values. In this paper, we show how to check continuity based on the approximate measurement results.
Three Applications Of Geometric Reasoning: Why Metastasis Is Mostly Caused By Elongated Cancer Cells? How Body Shape Affects Curiosity? Why Ring Fractures In Ice?, Julio C. Urenda, Olga Kosheleva, Vladik Kreinovich
Three Applications Of Geometric Reasoning: Why Metastasis Is Mostly Caused By Elongated Cancer Cells? How Body Shape Affects Curiosity? Why Ring Fractures In Ice?, Julio C. Urenda, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
In this paper, we describe three applications of geometric reasoning to important practical problems ranging from micro- to macro-level. Specifically, we use geometric reasoning to explain why metastasis is mostly caused by elongated cancer cell, why curiosity in fish is strongly correlated with body shape, and why ring-shaped fractures appear in Antarctica.
To Which Interdisciplinary Research Collaborations Should We Pay More Attention?, Miroslav Svitek, Olga Kosheleva, Vladik Kreinovich, Nguyen Hoang Phuong
To Which Interdisciplinary Research Collaborations Should We Pay More Attention?, Miroslav Svitek, Olga Kosheleva, Vladik Kreinovich, Nguyen Hoang Phuong
Departmental Technical Reports (CS)
Interdisciplinary research is very important in modern science. However, such a research is not easy, it often needs support and help. Resources that can be used for such a support are limited, so we need to decide which of many possible collaborations we should support. In this paper, we provide a natural simple model of collaboration effectiveness. Based on this model, we conclude that we should support collaborations for which the vector product of the participants' knowledge vectors attains the largest values.
Why Decisions Based On The Results Of Worst-Case, Most Realistic, And Best-Case Scenarios Work Well?, Miroslav Svitek, Olga Kosheleva, Vladik Kreinovich, Chon Van Le
Why Decisions Based On The Results Of Worst-Case, Most Realistic, And Best-Case Scenarios Work Well?, Miroslav Svitek, Olga Kosheleva, Vladik Kreinovich, Chon Van Le
Departmental Technical Reports (CS)
Often, to make an appropriate decision, people try three scenarios: the worst case, the most realistic case, and the best case. This three-scenarios approach often leads to reasonable decisions. A natural question is: why worst case and best case? These extreme cases mean that all numerous independent random factors work in the same direction: either are all stacked for or are all stacked against. Such stacking of random factors is highly improbable. So, at first glance, it would be more beneficial to use more realistic scenarios than the worst case and the best case. However, empirically, decisions based on the …
Why Green Wavelength Is Closer To Blue Than To Red And How It Is Related To Computations: Information-Based Explanation, Victor L. Timchenko, Yury P. Kondratenko, Olga Kosheleva, Vladik Kreinovich, Nguyen Hoang Phuong
Why Green Wavelength Is Closer To Blue Than To Red And How It Is Related To Computations: Information-Based Explanation, Victor L. Timchenko, Yury P. Kondratenko, Olga Kosheleva, Vladik Kreinovich, Nguyen Hoang Phuong
Departmental Technical Reports (CS)
In our previous papers, we analyzed the idea of using light signals of three basic color -- red, green, and blue -- to speed up computations, in particular fuzzy-related computations. A natural question is: why red, green, and blue? Why not select some other colors: e.g., from the wavelength viewpoint, green is much closer to blue than to green, so why not select colors whose distribution is more even? In this paper, we show that if we consider this problem from the information viewpoint, then the corresponding equal-information criterion indeed implies that the intermediate wavelength should be closer to the …
Training Neural Networks On Interval Data: Unexpected Results And Their Explanation, Edwin Tomy George, Vladik Kreinovich, Christoph Lauter, Martine Ceberio, Luc Jaulin
Training Neural Networks On Interval Data: Unexpected Results And Their Explanation, Edwin Tomy George, Vladik Kreinovich, Christoph Lauter, Martine Ceberio, Luc Jaulin
Departmental Technical Reports (CS)
In many practically useful numerical computations, training-and-then-using a neural network turned out to be a much faster alternative than running the original computations. When we applied a similar idea to take into account interval uncertainty, we encountered two unexpected results: (1) that while for numerical computations, it is usually better to represent an interval by its midpoint and half-width, for neural networks, it is more efficient to represent an interval by its endpoints, and (2) that while usually, it is better to train a neural network on the whole data processing algorithm, in our problems, it turned out to be …
What If The Resulting Interval Is Too Wide: From A Heuristic Fuzzy-Technique Idea To A Mathematically Justified Approach, Marc Fina, Vladik Kreinovich
What If The Resulting Interval Is Too Wide: From A Heuristic Fuzzy-Technique Idea To A Mathematically Justified Approach, Marc Fina, Vladik Kreinovich
Departmental Technical Reports (CS)
In engineering designs, we usually need to make sure that the values of some characteristics y do not exceed a certain threshold y0 – e.g., that the stress at each location does not exceed a certain critical value. Usually, we know how each of these characteristics y depends on the design parameters x1, . . . ,xn, i.e., we know the function y= f (x1, . . . ,xn). However, it is not enough to use the nominal values of the design parameters in our analysis, since the actual values are, in general, somewhat different from the nominal values. Often, …
Shapley Value Under Interval Uncertainty And Partial Information, Kittawit Autchariyapanikul, Olga Kosheleva, Vladik Kreinovich
Shapley Value Under Interval Uncertainty And Partial Information, Kittawit Autchariyapanikul, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
In the 1950s, the future Nobelist Lloyd Shapley solved the problem of how to fairly divide the common gain. Namely, he showed that some reasonable requirements determine a unique division -- which is now known as the Shapley value. The main limitation of Shapley's solution is that it assumes that for each subgroup of the original group of participants, we know exactly how much this group could gain if it acted by itself, without involving others. In practice, we rarely know these exact values. At best, we know the bounds on each such value -- i.e., in other words, an …
Experimental And Computational Investigation Of Green Laser Propagation Through Turbulent Medium In A Water Tank, Richard Owusu Adansi
Experimental And Computational Investigation Of Green Laser Propagation Through Turbulent Medium In A Water Tank, Richard Owusu Adansi
Open Access Theses & Dissertations
Turbulence medium poses significant challenges to the propagation of laser beams, impacting applications such as free-space optical communication, remote sensing, and laser weapons systems. Therefore, comprehending and mitigating turbulence effects are vital for enhancing the performance of these systems. Analysis of a strong turbulence impact on electromagnetic wave propagation requires extensive knowledge of the Earth's atmospheric and Oceanic phenomena and Maxwell's electromagnetic theory of light as a propagating wave of electric and magnetic fields. Optical systems' propagation often encounters Strong Turbulence, causing interference and diffraction. Nonetheless, light propagation through randomly fluctuating media has been an exciting and active area of …
Robust Multivariate Estimation And Inference With The Minimum Density Power Divergence Estimator, Ebenezer Nkum
Robust Multivariate Estimation And Inference With The Minimum Density Power Divergence Estimator, Ebenezer Nkum
Open Access Theses & Dissertations
The estimation of the location vector and scatter matrix plays a crucial role in many multivariate statistical methods. However, the classical likelihood-based estimation is greatly influenced by outliers, potentially leading to unreliable decisions. Hence, a fundamental challenge in multivariate statistics is to develop robust alternatives that can maintain performancein the presence of outliers and deviations from the assumed data distribution. Unfortunately, methods with good global robustness often substantially sacrifice efficiency. To address this, we propose the adoption of Minimum Density Power Divergence (MDPD) estimation, a well-established robust technique known for its efficiency and statistical robustness to outliers and model violations. …
If Subsequent Results Are Too Easy To Obtain, The Proof Most Probably Has Errors: Explanation Of The Empirical Observation, Olga Kosheleva, Vladik Kreinovich
If Subsequent Results Are Too Easy To Obtain, The Proof Most Probably Has Errors: Explanation Of The Empirical Observation, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
Many modern mathematical proofs are very complex, checking them is difficult; as a result, errors sneak into published proofs, even into proofs published in highly reputable journals. Sometimes, the errors are repairable, but sometimes, it turns out that the supposedly proven result is actually wrong. When the error is not noticed for some time, the published result is used to prove many other results -- and when the error is eventually found, all these new results are invalidated. This happened several times. Since it is not realistic to more thoroughly check all the proofs, and we want to minimize the …
Why Angles Between Galactic Center Filaments And Galactic Plane Follow A Bimodal Distribution: A Symmetry-Based Explanation, Julio C. Urenda, Vladik Kreinovich
Why Angles Between Galactic Center Filaments And Galactic Plane Follow A Bimodal Distribution: A Symmetry-Based Explanation, Julio C. Urenda, Vladik Kreinovich
Departmental Technical Reports (CS)
Recent observations have shown that the angles between the Galaxy Center filaments and the Galactic plane follow a bimodal distribution: a large number of filaments are approximately orthogonal to the Galactic plane, a large number of filaments are approximately parallel to the Galactic plane, and much fewer filaments have other orientations. In this paper, we show this bimodal distribution can be explained by natural geometric symmetries.
Why Seismicity In Ireland Is Low: A Possible Geometric Explanation, Julio C. Urenda, Aaron Velasco, Vladik Kreinovich
Why Seismicity In Ireland Is Low: A Possible Geometric Explanation, Julio C. Urenda, Aaron Velasco, Vladik Kreinovich
Departmental Technical Reports (CS)
For each geographic location, its seismicity level is usually determined by how close this location is to the boundaries of tectonic plates. However, there is one notable exception: while Ireland and Britain are at approximately the same distance from such boundaries, the seismicity level in Ireland is much lower than in Britain. A recent paper provided a partial explanation for this phenomenon: namely, it turns out that the lithosphere under Ireland is unusually thick, and this can potentially lead to lower seismicity. However, the current explanation of the relation between the lithosphere thickness and seismicity level strongly depends on the …
Is Alaska Negative-Tax Arrangement Fair? Almost: Mathematical Analysis, Chon Van Le, Vladik Kreinovich
Is Alaska Negative-Tax Arrangement Fair? Almost: Mathematical Analysis, Chon Van Le, Vladik Kreinovich
Departmental Technical Reports (CS)
In the State of Alaska there is no state income tax. Instead, there is a negative tex: every year every resident gets some money from the state. At present, every resident -- from the poorest to the richest -- gets the exact same amount of money: in 2024, it is expected to be around $1500. A natural question is: Is this fair? Maybe poor people should get more since their needs are greater? Maybe the rich people should get proportionally more, since fairness means equal added happiness for all, and for rich people, extra $1500 is barely noticeable? There have …
For 2 X N Cases, Proportional Fitting Problem Reduces To A Single Equation, Olga Kosheleva, Vladik Kreinovich
For 2 X N Cases, Proportional Fitting Problem Reduces To A Single Equation, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
In many practical situations, for each of two classifications, we know the probabilities that a randomly selected object belong to different categories. For example, we know what proportion of people are below 20 years old, what proportion is between 20 and 30, etc., and we also know what proportion of people earns less than 10K, between 10K and 20K, etc. In such situations, we are often interested in proportion of people who are classified by two classifications into two given categories. For example, we are interested in the proportion of people whose age is between 20 and 30 and whose …
Stochastic Dominance: Cases Of Interval And P-Box Uncertainty, Kittawit Autchariyapanikul, Olga Kosheleva, Vladik Kreinovich
Stochastic Dominance: Cases Of Interval And P-Box Uncertainty, Kittawit Autchariyapanikul, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
Traditional decision theory recommendation about making a decision assume that we know both the probabilities of different outcomes of each possible decision, and we know the utility function -- that describes the decision maker's preferences. Sometimes, we can make a recommendation even when we only have partial information about utility. Such cases are known as cases of stochastic dominance. In other cases, in addition to not knowing the utility function, we also only have partial information about the probabilities of different outcomes. For example, we may only known bounds on the outcomes (case of interval uncertainty) or bounds on the …
How To Propagate Uncertainty Via Ai Algorithms, Olga Kosheleva, Vladik Kreinovich
How To Propagate Uncertainty Via Ai Algorithms, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
Any data processing starts with measurement results. Measurement results are never absolutely accurate. Because of this measurement uncertainty, the results of processing measurement results are, in general, somewhat different from what we would have obtained if we knew the exact values of the measured quantities. To make a decision based on the result of data processing, we need to know how accurate is this result, i.e., we need to propagate the measurement uncertainty through the data processing algorithm. There are many techniques for uncertainty propagation. Usually, they involve applying the same data processing algorithm several times to appropriately modified data. …
For Discrete-Time Linear Dynamical Systems Under Interval Uncertainty, Predicting Two Moments Ahead Is Np-Hard, Luc Jaulin, Olga Kosheleva, Vladik Kreinovich
For Discrete-Time Linear Dynamical Systems Under Interval Uncertainty, Predicting Two Moments Ahead Is Np-Hard, Luc Jaulin, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
In the first approximation, when changes are small, most real-world systems are described by linear dynamical equations. If we know the initial state of the system, and we know its dynamics, then we can, in principle, predict the system's state many moments ahead. In practice, however, we usually know both the initial state and the coefficients of the system's dynamics with some uncertainty. Frequently, we encounter interval uncertainty, when for each parameter, we only know its range, but we have no information about the probability of different values from this range. In such situations, we want to know the range …
How To Make Ai More Reliable, Olga Kosheleva, Vladik Kreinovich
How To Make Ai More Reliable, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
One of the reasons why the results of the current AI methods (especially deep-learning-based methods) are not absolutely reliable is that, in contrast to more traditional data processing techniques which are based on solid mathematical and statistical foundations, modern AI techniques use a lot of semi-heuristic methods. These methods have been, in many cases, empirically successful, but the absence of solid justification makes us less certain that these methods will work in other cases as well. To make AI more reliable, it is therefore necessary to provide mathematical foundations for the current semi-heuristic techniques. In this paper, we show that …
What To Do If An Inflexible Tolerance Problem Has No Solutions: Probabilistic Justification Of Piegat's Semi-Heuristic Idea, Olga Kosheleva, Vladik Kreinovich
What To Do If An Inflexible Tolerance Problem Has No Solutions: Probabilistic Justification Of Piegat's Semi-Heuristic Idea, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
In many practical situations, it is desirable to select the control parameters x1, ..., xn in such a way that the resulting quantities y1, ..., ym of the system lie within desired ranges. In such situations, we usually know the general formulas describing the dependence of yi on xj, but the coefficients of these formulas are usually only known with interval uncertainty. In such a situation, we want to find the tuples for which all yi's are in the desired intervals for all possible tuples of coefficients. But what if no such parameters are possible? Since we cannot guarantee the …
Why Magenta Is Not A Real Color, And How It Is Related To Fuzzy Control And Quantum Computing, Victor L. Timchenko, Yuriy P. Kondratenko, Olga Kosheleva, Vladik Kreinovich
Why Magenta Is Not A Real Color, And How It Is Related To Fuzzy Control And Quantum Computing, Victor L. Timchenko, Yuriy P. Kondratenko, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
It is well known that every color can be represented as a combination of three basic colors: red, green, and blue. In particular, we can get several colors by combining two of the basic colors. Interestingly, while a combination of two neighboring colors leads to a color that corresponds to a certain frequency, the combination of two non-neighboring colors -- red and blue -- leads to magenta, a color that does not correspond to any frequency. In this paper, we provide a simple explanation for this phenomenon, and we also show that a similar phenomenon happens in two other areas …
Why Fully Consistent Quantum Field Theories Require That The Space-Time Be At Least 10-Dimensional: A Commonsense Field-Based Explanation, Olga Kosheleva, Vladik Kreinovich
Why Fully Consistent Quantum Field Theories Require That The Space-Time Be At Least 10-Dimensional: A Commonsense Field-Based Explanation, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
It is known that quantum field theories that describe fields in our usual 4-dimensional space-times are not fully consistent: they predict meaningless infinite values for some physical quantities. There are some known tricks to avoid such infinities, but it is definitely desirable to have a fully consistent theory, a theory that would produce correct results without having to use additional tricks. It turns out that the only way to have such a theory is to consider space-times of higher dimensions, the smallest of which is 10. There are complex mathematical reasons for why 10 is the smallest such dimension. However, …
Towards A More Subtle (And Hopefully More Adequate) Fuzzy "And"-Operation: Normalization-Invariant Multi-Input Aggregation Operators, Yusuf Güven, Vladik Kreinovich
Towards A More Subtle (And Hopefully More Adequate) Fuzzy "And"-Operation: Normalization-Invariant Multi-Input Aggregation Operators, Yusuf Güven, Vladik Kreinovich
Departmental Technical Reports (CS)
Many reasonable conditions have been formulated for a fuzzy "and"-operation: idempotency, commutativity, associativity, etc. It is known that the only "and"-operation that satisfies all these conditions is minimum, but minimum is not the most adequate description of expert's "and", and it often does not lead to the best control or the best decision. Many other more adequate "and"-operations (t-norms) have been proposed and effectively used, but they do not satisfy the natural idempotency condition. In this paper, we show that a small relaxation of the usual description of "and"-operations leads to the possibility of non-minimum idempotent operations. We also show …
Why Empirical Membership Functions Are Well-Approximated By Piecewise Quadratic Functions: Theoretical Explanation For Empirical Formulas Of Novak's Fuzzy Natural Logic, Olga Kosheleva, Vladik Kreinovich
Why Empirical Membership Functions Are Well-Approximated By Piecewise Quadratic Functions: Theoretical Explanation For Empirical Formulas Of Novak's Fuzzy Natural Logic, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
Empirical analysis shows that membership functions describing expert opinions have a shape that is well described by a smooth combination of two quadratic segments. In this paper, we provide a theoretical explanation for this empirical phenomenon.
Why Is Grade Distribution Often Bimodal? Why Individualized Teaching Adds Two Sigmas To The Average Grade? And How Are These Facts Related?, Christian Servin, Olga Kosheleva, Vladik Kreinovich
Why Is Grade Distribution Often Bimodal? Why Individualized Teaching Adds Two Sigmas To The Average Grade? And How Are These Facts Related?, Christian Servin, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
To make education more effective, to better use emerging technologies in education, we need to better understand the education process, to gain insights on this process. How can we check whether a new idea is indeed a useful insight? A natural criterion is that the new idea should explain some previously-difficult-to-explain empirical phenomenon. Since one of the main advantages of emerging educational technologies -- such as AI -- is the possibility of individualized education, a natural phenomenon to explain is the fact -- discovered by Benjamin Bloom -- that individualization adds two sigmas to the average grade. In this paper, …
Topics In The Study Of The Pragmatic Functions Of Phonetic Reduction In Dialog, Nigel G. Ward, Carlos A. Ortega
Topics In The Study Of The Pragmatic Functions Of Phonetic Reduction In Dialog, Nigel G. Ward, Carlos A. Ortega
Departmental Technical Reports (CS)
Reduced articulatory precision is common in speech, but for dialog its acoustic properties and pragmatic functions have been little studied. We here try to remedy this gap. This technical report contains content that was omitted from the journal article (Ward et. al, submitted). Specifically, we here report 1) lessons learned about annotating for perceived reduction, 2) the finding that, unlike in read speech, the correlates of reduction in dialog include high pitch, wide pitch range, and intensity, and 3) a baseline model for predicting reduction in dialog, using simple acoustic/prosodic features, that achieves correlations with human perceptions of 0.24 for …
How To Make A Neural Network Learn From A Small Number Of Examples -- And Learn Fast: An Idea, Chitta Baral, Vladik Kreinovich
How To Make A Neural Network Learn From A Small Number Of Examples -- And Learn Fast: An Idea, Chitta Baral, Vladik Kreinovich
Departmental Technical Reports (CS)
Current deep learning techniques have led to spectacular results, but they still have limitations. One of them is that, in contrast to humans who can learn from a few examples and learn fast, modern deep learning techniques require a large amount of data to learn, and they take a long time to train. In this paper, we show that neural networks do have a potential to learn from a small number of examples -- and learn fast. We speculate that the corresponding idea may already be implicitly implemented in Large Language Models -- which may partially explain their (somewhat mysterious) …
How Can We Explain Empirical Formulas For Shrinkage Cracking Of Cement-Stabilized Pavement Layers, Edgar Daniel Rodriguez Velasquez, Vladik Kreinovich
How Can We Explain Empirical Formulas For Shrinkage Cracking Of Cement-Stabilized Pavement Layers, Edgar Daniel Rodriguez Velasquez, Vladik Kreinovich
Departmental Technical Reports (CS)
In pavement construction, one of the frequent defects is shrinkage cracking of the cement-stabilized pavement layer. To minimize this defect, it is important to be able to predict how this cracking depends on the quantities describing the pavement layer and the corresponding environment. Cracking is usually described by two parameters: the average width of the crack and the crack spacing. Empirical analysis shows that the dependence of the width on all related quantities is described by a power law. Power laws are ubiquitous in physics, they describe a frequent case when the dependence is scale-invariant -- i.e., does not change …
Update From Aristotle To Newton, From Sets To Fuzzy Sets, And From Sigmoid To Relu: What Do All These Transitions Have In Common?, Christian Servin, Olga Kosheleva, Vladik Kreinovich
Update From Aristotle To Newton, From Sets To Fuzzy Sets, And From Sigmoid To Relu: What Do All These Transitions Have In Common?, Christian Servin, Olga Kosheleva, Vladik Kreinovich
Departmental Technical Reports (CS)
In this paper, we show that there is a -- somewhat unexpected -- common trend behind several seemingly unrelated historic transitions: from Aristotelian physics to modern (Newton's) approach, from crisp sets (such as intervals) to fuzzy sets, and from traditional neural networks, with close-to-step-function sigmoid activation functions to modern successful deep neural networks that use a completely different ReLU activation function. In all these cases, the main idea of the corresponding transition can be explained, in mathematical terms, as going from the first order to second order differential equations.