Softmax Function
The soft-max function is a generalization of the logistic function that normalizes a N-dimensional vector of arbitrary real values to a range of (0,1). It is used to obtain the […]
Category Archives: Statistics
Bayesian Decision Theory
Bayesian Decision Theory (BDT), also known as Bayesian Hypothesis Testing and Bayesian inference, is a fundamental statistical approach that quantifies the tradeoffs between various decisions using distributions and costs that […]
Random Walk Processes
A random walk is defined as a process where the current value of the variable is composed of the past value plus white noise. A white noise process is a […]
Likelihood-Ratio Test
In statistics, a likelihood function is a function of the parameter values, , given outcomes . The likelihood is equal to the probability of those observed outcomes given those parameter […]
Laws of Forecasting
In my study of time series analysis I have summed up three important laws for forecasting. We assume that the future will behave like the past. Even if we know […]
Logistic Regression
In statistics and machine learning, logistic regression is a type of probabilistic classification model. An example of a classification problem is to label an email as either “spam” or “not […]
Mad Mind of a PhD Student 