3 D Statistical Learning

Introduction to Statistical Decision Theory – Edition 1: From Traditional Statistical Methods to Decision Theory

1. Basic Idea Statistics is the science of learning from data. It has two main purposes: To describe what has been observed. To make inferences about the wider world beyond the observed data. Often, we…

Introduction to Statistical Decision Theory – Edition 2: Foundations of Estimation and Hypothesis Testing

1. Point Estimation Example Estimating Variance in the Normal Model Let \(X_1, \ldots, X_n \sim N(\mu, \sigma^2)\). We are interested in estimating \(\theta = \sigma^2\). Well-known estimators: Sample variance (unbiased): $$\hat{\sigma}^2 = \frac{1}{n-1} \sum_{i=1}^n (X_i…

Introduction to Statistical Decision Theory – Edition 3: Ethical and Strategic Decisions Under Uncertainty

This third edition presents a real-world-inspired decision-theoretic scenario rooted in the classical formulation of I. J. Good (1952), where human incentives, ethical dilemmas, and corporate strategy intersect. A new invention is presented to a company’s…

Introduction to Statistical Decision Theory- Edition 4: Cold Weather, Warm Decisions

A Practical Decision Under Uncertainty: Heating or Buying a Pullover? In this fourth edition, we analyze a relatable and simple decision problem using the framework of statistical decision theory. The goal is to determine the…

Introduction to Statistical Decision Theory- Edition 5: Optimal Decision Rules

Content Main topics: Admissible decision rules Bayes decision rules Minimax decision rules Context: Parameter estimation 1. Admissibility: The Idea In statistical decision theory, we aim to choose good decision rules from all possible ones. Let…

Introduction to Statistical Decision Theory- Edition 6: Bayes Decision Rules

1. From Classical to Bayesian Decision Making In earlier editions, we defined: Statistical decision problems Point estimation, hypothesis testing, confidence intervals Loss functions and risk functions Concepts of admissibility, dominance, and optimality In Edition 6,…