Learning Path
Question & Answer1
Understand Question2
Review Options3
Learn Explanation4
Explore TopicChoose the Best Answer
A
True
B
False
Understanding the Answer
Let's break down why this is correct
Answer
The statement is false: log‑sum‑exp is a smooth, differentiable approximation of the maximum, but it is biased because it always returns a value larger than the true maximum unless the largest term dominates. This bias comes from the logarithm of the sum of exponentials, which adds a positive offset that depends on how many terms are close to the maximum. In practice, you can reduce the bias by scaling the inputs with a large temperature parameter, but this introduces a trade‑off between smoothness and accuracy. For example, for values 0, 1, and 2, log‑sum‑exp with a temperature of 1 gives log(e^0+e^1+e^2)≈2. 31, while the true maximum is 2, showing a positive bias of about 0.
Detailed Explanation
The log-sum-exp function smooths the values so that the largest value is not taken exactly. Other options are incorrect because People often think that because log-sum-exp looks like a max, it gives the exact maximum.
Key Concepts
Log-sum-exp function
Optimization techniques
Convex functions
Topic
Log-sum-exp Function
Difficulty
medium level question
Cognitive Level
understand
Ready to Master More Topics?
Join thousands of students using Seekh's interactive learning platform to excel in their studies with personalized practice and detailed explanations.