Basic Stochastic Optimization Methods -- Decision/Control Under Stochastic Uncertainty -- Deterministic Substitute Problems in Optimal Decision Under Stochastic Uncertainty -- Differentiation Methods -- Differentiation Methods for Probability and Risk Functions -- Deterministic Descent Directions -- Deterministic Descent Directions and Efficient Points -- Semi-Stochastic Approximation Methods -- RSM-Based Stochastic Gradient Procedures -- Stochastic Approximation Methods with Changing Error Variances -- Technical Applications -- Approximation of the Probability of Failure/Survival in Plastic Structural Analysis and Optimal Plastic Design.Optimization problems arising in practice involve random parameters. For the computation of robust optimal solutions, i.e., optimal solutions being insensitive with respect to random parameter variations, deterministic substitute problems are needed. Based on the distribution of the random data, and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into deterministic substitute problems. Due to the occurring probabilities and expectations, approximative solution techniques must be applied. Deterministic and stochastic approximation methods and their analytical properties are provided: Taylor expansion, regression and response surface methods, probability inequalities, First Order Reliability Methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation methods, differentiation of probability and mean value functions. Convergence results of the resulting iterative solution procedures are given.