Production and Inventory Systems -- Average Cost Optimality in Inventory Models with Markovian Demands and Lost Sales -- Inventory Control of Switched Production Systems: LMI Approach -- A Two-Time-Scale Approach for Production Planning in Discrete Time -- Evaluation of Throughput in Serial Production Lines with Non-Exponential Machines -- Supply Chain Production Planning Modeling Facility Lead Time and Quality of Service -- Large Scale or Multi Agent System Problems -- Providing QoS in Large Networks: Statistical Multiplexing and Admission Control -- Combined Competitive Flow Control and Routing in Networks with Hard Side Constraints -- Generalized Uplifts in Pool-Based Electricity Markets -- Nash Equilibria for Large-Population Linear Stochastic Systems of Weakly Coupled Agents.Analysis, Control and Optimization of Complex Dynamic Systems gathers in a single volume a spectrum of complex dynamic systems related papers written by experts in their fields, and strongly representative of current research trends. Complex systems present important challenges, in great part due to their sheer size which makes it difficult to grasp their dynamic behavior, optimize their operations, or study their reliability. Yet, we live in a world where, due to increasing inter-dependencies and networking of systems, complexity has become the norm. With this in mind, the volume comprises two parts. The first part is dedicated to a spectrum of complex problems of decision and control encountered in the area of production and inventory systems. The second part is dedicated to large scale or multi-agent system problems occurring in other areas of engineering such as telecommunication and electric power networks, as well as more generic context.