Reinforcement Learning for Railway Scheduling · Reinforcement Learning for Railway Scheduling...

Reinforcement Learning

for Railway Scheduling

Overcoming Data Sparseness through Simulations

Dr. Erik Nygren Research and Innovation Lab Swiss Federal Railway

Swiss Railway Network. A Complex Dynamical System.

Influencing Factors Facts

10,000

1,210,000

Weather People

Infrastructure Events

12,997

Most dense network 33,000

210,000 t

31,266

3,230 km

Energy

Train Dispatching and Scheduling. Challenges in the Worlds Densest Train Network.

Train runs

Production

Timetable

Evolution of Dispatching. Towards Full Automation.

Future

Automated Train Dispatching. Current Challenges.

Big Data

Big Data: Not enough relevant information

Automated

Dispatching

Learning

Measure-

ments Action

Reinforcement Learning for Railway Dispatching. Overcoming Data Sparseness through Simulations.

Measure- ments Action

Validation

Data generation

Learning

Action

Artificial Data

Big Data

High Performance Simulation

High Performance Simulations. Unleashing the Power of Parallel Computing.

DGX-1 High Performance Simulations

Time speedup Scenario variations Influencing factor analysis

Preliminary Results. Visualization of Simulation Results.

2h realtime

5000x Simulation speed

Visualization speed

Reinforcement Learning. Playing the Dispatcher Game.

Action

Reward

Artificial Data

DGX-1 Automated Dispatcher

Machine Learning on Artificial Data. Generating, Evaluating and Optimizing Train Dispatching.

Automated Dispatcher

Reinforcement Learning

Tree Search

Evolutionary Strategies

Building Blocks Variable Topologies

Mixed Integer Linear Programming

Genetic Algorithm

Current State... And Future Expected Reward.

DGX-1 Automated Dispatcher

Fully Automated Process

Train runs

Production

Timetable

Take Home.

Big Data Big Information

Take Home.

Big Data Big Information

Dr. Erik Nygren

erik.nygren@sbb.ch

AI Researcher

Research Team

Reward Function. How to Reward an Artificial Dispatcher.

Reward

Reinforcement Learning for Railway Scheduling · Reinforcement Learning for Railway Scheduling...

Documents

Optimal opportunistic tamping scheduling for railway track …1464836/... · 2020. 9. 8. · Optimal opportunistic tamping scheduling for railway track geometry Hamid Khajeheia, Mohammad

Deep Reinforcement Learning-based Scheduling for ...dl.ifip.org/db/conf/wiopt/wiopt2017/1570333085.pdf1 Deep Reinforcement Learning-based Scheduling for Roadside Communication Networks

INFORMS 2012 Shared Corridor Railway Maintenance Scheduling

SLA-based Spark Job Scheduling in Cloud with Deep ... · SLA-based Spark Job Scheduling in Cloud with Deep Reinforcement Learning Muhammed Taw qul Islam 1, Shanika Karunasekera ,

ADAPTIVE REACTIVE JOB-SHOP SCHEDULING WITH REINFORCEMENT LEARNING AGENTSml.informatik.uni-freiburg.de/_media/publications/gr07.pdf · concepts covered in this article. Accordingly,

Exploration of Reinforcement Learning in Radar Scheduling

Railway, Metro and Lightrail Electrification Return Circuit APKJ... · Railway, Metro and Lightrail Electrification ... of reinforced concrete ... where corrosion of the reinforcement

Decentralised reinforcement learning for energy …...Decentralised reinforcement learning for energy-efficient scheduling in wireless sensor networks Mihail Mihaylov* and Yann-Aël

BS 4466-1989 Specification for Scheduling, Dimensioning, Bending & Cutting of Steel Reinforcement for Concrete_2

Cellular Network Traffic Scheduling using Deep Reinforcement … · 2019-03-11 · Cellular Network Traffic Scheduling using Deep Reinforcement Learning Sandeep Chinchali, et. al

A Generic Multi-Agent Reinforcement Learning Approach … · A Generic Multi-Agent Reinforcement Learning Approach for Scheduling Problems ... Frank, Anne-Sonia, Kimberly, Eve, Marilyn,

On a Railway Maintenance Scheduling Problem with Customer ...scheith/ABSTRACTS/PREPRINTS/14-Heinicke.pdf · On a Railway Maintenance Scheduling Problem with Customer Costs and Multi-Depots

Reinforcement Learning in Telescope Scheduling

A Reinforcement Learning Approach for Hybrid Flexible Flowline Scheduling Problems

Research Article Genetic Scheduling and Reinforcement Learning …downloads.hindawi.com/journals/mpe/2015/597956.pdf · 2019-07-31 · Genetic Scheduling and Reinforcement Learning

Reinforcement Learning for Scheduling Wireless Powered ...193.136.60.49/docs/reinforcement_learning_for... · Reinforcement Learning for Scheduling Wireless Powered Sensor Communications

Dynamic scheduling in Petroleum process using ...ceur-ws.org/Vol-547/96.pdf · Dynamic scheduling in Petroleum process using reinforcement learning ... Petroleum industry production

Reinforcement Learning applied to Meta -scheduling in grid environments Bernardo Costa Inês Dutra

A Reinforcement Learning Variant for Control Scheduling · scheme for accelerated learning, if the system visits the same failed state successively, the negative reinforcement value

Scheduling Virtual Machine Migration during Datacenter Upgrades … · 2020. 7. 23. · Scheduling Virtual Machine Migration during Datacenter Upgrades with Reinforcement Learning