QLindA: Quantum Reinforcement Learning for Industrial Applications

Recent advances in deep reinforcement learning have made it possible for artificial intelligence (AI) systems to play games like chess or Go better than any human or computer ever could. This key technology is recently also used for learning control in industrial environments.

The current rapid increase in the capacity of quantum computers opens up the possibility of using quantum computers in AI systems, and offers the potential for breakthrough performance improvements that could trigger a technological revolution with implications for a wide range of applications.

In this project we are working with partners to develop novel algorithms that will allow methods used in reinforcement learning to be transferred to high-performance quantum computers.

For more information, please refer to the project's homepage.

This project is sponsored by the Federal Ministry of Education and Research.

People

Related Publications

To Appear IEEE Conference
Guided-SPSA: Simultaneous Perturbation Stochastic Approximation assisted by the Parameter Shift Rule

Maniraman Periyasamy, Axel Plinge, Christopher Mutschler, Daniel D. Scherer, Wolfgang MauererProceedings of the IEEE International Conference on Quantum Computing and Engineering2024.
PDF [BibTex]

×

BibTex Entry

@inproceedings{periyasamy:24:qce24,
 author = {Maniraman Periyasamy and Axel Plinge and Christopher Mutschler and Daniel D. Scherer and Wolfgang Mauerer},
 booktitle = {Proceedings of the IEEE International Conference on Quantum Computing and Engineering},
 entrysubtype = {Conference},
 month = {4},
 title = {Guided-SPSA: Simultaneous Perturbation Stochastic Approximation assisted by the Parameter Shift Rule},
 url = {https://arxiv.org/abs/2404.15751},
 userd = {IEEE QCE '24},
 year = {2024}
}

Close

SIGMOD A*
Reproducibility Report for ACM SIGMOD 2023 Paper: Ready to Leap (by Co-Design)? Join Order Optimisation . . .

Sebastian Schmidl, Yangshen Deng, Pingchuan Ma, Manuel Schönberger, Wolfgang Mauerer2024.
PDF [BibTex]

×

BibTex Entry

@inproceedings{schmidl:24:repro,
 author = {Sebastian Schmidl and Yangshen Deng and Pingchuan Ma and Manuel Schönberger and Wolfgang Mauerer},
 title = {Reproducibility Report for ACM SIGMOD 2023 Paper: Ready to Leap (by Co-Design)? Join Order Optimisation . . . },
 userc = {CORE23:A*},
 userd = {SIGMOD '23},
 year = {2024}
}

Close

VLDB Conference A*
Quantum-Inspired Digital Annealing for Join Ordering

Manuel Schönberger, Immanuel Trummer, Wolfgang MauererProceedings of the VLDB Endowment2023.
PDF 10.14778/3632093.3632112 Reproduction Package [BibTex]

×

BibTex Entry

@inproceedings{schoenberger:23:pvldb,
 author = {Schönberger, Manuel and Trummer, Immanuel and Mauerer, Wolfgang},
 booktitle = {Proceedings of the VLDB Endowment},
 doi = {10.14778/3632093.3632112},
 entrysubtype = {Conference},
 language = {en},
 month = {11},
 number = {3},
 title = {Quantum-Inspired Digital Annealing for Join Ordering},
 url = {https://doi.org/10.14778/3632093.3632112},
 userc = {CORE23:A*},
 userd = {VLDB '24},
 volume = {17},
 year = {2023}
}

Close

IEEE Conference
Workshop Summary: Quantum Machine Learning

Volker Tresp, Steffen Udluff, Daniel Hein, Werner Hauptmann, Martin Leib, Christopher Mutschler, Daniel D. Scherer, Wolfgang MauererProceedings of the IEEE International Conference on Quantum Computing and Engineering2023.
PDF 10.1109/QCE57702.2023.10174 [BibTex]

×

BibTex Entry

@inproceedings{Tresp:23:qml,
 author = {Volker Tresp and Steffen Udluff and Daniel Hein and Werner Hauptmann and Martin Leib and
Christopher Mutschler and Daniel D. Scherer and Mauerer, Wolfgang},
 booktitle = {Proceedings of the IEEE International Conference on Quantum Computing and Engineering},
 doi = {10.1109/QCE57702.2023.10174},
 entrysubtype = {Conference},
 language = {en},
 month = {09},
 title = {Workshop Summary: Quantum Machine Learning},
 userd = {IEEE QCE '23},
 year = {2023}
}

Close

VLDB Workshop A*
Quantum Optimisation of General Join Trees

Manuel Schönberger, Immanuel Trummer, Wolfgang MauererProceedings of the International Workshop on Quantum Data Science and Management2023.
PDF [BibTex]

×

BibTex Entry

@inproceedings{schoenberger:23:qdsm,
 author = {Schönberger, Manuel and Trummer, Immanuel and Mauerer, Wolfgang},
 booktitle = {Proceedings of the International Workshop on Quantum Data Science and Management},
 entrysubtype = {Workshop},
 month = {08},
 series = {QDSM '23},
 title = {Quantum Optimisation of General Join Trees},
 userc = {CORE22:A*},
 userd = {VLDB '23},
 year = {2023}
}

Close

Workshop A*
Joint Proceedings of Workshops at the 49th International Conference on Very Large Data Bases (VLDB 2023), Vancouver, Canada, August 28 - September 1, 2023

Rajesh Bordawekar, Cinzia Cappiello, Vasilis Efthymiou, Lisa Ehrlinger, Vijay Gadepally, Sainyam Galhotra, Sandra Geisler, Sven Groppe, Le Gruenwald, Alon Y. Halevy, Hazar Harmouch, Oktie Hassanzadeh, Ihab F. Ilyas, Ernesto Jiménez-Ruiz, Sanjay Krishnan, Tirthankar Lahiri, Guoliang Li, Jiaheng Lu, Wolfgang Mauerer, Umar Farooq Minhas, Felix Naumann, M. Tamer Özsu, El Kindi Rezig, Kavitha Srinivas, Michael Stonebraker, Satyanarayana R. Valluri, Maria-Esther Vidal, Haixun Wang, Jiannan Wang, Yingjun Wu, Xun Xue, Mohamed Zaït, Kai ZengCEUR-WS.org2023.
[BibTex]

×

BibTex Entry

@proceedings{Bordawekar:23:vldbw,
 editor = {Rajesh Bordawekar and
Cinzia Cappiello and
Vasilis Efthymiou and
Lisa Ehrlinger and
Vijay Gadepally and
Sainyam Galhotra and
Sandra Geisler and
Sven Groppe and
Le Gruenwald and
Alon Y. Halevy and
Hazar Harmouch and
Oktie Hassanzadeh and
Ihab F. Ilyas and
Ernesto Jiménez{-}Ruiz and
Sanjay Krishnan and
Tirthankar Lahiri and
Guoliang Li and
Jiaheng Lu and
Wolfgang Mauerer and
Umar Farooq Minhas and
Felix Naumann and
M. Tamer Özsu and
El Kindi Rezig and
Kavitha Srinivas and
Michael Stonebraker and
Satyanarayana R. Valluri and
Maria{-}Esther Vidal and
Haixun Wang and
Jiannan Wang and
Yingjun Wu and
Xun Xue and
Mohamed Zaït and
Kai Zeng},
 entrysubtype = {Workshop},
 publisher = {CEUR-WS.org},
 series = {{CEUR} Workshop Proceedings},
 title = {Joint Proceedings of Workshops at the 49th International Conference
on Very Large Data Bases {(VLDB} 2023), Vancouver, Canada, August
28 - September 1, 2023},
 url = {https://ceur-ws.org/Vol-3462},
 userc = {CORE22:A*},
 volume = {3462},
 year = {2023}
}

Close

ACM Conference A*
Ready to Leap (by Co-Design)? Join Order Optimisation on Quantum Hardware

Manuel Schönberger, Stefanie Scherzinger, Wolfgang MauererProceedings of ACM SIGMOD/PODS International Conference on Management of Data2023.
PDF 10.1145/3588946 Reproduction Package [BibTex]

×

BibTex Entry

@inproceedings{schoenberger:23:leap,
 author = {Schönberger, Manuel and Scherzinger, Stefanie and Mauerer, Wolfgang},
 booktitle = {Proceedings of ACM SIGMOD/PODS International Conference on Management of Data},
 doi = {10.1145/3588946},
 entrysubtype = {Conference},
 title = {Ready to Leap (by Co-Design)? Join Order Optimisation on Quantum Hardware},
 userc = {CORE23:A*},
 userd = {ACM SIGMOD '23},
 year = {2023}
}

Close

Journal 4.45
Uncovering Instabilities in Variational-Quantum Deep Q-Networks

Maja Franz, Lucas Wolf, Maniraman Periyasamy, Ch. Ufrecht, D. Scherer, A. Plinge, Ch. Mutschler, Wolfgang MauererJournal of The Franklin InstituteElsevier (Open Access)2022.
PDF 10.1016/j.jfranklin.2022.08.021 Reproduction Package [BibTex]

×

BibTex Entry

@article{franz:22:qrl,
 author = {Franz, Maja and Wolf, Lucas and Periyasamy, Maniraman and Ufrecht, Ch. and Scherer, D. and Plinge, A. and Mutschler, Ch. and Mauerer, Wolfgang},
 doi = {10.1016/j.jfranklin.2022.08.021},
 entrysubtype = {Journal},
 journal = {Journal of The Franklin Institute},
 month = {8},
 publisher = {Elsevier (Open Access)},
 title = {Uncovering Instabilities in Variational-Quantum Deep Q-Networks},
 userc = {IF:4.45},
 year = {2022}
}

Close

SIGMOD A* 2nd Place
Applicability of Quantum Computing on Database Query Optimization

Manuel SchönbergerProceedings of the 2022 International Conference on Management of DataAssociation for Computing Machinery20222nd Place.
PDF 10.1145/3514221.3520257 [BibTex]

×

BibTex Entry

@inproceedings{schoenberger:22:sigmodsrc,
 address = {New York, NY, USA},
 author = {Schönberger, Manuel},
 booktitle = {Proceedings of the 2022 International Conference on Management of Data},
 doi = {10.1145/3514221.3520257},
 isbn = {9781450392495},
 keywords = {quantum computing, quantum computation, multiple query optimization,
join order optimization, query optimization},
 location = {Philadelphia, PA, USA},
 month = {6},
 numpages = {3},
 pages = {2512–2514},
 publisher = {Association for Computing Machinery},
 series = {SIGMOD '22},
 title = {Applicability of Quantum Computing on Database Query Optimization},
 url = {https://doi.org/10.1145/3514221.3520257},
 userc = {CORE21:A*},
 userd = {SIGMOD '22},
 year = {2022}
}

Close

FGDB
Applicability of Quantum Computing on Database Query Optimization

Manuel Schönberger, Stefanie Scherzinger, Wolfgang MauererFrühjahrstreffen Fachgruppe Datenbanken in Potsdam (Poster Presentation)2022.
PDF [BibTex]

×

BibTex Entry

@inproceedings{mintel:22:fgdb,
 author = {Schönberger, Manuel and Scherzinger, Stefanie and Mauerer, Wolfgang},
 booktitle = {Frühjahrstreffen Fachgruppe Datenbanken in Potsdam (Poster Presentation)},
 month = {3},
 title = {Applicability of Quantum Computing on Database Query Optimization},
 userd = {FGDB '22},
 venue = {Potsdam, Germany},
 year = {2022}
}

Close

SANER Workshop A
1-2-3 Reproducibility for Quantum Software Experiments

Wolfgang Mauerer, Stefanie ScherzingerIEEE International Conference on Software Analysis, Evolution and Reengineering (SANER)2022.
PDF 10.1109/SANER53432.2022.00148 [BibTex]

×

BibTex Entry

@inproceedings{mauerer:22:q-saner,
 author = {Mauerer, Wolfgang and Scherzinger, Stefanie},
 booktitle = {IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER)},
 doi = {10.1109/SANER53432.2022.00148},
 entrysubtype = {Workshop},
 number = {},
 pages = {1247-1248},
 title = {1-2-3 Reproducibility for Quantum Software Experiments},
 userc = {CORE22:A},
 userd = {SANER '22},
 volume = {},
 year = {2022}
}

Close

ICSE Workshop A*
Beyond the Badge: Reproducibility Engineering as a Lifetime Skill

Wolfgang Mauerer, Stefan Klessinger, Stefanie ScherzingerProceedings of the 4th International Workshop on Software Engineering Education for the Next GenerationAssociation for Computing Machinery2022.
PDF 10.1145/3528231.3528359 [BibTex]

×

BibTex Entry

@inproceedings{mauerer:22:icse,
 address = {New York, NY, USA},
 author = {Mauerer, Wolfgang and Klessinger, Stefan and Scherzinger, Stefanie},
 booktitle = {Proceedings of the 4th International Workshop on Software Engineering Education for the Next Generation},
 doi = {10.1145/3528231.3528359},
 entrysubtype = {Workshop},
 isbn = {9781450393362},
 location = {Pittsburgh, Pennsylvania},
 numpages = {4},
 pages = {1–4},
 publisher = {Association for Computing Machinery},
 series = {SEENG '22},
 title = {Beyond the Badge: Reproducibility Engineering as a Lifetime Skill},
 url = {https://doi.org/10.1145/3528231.3528359},
 userc = {CORE22:A*},
 userd = {ICSE},
 year = {2022}
}

Close

ICSA Workshop A
Peel | Pile? Cross-Framework Portability of Quantum Software

Manuel Schönberger, Maja Franz, Stefanie Scherzinger, Wolfgang Mauerer2022 IEEE 19th International Conference on Software Architecture Companion (ICSA-C)2022.
PDF 10.1109/ICSA-C54293.2022.00039 Reproduction Package [BibTex]

×

BibTex Entry

@inproceedings{schoenberger:22:icsa,
 author = {Schönberger, Manuel and Franz, Maja and Scherzinger, Stefanie and Mauerer, Wolfgang},
 booktitle = {2022 IEEE 19th International Conference on Software Architecture Companion (ICSA-C)},
 doi = {10.1109/ICSA-C54293.2022.00039},
 entrysubtype = {Workshop},
 pages = {164-169},
 title = {Peel | Pile? Cross-Framework Portability of Quantum Software},
 url = {https://ieeexplore.ieee.org/document/9779833},
 userc = {CORE22:A},
 userd = {ICSA '22},
 year = {2022}
}

Close