Rachid Guerraoui
Professeur ordinaire
rachid.guerraoui@epfl.ch +41 21 693 52 72 https://dcl.epfl.ch/rachid/
Nationalité: Morroccan & Swiss & French
EPFL IC IINFCOM DCL
INR 310 (Bâtiment INR)
Station 14
1015 Lausanne
Web site: Site web: https://dcl.epfl.ch/
+41 21 693 52 72
EPFL
>
IC
>
IC-SSC
>
SSC-ENS
Web site: Site web: https://ssc.epfl.ch
+41 21 693 52 72
EPFL
>
IC
>
IC-SIN
>
SIN-ENS
Web site: Site web: https://sin.epfl.ch
+41 21 693 52 72
EPFL
>
IC
>
IC-DEC
>
IC-CEA
Publications
Publications Infoscience
Infoscience
The Privacy Power of Correlated Noise in Decentralized Learning
2024. 41st International Conference on Machine Learning (ICML 2024), Vienna, Austria, July 21-27, 2024. DOI : 10.48550/arXiv.2405.01031.Rapidly verifiable aggregate signatures
WO2024062304 ; EP4343599 . 2024.Robust Sparse Voting
2024. International Conference on Artificial Intelligence and Statistics (AISTATS), Valencia, Spain, 2024.Epidemic Learning: Boosting Decentralized Learning with Randomized Communication
2023-12-14. 37th Conference on Neural Information Processing Systems (NeurIPS 2023), New Orleans, Louisiana, USA, December 10-16, 2023.Byzantine consensus is Θ(n^2): the Dolev-Reischuk bound is tight even in partial synchrony!
Distributed Computing. 2023-12-11. DOI : 10.1007/s00446-023-00458-w.Robust Distributed Learning: Tight Error Bounds and Breakdown Point under Data Heterogeneity
2023-11-02. Thirty-seventh Conference on Neural Information Processing Systems, New Orleans, LA, USA, December 10-16, 2023.GoldFinger: Fast & Approximate Jaccard for Efficient KNN Graph Constructions
Ieee Transactions On Knowledge And Data Engineering. 2023-11-01. DOI : 10.1109/TKDE.2022.3232689.As easy as ABC: Optimal (A)ccountable (B)yzantine (C)onsensus is easy!
Journal Of Parallel And Distributed Computing. 2023-11-01. DOI : 10.1016/j.jpdc.2023.104743.Efficacy of temporal and spatial abstraction for training accurate machine learning models: A case study in smart thermostats
Energy And Buildings. 2023-10-01. DOI : 10.1016/j.enbuild.2023.113377.PePTM: An Efficient and Accurate Personalized P2P Learning Algorithm for Home Thermal Modeling
Energies. 2023-09-01. DOI : 10.3390/en16186594.Byzantine Machine Learning: A Primer
ACM Computing Surveys. 2023-08-18. DOI : 10.1145/3616537.Robust Collaborative Learning with Linear Gradient Overhead
2023-07-31. International Conference on Machine Learning, Honolulu, Hawaii, USA, July 23-29, 2023. p. 9761-9813.Leaderless consensus
Journal Of Parallel And Distributed Computing. 2023-03-13. DOI : 10.1016/j.jpdc.2023.01.009.Byzantine-Resilient Learning Beyond Gradients: Distributing Evolutionary Search
2023-01-01. Genetic and Evolutionary Computation Conference (GECCO), Lisbon, PORTUGAL, JUL 15-19, 2023. p. 295-298. DOI : 10.1145/3583133.3590719.Efficient and Accurate Peer-to-Peer Training of Machine Learning Based Home Thermal Models
2023-01-01. 14th ACM International Conference on Future Energy Systems (e-Energy), Orlando, FL, JUN 20-23, 2023. p. 524-529. DOI : 10.1145/3575813.3597453.On the Validity of Consensus
2023-01-01. 42nd ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing (PODC), Orlando, FL, JUN 19-23, 2023. p. 332-343. DOI : 10.1145/3583668.3594567.DIABLO: A Benchmark Suite for Blockchains
2023-01-01. 18th European Conference on Computer Systems (EuroSys), Rome, ITALY, May 08-12, 2023. p. 540-556. DOI : 10.1145/3552326.3567482.On the Privacy-Robustness-Utility Trilemma in Distributed Learning
Proceedings of the 40th International Conference on Machine Learning - Hawaii. 2023.On the Strategyproofness of the Geometric Median
2023. 26th International Conference on Artificial Intelligence and Statistics (AISTATS), Valencia, Spain, April 25-27, 2023.Fixing by Mixing: A Recipe for Optimal Byzantine ML under Heterogeneity
2023.uKharon: A Membership Service for Microsecond Applications
2023. 2022 USENIX Annual Technical Conference (USENIX ATC '22), Carlsbad, CA, USA, July 11–13, 2022.uBFT: Microsecond-Scale BFT using Disaggregated Memory
2023. 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2023), Vancouver, BC, Canada, March 25–29, 2023. p. 862-877. DOI : 10.1145/3575693.3575732.Byzantine-Resilient Multi-Agent System
Ieee Transactions On Dependable And Secure Computing. 2022-11-01. DOI : 10.1109/TDSC.2021.3116488.FLEET: Online Federated Learning via Staleness Awareness and Performance Prediction
Acm Transactions On Intelligent Systems And Technology. 2022-10-01. DOI : 10.1145/3527621.Byzantine Machine Learning Made Easy By Resilient Averaging of Momentums
2022-07-17. 38th International Conference on Machine Learning (ICML 2022), Baltimore, Maryland, USA, July 17-23, 2022. p. 6246-6283.An Equivalence Between Data Poisoning and Byzantine Gradient Attacks
2022-07-17. 38th International Conference on Machine Learning (ICML 2022), Baltimore, Maryland, USA, July 17-23, 2022. p. 6284–6323.On the advantages of P2P ML on mobile devices
2022-06-28. 13th ACM International Conference on Future Energy Systems (e-Energy '22), Virtual Event , 28 June - 1 July, 2022. p. 338-353. DOI : 10.1145/3538637.3538863.The Universal Gossip Fighter
2022-05-30. 36th IEEE International Parallel & Distributed Processing Symposium (IPDPS 2022), Online, May 30 – June 3, 2022. p. 1162-1172. DOI : 10.1109/IPDPS53621.2022.00116.Genuinely distributed Byzantine machine learning
Distributed Computing. 2022-05-26. DOI : 10.1007/s00446-022-00427-9.The consensus number of a cryptocurrency (vol 35, pg 1, 2022)
Distributed Computing. 2022-02-23. DOI : 10.1007/s00446-022-00422-0.G-Fake: Tell Me How It is Shared and I Shall Tell You If It is Fake
2022-01-01. 14th Asian Conference on Intelligent Information and Database Systems (ACIIDS), Ho Chi Minh City, VIETNAM, Nov 28-30, 2022. p. 1-13. DOI : 10.1007/978-981-19-8234-7_1.The Road to a Universal Internet Machine
2022-01-01. 21st IEEE International Symposium on Parallel and Distributed Computing (ISPDC), Basel, SWITZERLAND, Jul 11-13, 2022. p. XIX-XIX.Oracular Byzantine Reliable Broadcast
2022. 36th International Symposium on Distributed Computing (DISC 2022), Augusta, Georgia, USA, October 25-27, 2022. DOI : 10.4230/lipics.disc.2022.13.Byzantine Consensus is Θ(n^2): The Dolev-Reischuk Bound is Tight even in Partial Synchrony!
2022. 36th International Symposium on Distributed Computing (DISC 2022), Augusta, Georgia, USA, October 25-27, 2022. p. 1:11-1:19.Crime and Punishment in Distributed Byzantine Decision Tasks
2022. 42nd IEEE International Conference on Distributed Computing Systems (ICDCS), Bologna, Italy, July 10-13, 2022. p. 34-44. DOI : 10.1109/ICDCS54860.2022.00013.Revisiting Tendermint: Design Tradeoffs, Accountability, and Practical Use
2022. 2022 52nd Annual IEEE/IFIP International Conference on Dependable Systems and Networks - Supplemental Volume (DSN-S), Baltimore, MD, USA, June 27-30, 2022. p. 11-14. DOI : 10.1109/DSN-S54099.2022.00014.As easy as ABC: Optimal (A)ccountable (B)yzantine (C)onsensus is easy!
2022. 2022 IEEE International Parallel and Distributed Processing Symposium (IPDPS), Lyon, France, 30 May - 03 June, 2022. p. 560-570. DOI : 10.1109/IPDPS53621.2022.00061.Removing Algorithmic Discrimination (With Minimal Individual Error)
Theoretical Computer Science. 2022-05-19. DOI : 10.1016/j.tcs.2022.04.051.The consensus number of a cryptocurrency (extended version)
Distributed Computing. 2022. DOI : 10.1007/s00446-021-00399-2.Collaborative Learning in the Jungle (Decentralized, Byzantine, Heterogeneous, Asynchronous and Nonconvex Learning)
2021-12-06. 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Virtual, December 6-14, 2021.Probabilistic and temporal failure detectors for solving distributed problems
Journal Of Parallel And Distributed Computing. 2021-12-01. DOI : 10.1016/j.jpdc.2021.07.017.GARFIELD: System Support for Byzantine Machine Learning (Regular Paper)
2021-06-21. 2021 51st Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), Taipei, Taiwan, June 21-24, 2021. p. 39-51. DOI : 10.1109/DSN48987.2021.00021.The Imitation Game: Algorithm Selection by Exploiting Black-Box Recommenders
2021-01-14. 8th International Conference (NETYS 2020), Marrakech, Morocco, June 3–5, 2020. p. 170-182. DOI : 10.1007/978-3-030-67087-0_11.Dynamic Byzantine Reliable Broadcast
2021. 24th International Conference on Principles of Distributed Systems (OPODIS 2020), Strasbourg, France (Virtual Conference), Decembre 14-16, 2020. DOI : 10.4230/lipics.opodis.2020.23.AKSEL: Fast Byzantine SGD
2021. 24th International Conference on Principles of Distributed Systems (OPODIS 2020), Strasbourg, France (Virtual Conference), Decembre 14-16, 2020. DOI : 10.4230/lipics.opodis.2020.8.Differential Privacy and Byzantine Resilience in SGD: Do They Add Up?
2021-01-01. 40th ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing (PODC), ELECTR NETWORK, Jul 26-30, 2021. p. 391-401. DOI : 10.1145/3465084.3467919.Leaderless Consensus
2021-01-01. 41st IEEE International Conference on Distributed Computing Systems (ICDCS), ELECTR NETWORK, Jul 07-10, 2021. p. 392-402. DOI : 10.1109/ICDCS51616.2021.00045.Distributed Momentum for Byzantine-resilient Stochastic Gradient Descent
2021. 9th International Conference on Learning Representations (ICLR), virtual conference, May 4-8, 2021.Differentially Private Stochastic Coordinate Descent
2021. 35th AAAI Conference on Artificial Intelligence / 33rd Conference on Innovative Applications of Artificial Intelligence / 11th Symposium on Educational Advances in Artificial Intelligence, Virtual Conference, February 2–9, 2021. p. 7176-7184. DOI : 10.1609/aaai.v35i8.16882.FeGAN: Scaling Distributed GANs
2020-12-10. 21st International Middleware Conference, Delft, Netherlands, December 7-11, 2020. p. 193-206. DOI : 10.1145/3423211.3425688.Efficient Multi-Word Compare and Swap
2020-10-07. 34th International Symposium on Distributed Computing (DISC 2020), October 12-16, 2020. DOI : 10.4230/LIPIcs.DISC.2020.4.Fast and Robust Distributed Learning in High Dimension
2020-09-21. IEEE 39th International Symposium on Reliable Distributed Systems (SRDS 2020), Shanghai, China, September 21-24, 2020. p. 71-80. DOI : 10.1109/SRDS51746.2020.00015.The Cost of Scaling a Reliable Interconnection Topology
Ieee Transactions On Dependable And Secure Computing. 2020-09-01. DOI : 10.1109/TDSC.2018.2845402.Genuinely Distributed Byzantine Machine Learning
2020-08-03. The ACM Symposium on Principles of Distributed Computing (PODC), Salerno, Italy, August 3–7, 2020. DOI : 10.1145/3382734.3405695.Microsecond Consensus for Microsecond Applications
2020-01-01. 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI), ELECTR NETWORK, Nov 04-06, 2020. p. 599-616.Thread-Placement Learning
2020-01-01. 40th IEEE International Conference on Distributed Computing Systems (ICDCS), ELECTR NETWORK, Nov 29-Dec 01, 2020. p. 877-887. DOI : 10.1109/ICDCS47774.2020.00050.The Impossibility of Fast Transactions
2020-01-01. 34th IEEE International Parallel and Distributed Processing Symposium (IPDPS), ELECTR NETWORK, May 18-22, 2020. p. 1143-1154. DOI : 10.1109/IPDPS47924.2020.00120.Robust P2P Personalized Learning
2020-01-01. 39th International Symposium on Reliable Distributed Systems (SRDS), Shanghai, PEOPLES R CHINA, Sep 21-24, 2020. p. 299-308. DOI : 10.1109/SRDS51746.2020.00037.FLeet: Online Federated Learning via Staleness Awareness and Performance Prediction
2020. Middleware '20: 21st International Middleware Conference, Delft, Netherlands (online), December, 2020. p. 163-177. DOI : 10.1145/3423211.3425685.Online Payments by Merely Broadcasting Messages
2020. 50th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), Valencia, Spain, June 29th, July 2nd 2020. DOI : 10.1109/DSN48063.2020.00023.Who Started This Rumor? Quantifying the Natural Differential Privacy of Gossip Protocols
2020. 34th International Symposium on Distributed Computing (DISC 2020), October 15, 2020. DOI : 10.4230/lipics.disc.2020.8.Smaller, Faster & Lighter KNN Graph Constructions
2020. The Web Conference 2020, April 2020. p. 1060-1070. DOI : 10.1145/3366423.3380184.Byzantine machine learning
WO2020011361 . 2020.The weakest failure detector for eventual consistency
Distributed Computing. 2019-12-01. DOI : 10.1007/s00446-016-0292-9.Exploring The Borderlands Of The Gathering Problem
Bulletin of The European Association for Theoretical Computer Science. 2019-10-01.AGGREGATHOR: Byzantine Machine Learning via Robust Gradient Aggregation
2019-04-01. The Conference on Systems and Machine Learning (SysML), 2019, Stanford, CA, USA, March 31 - April 2, 2019 .Lock-Unlock: Is That All? A Pragmatic Analysis of Locking in Software Systems
Acm Transactions On Computer Systems. 2019-03-01. DOI : 10.1145/3301501.The Consensus Number of a Cryptocurrency
2019-01-01. 38th ACM Symposium on Principles of Distributed Computing (PODC), Toronto, CANADA, Jul 29-Aug 02, 2019. p. 307-316. DOI : 10.1145/3293611.3331589.Scalable Byzantine Reliable Broadcast
2019. 33rd International Symposium on Distributed Computing (DISC 2019), Budapest, Hungary, October 14-18, 2019. p. 22:1-22:16. DOI : 10.4230/LIPIcs.DISC.2019.22.The Impact of RDMA on Agreement
2019. PODC '19: ACM Symposium on Principles of Distributed Computing, Toronto, Canada, July, 2019. p. 409-418. DOI : 10.1145/3293611.3331601.The Fake News Vaccine
2019. 7th International Conference on Networked Systems. NETYS 2019, Marrakech, Morocco, June 19–21, 2019. p. 347-364. DOI : 10.1007/978-3-030-31277-0_23.Unified and Scalable Incremental Recommenders with Consumed Item Packs
2019. Euro-Par 2019 : European Conference on Parallel Processing, Göttingen, Germany, August 26–30, 2019. p. 227-240. DOI : 10.1007/978-3-030-29400-7_17.Utility and privacy effects of a user action in a communication system
EP3435314 . 2019.Byzantine tolerant gradient descent for distributed machine learning with adversaries
US2020380340 ; WO2019105543 . 2019.Distributed Transactional Systems Cannot Be Fast
2019. The 31st ACM on Symposium on Parallelism in Algorithms and Architectures - SPAA '19, Phoenix, AZ, USA, June 22 - 24, 2019. p. 369-380. DOI : 10.1145/3323165.3323189.Fingerprinting Big Data: The Case of KNN Graph Construction
2019. 2019 IEEE 35th International Conference on Data Engineering (ICDE), Macao, Macao, Macao, April 8-11 2019. p. 1738-1741. DOI : 10.1109/ICDE.2019.00186.The PCL Theorem: Transactions cannot be Parallel, Consistent, and Live
Journal Of The Acm. 2019-01-01. DOI : 10.1145/3266141.Causal Consistency and Latency Optimality: Friend or Foe?
Proceedings Of The Vldb Endowment. 2018-07-01. DOI : 10.14778/3236187.3236210.Monotonic Prefix Consistency in Distributed Systems
2018-05-30. 38th IFIP WG 6.1 International Conference on Formal Techniques for Distributed Objects, Components, and Systems, Madrid, Spain, June 18-20, 2018. DOI : 10.1007/978-3-319-92612-4_3.Personalized and Private Peer-to-Peer Machine Learning
2018-04-09. AISTATS.SPADE: Tuning scale-out OLTP on modern RDMA clusters
2018. 19th International Middleware Conference on - Middleware '18, Rennes, France, December, 2018. p. 80-93. DOI : 10.1145/3274808.3274815.Log-Free Concurrent Data Structures
2018-01-01. USENIX Annual Technical Conference (ATC), Boston, MA, Jul 11-13, 2018. p. 373-385.Collaborative Filtering Under a Sybil Attack: Similarity Metrics do Matter!
2018-01-01. 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), Luxembourg City, LUXEMBOURG, Jun 25-28, 2018. p. 466-477. DOI : 10.1109/DSN.2018.00055.Asynchronous Byzantine Machine Learning (the case of SGD)
2018. 35th International Conference on Machine Learning, Stockholm, SWEDEN, July 10-15, 2018. p. 1145-1154.Passing Messages while Sharing Memory
2018-01-01. 37th ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing (PODC), Egham, ENGLAND, Jul 23-27, 2018. p. 51-60. DOI : 10.1145/3212734.3212741.Locking Timestamps versus Locking Objects
2018-01-01. 37th ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing (PODC), Egham, ENGLAND, Jul 23-27, 2018. p. 367-376. DOI : 10.1145/3212734.3212742.On the Unfairness of Blockchain
2018. NETYS 2018, Essaouira, Morocco, May 9, 2018 - May 11, 2018. p. 36-50. DOI : 10.1007/978-3-030-05529-5_3.The entropy of a distributed computation random number generation from memory interleaving
DISTRIBUTED COMPUTING. 2018. DOI : 10.1007/s00446-017-0311-5.TM 2 C: a software transactional memory for many-cores
Distributed Computing. 2018. DOI : 10.1007/s00446-017-0310-6.Deep Learning Works in Practice. But Does it Work in Theory?
ArXiv. 2018.The Hidden Vulnerability of Distributed Learning in Byzantium
2018. International Conference on Machine Learning, Stockholm, Sweden, July 10-15, 2018.The Inherent Cost of Remembering Consistently
2018. 30th ACM Symposium on Parallelism in Algorithms and Architectures, Vienna, Austria, July 16 - 18, 2018. p. 259–269. DOI : 10.1145/3210377.3210400.Log-Free Concurrent Data Structures
2018. 2018 USENIX Annual Technical Conference, BOSTON, MA, USA, JULY 11–13, 2018.The Utility and Privacy Effects of a Click
2017-08-07. SIGIR, Shinjuku, Tokyo, Japan, August 7-11, 2017. p. 665–674. DOI : 10.1145/3077136.3080783.TRIAD: creating synergies between memory, disk and log in log structured key-value stores
2017-07-12. USENIX ATC, Santa Clara, CA, USA, July 12-14, 2017.FloDB: Unlocking Memory in Persistent Key-Value Stores
2017-04-23. EuroSys, Belgrade, Serbia, April 23-26, 2017. DOI : 10.1145/3064176.3064193.Why You Can't Beat Blockchains: Consistency and High Availability in Distributed Systems
2017ESTIMA: Extrapolating ScalabiliTy of In-Memory Applications
ACM Transactions on Parallel Computing. 2017. DOI : 10.1145/3108137.On The Robustness of a Neural Network
2017. 36th IEEE International Symposium on Reliable Distributed Systems, Hong Kong, September 26-29, 2017. p. 84-93. DOI : 10.1109/SRDS.2017.21.Sequential Proximity: Towards Provably Scalable Concurrent Search Algorithms
2017. Networked Systems: 5th International Conference, Marrakech, Morocco, May 17-19, 2017. p. 405-420. DOI : 10.1007/978-3-319-59647-1_30.Enseignement & Phd
Enseignement
Communication Systems
Computer Science
Doctorants
Allouah Youssef, Burgelin Clément Louis Alexandre, El Mrini Abdellah, Farhadkhani Sadegh, Murat Antoine, Petrescu Diana Andreea, Shokry Beatrice Shokry Samir, Stephan John,A dirigé les thèses EPFL de
Alistarh Dan , Antoniadis Karolos , Banabic Radu , Bushkov Victor , Chatzopoulos Georgios , Damaskinos Georgios , David Tudor Alexandru , Dragojevic Aleksandar , El Mhamdi El Mahdi , Guirguis Arsany Hany Abdelmessih , Kapalka Michal , Knezevic Nikola , Komatovic Jovan , Kozhaya David , Kucherenko Anastasiia , Letia Mihai , Losa Giuliano , Monod Maxime , Monti Matteo , Patra Rhicheek , Pavlovic Matej , Ribeiro Vidigueira Manuel José , Rouault Sébastien Louis Alexandre , Seredinschi Dragos-Adrian , Spring Jesper Honig , Taziki Mahsa , Trigonakis Vasileios , Wang Jingjing , Xygkis Athanasios , Yabandeh Maysam , Zablotchi Mihail Igor ,Cours
Distributed algorithms
L'informatique est souvent distribuée sur plusieurs machines, dans un réseau IP, un nuage ou un réseau P2P. Malgré les pannes partielles de machines ou de liens de communication le processus doit continuer.
Les bases de l'informatique distribué fiable seront étudiées.
Concurrent computing
Devant l'avénement des architectures modernes, il est crucial de maîtriser l'algorithmique de la concurrence. L'objectif de ce cours est d'étudier les fondements de cette algorithmique et en particulier les techniques permettant de concevoir des algorithmes robustes.