COSMOS: Causal Consistency on the Network Edge
(PTDC/EEI-COM/29271/2017)
14/06/2018-13/06/2022
Abstract
This project aims at designing, implementing, and evaluating Cosmos, a
storage system to support edge-computing. Systems such as Cosmos are
of extremely practical relevance today. As the number of devices
connected to the internet grows, it becomes unfeasible to store and
process all data in a few (centralised) datacenters, without the
support of the computing power that lies at the edge of the
network. In fact, it is estimated that as early as 2018, 40% of the
data created by IoT devices will need to be processed in the edge. The
design of Cosmos is based on most recent technological advances in the
areas of consistency management, overlay management, and dependability
assurance, to build a storage system that can operate efficiently and
reliably in the resource constrained and unstable edge devices. Cosmos
will be made available to the community as an open source project.
Partners
Team
- Luís
Rodrigues (PI)
- Miguel Correia (CO-PI)
- RodrigoRodrigues
- Paolo Romano
- MiguelMatos
- Nuno Santos
- Nuno Preguiça
- João Leitão
- Carla Ferreira
- Angel Gestoso
- Nivia Quental
- Nuno C Afonso
- Cláudio Correia
- Taras Lykhenko
- Válter Santos
- João Soares
- Guilherme Borges
- Daniel Presser
- Ray Neiheiser
Thesis
PhD Thesis
- D. Barradas
- Unobservable Multimedia-based Covert Channels for Internet Censorship Circumvention
- PhD Thesis. Instituto Superior Técnico, Universidade de Lisboa.
- October, 2021.
- D. Presser
- Performance Modeling, Task Scheduling and Elastic Scaling for Distributed Graph Processing Systems.
- PhD Thesis. Universidade Federal de Santa Catarina.
- October, 2021.
MSc Thesis
- N. Afonso
- Mechanisms for Providing Causal Consistency on Edge Computing
- MSc Thesis. Instituto Superior Técnico, Universidade de Lisboa.
- October, 2018.
- T. Lykhenko
- Efficient Implementation of Causal Consistent Transactions in the Cloud.
- MSc Thesis. Instituto Superior Técnico, Universidade de Lisboa.
- November, 2019.
- V. Santos
- Localized Reliable Causal Multicast.
- MSc Thesis. Instituto Superior Técnico, Universidade de Lisboa.
- November, 2019.
- A. Madeira
- Efficient Implementation of Causal Consistent Transactions in the Cloud.
- MSc Thesis. Instituto Superior Técnico, Universidade de Lisboa.
- November, 2019.
- C. Correia
- Omega: a Secure Event Ordering Service for the Edge.
- MSc Thesis. Instituto Superior Técnico, Universidade de Lisboa.
- November, 2019.
- F. Pedrosa
- LoCaPS: Localized Causal Publish-Subscribe
- MSc Thesis. Instituto Superior Técnico, Universidade de Lisboa.
- November, 2020.
- M. Belém
- ENGAGE: Session Guaranties for the Edge
- MSc Thesis. Instituto Superior Técnico, Universidade de Lisboa.
- November, 2020.
- L. Marques Epifânio
- Cathode: A Consistency-Aware Data Placement Algorithm for the Edge
- MSc Thesis. Instituto Superior Técnico (IST), Universidade de Lisboa.
- January 2021.
- T. Gonçalves
- Dynamic Reconfiguration of the Data Aggregation Topology at the Edge
- MSc Thesis. Instituto Superior Técnico (IST), Universidade de Lisboa.
- January 2021.
- R. Prates
- Proof of Timely-Retrievability for Storage Systems at the Edge
- MSc Thesis. Instituto Superior Técnico (IST), Universidade de Lisboa.
- November 2021.
- J. Soares
- An Architecture to Offer Transactional Strong Consistency for FaaS Applications
- MSc Thesis. Instituto Superior Técnico (IST), Universidade de Lisboa.
- November 2021.
Publications
Journals
- Omega: a Secure Event Ordering Service for for the Edge.
- C. Correia, M. Correia, L. Rodrigues.
- IEEE Transactions on Dependable and Secure Computing.
- Secure cloud-of-clouds storage with space-efficient secret sharing
- A. Niknia, M. Correia, J. Karimpour
- Journal of Information Security and Applications, Volume 59, 2021.
Internacional Conference Proceedings
- Hourglass: Leveraging Transient Resources for Time-Constrained Graph Processing in the Cloud.
- P. Joaquim, M. Bravo, L. Rodrigues, M. Matos.
- In Proceedings of the EuroSys 2019, Dresden, Germany, March 2019.
- Measurements as First-class Artifacts.
- P. Laffranchini, L. Rodrigues, M. Canini, B. Krishnamurthy.
- Proceedings of the IEEE International Conference on Computer Communications (INFOCOM), Paris, France, April-May, 2019.
- Localized Reliable Causal Multicast
- V. Santos and L. Rodrigues.
- In Proceedings of the IEEE International Symposium on Network Computing and Applications (NCA 2019), Cambridge (MA), USA, September 2019.
- HeTM: Transactional Memory for Heterogeneous Systems.
- D. Castro, P. Romano, A. Illic, A. Khan.
- In Proc. 28th International Conference on Parallel Architectures and Compilation Techniques (PACT 2019). Seattle (WA), USA, September 2019.
- Omega: a Secure Event Ordering Service for the Edge.
- C. Correia, L. Rodrigues, and M. Correia.
- In Proceedings of 50th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), Valência, Spain, June 2020.
- NetSheriff: sheltering software-defined networks from rogue switches.
- P. Laffranchini, L. Rodrigues, E. Riviere, R. Sadre, N. Machado and J. Miranda.
- In Proceedings of the 8th International Conference in Networked Systems (NETYS), Marrakech, Marocco, June 2020.
- EdgeScaler: Effective Elastic Scaling for Graph Stream Processing Systems.
- D. Presser, F. Siqueira, L. Rodrigues, P. Romano.
- In Proceedings of the 14th ACM International Conference on Distributed and Event-Based Systems (DEBS), Montreal, Quebec, Canada, July 2020.
- Combining High Throughput and Low Migration Latency for Consistent Data Storage on the Edge.
- N. Afonso, M. Bravo and L. Rodrigues.
- In Proceedings of the 29th International Conference on Computer Communications and Networks (ICCCN), Honolulu (HI) USA, August 2020.
- Poking a Hole in the Wall: Efficient Censorship-Resistant Internet Communications by Parasitizing on WebRTC.
- D. Barradas, N. Santos, L. Rodrigues, V. Nunes.
- In Proceedings of the 2020 ACM Conference on Computer and Communications Security (CCS), Online, November 2020.
- Reducing the Subscription Latency in Reliable Causal ublish-Subscribe Systems.
- F. Pedrosa and L. Rodrigues
- Proceedings of the The 36th ACM/SIGAPP Symposium On Applied Computing (SAC) Online, March, 2021.
- FlowLens: Enabling Efficient Flow Classification for ML-based Network Security Applications.
- D. Barradas, N. Santos, L. Rodrigues, S. Signorello, F. Ramos, A. Madeira.
- Proceedings of the 2021 Usenix Network and Distributed System Security Symposium (NDSS), Online, February, 2021.
- Kauri: Scalable BFT Consensus with Pipelined Tree-Based Dissemination and Aggregation.
- R. Neiheiser, M. Matos, and L. Rodrigues.
- Proceedings of the 28th ACM Symposium on Operating Systems Principles (SOSP), Online, October, 2021.
- Cathode: A Consistency-Aware Data Placement Algorithm for the Edge.
- L. Epifânio, C. Correia and L. Rodrigues.
- Proceedings of the 20th IEEE International Symposium on Network Computing and Applications (NCA 2021), Online, November, 2021.
- FaaSTCC: Efficient Transactional Causal Consistency for Serverless Computing.
- T. Lykhenko, R. Soares and L. Rodrigues.
- Proceedings of the 22nd ACM/IFIP International Middleware Conference, Online, December 2021.
National Conference Proceedings
-
Armazenamento de Dados com Coerência Causal na Periferia da Rede.
- N. Afonso, M. Bravo, and L. Rodrigues
- Actas do nono Simpósio de Informática (Inforum), Coimbra, Portugal, Sep. 2018.
- Difusão em Grupo Tolerante a Faltas com Ordem Causal Usando Informação Localizada.
- V. Santos and L. Rodrigues
- Actas do décimo primeiro Simpósio de Informática (Inforum), Guimarães, Portugal, Sep. 2019.
- Concretização Eficiente de Coerência Causal Transaccional na Nuvem.
- T. Lykhenko and L. Rodrigues
- Actas do décimo primeiro Simpósio de Informática (Inforum), Guimarães, Portugal, Sep. 2019.
- Ordenação Segura de Eventos na Periferia da Rede.
- C. Correia, L. Rodrigues and M. Correia
- Actas do décimo primeiro Simpósio de Informática (Inforum), Guimarães, Portugal, Sep. 2019.
- Identificação de Canais Encobertos no Skype usando Esboços em SDNs.
- A. Madeira, D. Barradas, N. Santos and L. Rodrigues
- Actas do décimo primeiro Simpósio de Informática (Inforum), Guimarães, Portugal, Sep. 2019.
- Prova de Resposta Pontual no Acesso ao Armazenamento Contratado na Periferia da Rede.
- C. Correia, M. Correia, and L. Rodrigues
- Actas do décimo segundo Simpósio de Informática (Inforum), Lisboa,Portugal, Sep. 2021.
- Uma Arquitectura para Oferecer Garantias de Coerência forte a Aplicações FaaS.
- R. Soares and L. Rodrigues
- Actas do décimo segundo Simpósio de Informática (Inforum), Lisboa,Portugal, Sep. 2021.