{"id":{"repo_id":"ets-quebec","oai_identifier":"oai:espace.etsmtl.ca:3545"},"canonical_url":"https://search.ndltd.org/etd/ets-quebec/oai:espace.etsmtl.ca:3545","repository":{"repo_id":"ets-quebec","name":"ETS (Quebec)","base_url":"https://espace.etsmtl.ca/cgi/oai2"},"display":{"title":"Publish/subscribe method for data processing in massive IoT leveraging blockchain for secured storage","abstract":"In the era of the Internet of Things (IoT), the rise of Machine-Type Devices (MTDs) has brought about Massive IoT (MIoT) or massive Mache-Type Communication (mMTC), creating new possibilities for connected devices. However, dealing with the substantial and diverse data streams in real time poses challenges. To address this, we employ Publish/Subscribe messaging architecture, specifically designed for real-time data processing capabilities. Our method involves a publish/subscribe system, where device data is sent to a dedicated broker acting as a separate server. This broker allows any application to subscribe to the dataset, fostering a dynamic and responsive data environment. At the heart of our data transmission setup is a Distributed Store and Stream-Processing Platform (Apache Kafka version 3.6.1), recognized for its effective data flow management. Kafka, which takes advantage of Publish/Subscribe architecture, facilitates the connection between MIoT sensors and brokers, supporting parallel clusters for improved scalability. On top of our real-time event streaming engine, we employ analytical database software such as Apache Druid version 28.0.0, known for its real-time analysis capabilities. On the other hand, to ensure uninterrupted connectivity, we integrate a fail-safe mechanism using two Software-Defined Radios (SDR) called Nutaq PicoLTE Release 1.5 in our model. This redundancy enhances data transmission availability, protecting against connectivity disruptions. For data repository security, we leverage blockchain technology, specifically InetrPlanetary File System and Hyperledger Fabric, known for their high-performance characteristics, ensuring data integrity, immutability, and security. Our latency results show that our platform significantly reduces latency for 100,000 devices classified as MIoT to under 25 milliseconds. Additionally, our research on blockchain performance highlights our model as a secure platform, achieving over 800 Transactions Per Second in a dataset of 14,000 transactions, demonstrating its high efficiency.","abstract_html":"In the era of the Internet of Things (IoT), the rise of Machine-Type Devices (MTDs) has brought about Massive IoT (MIoT) or massive Mache-Type Communication (mMTC), creating new possibilities for connected devices. However, dealing with the substantial and diverse data streams in real time poses challenges. To address this, we employ Publish/Subscribe messaging architecture, specifically designed for real-time data processing capabilities. Our method involves a publish/subscribe system, where device data is sent to a dedicated broker acting as a separate server. This broker allows any application to subscribe to the dataset, fostering a dynamic and responsive data environment. At the heart of our data transmission setup is a Distributed Store and Stream-Processing Platform (Apache Kafka version 3.6.1), recognized for its effective data flow management. Kafka, which takes advantage of Publish/Subscribe architecture, facilitates the connection between MIoT sensors and brokers, supporting parallel clusters for improved scalability. On top of our real-time event streaming engine, we employ analytical database software such as Apache Druid version 28.0.0, known for its real-time analysis capabilities. On the other hand, to ensure uninterrupted connectivity, we integrate a fail-safe mechanism using two Software-Defined Radios (SDR) called Nutaq PicoLTE Release 1.5 in our model. This redundancy enhances data transmission availability, protecting against connectivity disruptions. For data repository security, we leverage blockchain technology, specifically InetrPlanetary File System and Hyperledger Fabric, known for their high-performance characteristics, ensuring data integrity, immutability, and security. Our latency results show that our platform significantly reduces latency for 100,000 devices classified as MIoT to under 25 milliseconds. Additionally, our research on blockchain performance highlights our model as a secure platform, achieving over 800 Transactions Per Second in a dataset of 14,000 transactions, demonstrating its high efficiency.","abstract_has_math":false,"creators":["Ataei Kachouei, Mohammad Hossein"],"institution":"École de technologie supérieure","degree_name":"Mémoire de maîtrise électronique","degree_level":"masters","degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-07-02","date_published":"2024-07-02","updated_at":"2026-11-18T22:10:21Z","subjects":["méthode de publication/abonnement, Internet des objets massif, traitement de données en temps réel (Apache Kafka), analyse de données (Apache Druid), scalabilité, disponibilité, sécurité"],"languages":["en"],"rights":[],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["INSERT-YOUR-LIBRARY-ID-HERE3545"],"render_values":[{"text":"INSERT-YOUR-LIBRARY-ID-HERE3545","href":null,"code":true}]}],"person_identifier_entries":[]},"links":{"outbound_url":null,"outbound_label":null,"outbound_source":null,"record_url":null,"record_label":null,"record_kind":null,"record_source":null,"download_url":"https://espace.etsmtl.ca/id/eprint/3545/1/ATAEI_KACHOUEI_Mohammad_Hossein.pdf","download_label":"Download PDF","download_source":"dc:identifier","access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://espace.etsmtl.ca/cgi/oai2?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Aespace.etsmtl.ca%3A3545","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:creator","label":"Author","values":["Ataei Kachouei, Mohammad Hossein"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2024-07-02"]},{"key":"dc:publisher","label":"Institution","values":["École de technologie supérieure"]},{"key":"dc:type","label":"Dc Type","values":["Electronic Thesis or Dissertation"]},{"key":"thesis:degree_level","label":"Degree Level","values":["masters"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Mémoire de maîtrise électronique"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["École de technologie supérieure"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["méthode de publication/abonnement, Internet des objets massif, traitement de données en temps réel (Apache Kafka), analyse de données (Apache Druid), scalabilité, disponibilité, sécurité"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["INSERT-YOUR-LIBRARY-ID-HERE3545","https://espace.etsmtl.ca/id/eprint/3545/1/ATAEI_KACHOUEI_Mohammad_Hossein.pdf"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["In the era of the Internet of Things (IoT), the rise of Machine-Type Devices (MTDs) has brought about Massive IoT (MIoT) or massive Mache-Type Communication (mMTC), creating new possibilities for connected devices. However, dealing with the substantial and diverse data streams in real time poses challenges. To address this, we employ Publish/Subscribe messaging architecture, specifically designed for real-time data processing capabilities. Our method involves a publish/subscribe system, where device data is sent to a dedicated broker acting as a separate server. This broker allows any application to subscribe to the dataset, fostering a dynamic and responsive data environment. At the heart of our data transmission setup is a Distributed Store and Stream-Processing Platform (Apache Kafka version 3.6.1), recognized for its effective data flow management. Kafka, which takes advantage of Publish/Subscribe architecture, facilitates the connection between MIoT sensors and brokers, supporting parallel clusters for improved scalability. On top of our real-time event streaming engine, we employ analytical database software such as Apache Druid version 28.0.0, known for its real-time analysis capabilities. On the other hand, to ensure uninterrupted connectivity, we integrate a fail-safe mechanism using two Software-Defined Radios (SDR) called Nutaq PicoLTE Release 1.5 in our model. This redundancy enhances data transmission availability, protecting against connectivity disruptions. For data repository security, we leverage blockchain technology, specifically InetrPlanetary File System and Hyperledger Fabric, known for their high-performance characteristics, ensuring data integrity, immutability, and security. Our latency results show that our platform significantly reduces latency for 100,000 devices classified as MIoT to under 25 milliseconds. Additionally, our research on blockchain performance highlights our model as a secure platform, achieving over 800 Transactions Per Second in a dataset of 14,000 transactions, demonstrating its high efficiency."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Publish/subscribe method for data processing in massive IoT leveraging blockchain for secured storage"]}]}],"canonical_facts":{"dc:creator":["Ataei Kachouei, Mohammad Hossein"],"dc:date":["2024-07-02"],"dc:description":["In the era of the Internet of Things (IoT), the rise of Machine-Type Devices (MTDs) has brought about Massive IoT (MIoT) or massive Mache-Type Communication (mMTC), creating new possibilities for connected devices. However, dealing with the substantial and diverse data streams in real time poses challenges. To address this, we employ Publish/Subscribe messaging architecture, specifically designed for real-time data processing capabilities. Our method involves a publish/subscribe system, where device data is sent to a dedicated broker acting as a separate server. This broker allows any application to subscribe to the dataset, fostering a dynamic and responsive data environment. At the heart of our data transmission setup is a Distributed Store and Stream-Processing Platform (Apache Kafka version 3.6.1), recognized for its effective data flow management. Kafka, which takes advantage of Publish/Subscribe architecture, facilitates the connection between MIoT sensors and brokers, supporting parallel clusters for improved scalability. On top of our real-time event streaming engine, we employ analytical database software such as Apache Druid version 28.0.0, known for its real-time analysis capabilities. On the other hand, to ensure uninterrupted connectivity, we integrate a fail-safe mechanism using two Software-Defined Radios (SDR) called Nutaq PicoLTE Release 1.5 in our model. This redundancy enhances data transmission availability, protecting against connectivity disruptions. For data repository security, we leverage blockchain technology, specifically InetrPlanetary File System and Hyperledger Fabric, known for their high-performance characteristics, ensuring data integrity, immutability, and security. Our latency results show that our platform significantly reduces latency for 100,000 devices classified as MIoT to under 25 milliseconds. Additionally, our research on blockchain performance highlights our model as a secure platform, achieving over 800 Transactions Per Second in a dataset of 14,000 transactions, demonstrating its high efficiency."],"dc:format":["application/pdf"],"dc:identifier":["INSERT-YOUR-LIBRARY-ID-HERE3545","https://espace.etsmtl.ca/id/eprint/3545/1/ATAEI_KACHOUEI_Mohammad_Hossein.pdf"],"dc:language":["en"],"dc:publisher":["École de technologie supérieure"],"dc:subject":["méthode de publication/abonnement, Internet des objets massif, traitement de données en temps réel (Apache Kafka), analyse de données (Apache Druid), scalabilité, disponibilité, sécurité"],"dc:title":["Publish/subscribe method for data processing in massive IoT leveraging blockchain for secured storage"],"dc:type":["Electronic Thesis or Dissertation"],"thesis:degree_level":["masters"],"thesis:degree_name":["Mémoire de maîtrise électronique"],"thesis:institution_name":["École de technologie supérieure"]},"updated_at":"2026-11-18T22:10:21Z"}