MQTT Architecture for Stream Analytics of PMU Data

Paul Brogan; Andres Jarmillo; Xueqin Amy Liu; John Hastings; David Laverty; D. John Morrow; Connor Duggan; Robert Best

doi:10.1109/ISSC52156.2021.9467849

MQTT Architecture for Stream Analytics of PMU Data

Paul Brogan, Andres Jarmillo, Xueqin Amy Liu, John Hastings, David Laverty, D. John Morrow, Connor Duggan, Robert Best

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Synchrophasor data, derived from Phasor Measurement Units, offers great potential to provide insights into the operation of electrical power systems in the presence of high capacities of renewable generation. Accessing synchrophasor data is challenging since established protocols are rigidly hierarchical and 'point-to-point', based on serialized methodologies requiring 'data concentrators'. This makes real-time and in-stream analysis of synchrophasor data very cumbersome. An alternative is explored in this paper. This novel method is database independent, and allows for synchrophasSaveor data transport, analysis and archival. Using a publish-subscribe MQTT broker, real-time stream analytics are made available in real-time through republishing to new MQTT topics. The advantages of MQTT as a development and deployment platform are presented; in terms of scalability, computational efficiency, latency, modular development, data rate and failover. The dependency chain of an event detector is presented in detail, highlighting the JSON communication protocol used and the implemented topic structure. An intention of this paper is to present the topic name convention and JSON schema employed and invite debate on conventions.

Original language	English
Title of host publication	2021 32nd Irish Signals and Systems Conference (ISSC 2021): Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781665434294
DOIs	https://doi.org/10.1109/ISSC52156.2021.9467849
Publication status	Published - 01 Jul 2021
Event	32nd Irish Signals and Systems Conference, ISSC 2021 - Athlone, Ireland Duration: 10 Jun 2021 → 11 Jun 2021

Publication series

Name	2021 32nd Irish Signals and Systems Conference, ISSC 2021
Publisher	IEEE
ISSN (Print)	2688-1446
ISSN (Electronic)	2688-1454

Conference

Conference	32nd Irish Signals and Systems Conference, ISSC 2021
Country/Territory	Ireland
City	Athlone
Period	10/06/2021 → 11/06/2021

Bibliographical note

Funding Information:
This work is part of SPIRE2 (Storage Platform for the Integration of Renewable Energy 2) project, supported by the European Union’s INTERREG VA Programme, managed by the Special EU Programmes Body (SEUPB). The views and opinions expressed in this paper do not necessarily reflect those of the European Commission or SEUPB.

Funding Information:
Supported by the SPIRE 2 a project in the European Union’s INTERREG VA Programme, managed by the Special EU Programmes Body (SEUPB), under the grant SPIRE2_INT-VA-049. 978-1-6654-3429-4/21/$31.00 ©2021 IEEE

Publisher Copyright:
© 2021 IEEE.

Copyright:
Copyright 2021 Elsevier B.V., All rights reserved.

Keywords

Failover
MQTT
PMU
Stream Analytics

ASJC Scopus subject areas

Signal Processing

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1109/ISSC52156.2021.9467849Licence: Unspecified

Cite this

Brogan, P., Jarmillo, A., Liu, X. A., Hastings, J., Laverty, D., Morrow, D. J., Duggan, C., & Best, R. (2021). MQTT Architecture for Stream Analytics of PMU Data. In 2021 32nd Irish Signals and Systems Conference (ISSC 2021): Proceedings [9467849] (2021 32nd Irish Signals and Systems Conference, ISSC 2021). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISSC52156.2021.9467849

@inproceedings{5ad928ff70854be8b146b18f607b4282,

title = "MQTT Architecture for Stream Analytics of PMU Data",

abstract = "Synchrophasor data, derived from Phasor Measurement Units, offers great potential to provide insights into the operation of electrical power systems in the presence of high capacities of renewable generation. Accessing synchrophasor data is challenging since established protocols are rigidly hierarchical and 'point-to-point', based on serialized methodologies requiring 'data concentrators'. This makes real-time and in-stream analysis of synchrophasor data very cumbersome. An alternative is explored in this paper. This novel method is database independent, and allows for synchrophasSaveor data transport, analysis and archival. Using a publish-subscribe MQTT broker, real-time stream analytics are made available in real-time through republishing to new MQTT topics. The advantages of MQTT as a development and deployment platform are presented; in terms of scalability, computational efficiency, latency, modular development, data rate and failover. The dependency chain of an event detector is presented in detail, highlighting the JSON communication protocol used and the implemented topic structure. An intention of this paper is to present the topic name convention and JSON schema employed and invite debate on conventions.",

keywords = "Failover, MQTT, PMU, Stream Analytics",

author = "Paul Brogan and Andres Jarmillo and Liu, {Xueqin Amy} and John Hastings and David Laverty and Morrow, {D. John} and Connor Duggan and Robert Best",

note = "Funding Information: This work is part of SPIRE2 (Storage Platform for the Integration of Renewable Energy 2) project, supported by the European Union{\textquoteright}s INTERREG VA Programme, managed by the Special EU Programmes Body (SEUPB). The views and opinions expressed in this paper do not necessarily reflect those of the European Commission or SEUPB. Funding Information: Supported by the SPIRE 2 a project in the European Union{\textquoteright}s INTERREG VA Programme, managed by the Special EU Programmes Body (SEUPB), under the grant SPIRE2_INT-VA-049. 978-1-6654-3429-4/21/$31.00 {\textcopyright}2021 IEEE Publisher Copyright: {\textcopyright} 2021 IEEE. Copyright: Copyright 2021 Elsevier B.V., All rights reserved.; 32nd Irish Signals and Systems Conference, ISSC 2021 ; Conference date: 10-06-2021 Through 11-06-2021",

year = "2021",

month = jul,

day = "1",

doi = "10.1109/ISSC52156.2021.9467849",

language = "English",

series = "2021 32nd Irish Signals and Systems Conference, ISSC 2021",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2021 32nd Irish Signals and Systems Conference (ISSC 2021): Proceedings",

}

Brogan, P, Jarmillo, A, Liu, XA, Hastings, J, Laverty, D , Morrow, DJ, Duggan, C & Best, R 2021, MQTT Architecture for Stream Analytics of PMU Data. in 2021 32nd Irish Signals and Systems Conference (ISSC 2021): Proceedings., 9467849, 2021 32nd Irish Signals and Systems Conference, ISSC 2021, Institute of Electrical and Electronics Engineers Inc., 32nd Irish Signals and Systems Conference, ISSC 2021, Athlone, Ireland, 10/06/2021. https://doi.org/10.1109/ISSC52156.2021.9467849

MQTT Architecture for Stream Analytics of PMU Data. / Brogan, Paul; Jarmillo, Andres; Liu, Xueqin Amy et al.

2021 32nd Irish Signals and Systems Conference (ISSC 2021): Proceedings. Institute of Electrical and Electronics Engineers Inc., 2021. 9467849 (2021 32nd Irish Signals and Systems Conference, ISSC 2021).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - MQTT Architecture for Stream Analytics of PMU Data

AU - Brogan, Paul

AU - Jarmillo, Andres

AU - Liu, Xueqin Amy

AU - Hastings, John

AU - Laverty, David

AU - Morrow, D. John

AU - Duggan, Connor

AU - Best, Robert

N1 - Funding Information: This work is part of SPIRE2 (Storage Platform for the Integration of Renewable Energy 2) project, supported by the European Union’s INTERREG VA Programme, managed by the Special EU Programmes Body (SEUPB). The views and opinions expressed in this paper do not necessarily reflect those of the European Commission or SEUPB. Funding Information: Supported by the SPIRE 2 a project in the European Union’s INTERREG VA Programme, managed by the Special EU Programmes Body (SEUPB), under the grant SPIRE2_INT-VA-049. 978-1-6654-3429-4/21/$31.00 ©2021 IEEE Publisher Copyright: © 2021 IEEE. Copyright: Copyright 2021 Elsevier B.V., All rights reserved.

PY - 2021/7/1

Y1 - 2021/7/1

N2 - Synchrophasor data, derived from Phasor Measurement Units, offers great potential to provide insights into the operation of electrical power systems in the presence of high capacities of renewable generation. Accessing synchrophasor data is challenging since established protocols are rigidly hierarchical and 'point-to-point', based on serialized methodologies requiring 'data concentrators'. This makes real-time and in-stream analysis of synchrophasor data very cumbersome. An alternative is explored in this paper. This novel method is database independent, and allows for synchrophasSaveor data transport, analysis and archival. Using a publish-subscribe MQTT broker, real-time stream analytics are made available in real-time through republishing to new MQTT topics. The advantages of MQTT as a development and deployment platform are presented; in terms of scalability, computational efficiency, latency, modular development, data rate and failover. The dependency chain of an event detector is presented in detail, highlighting the JSON communication protocol used and the implemented topic structure. An intention of this paper is to present the topic name convention and JSON schema employed and invite debate on conventions.

AB - Synchrophasor data, derived from Phasor Measurement Units, offers great potential to provide insights into the operation of electrical power systems in the presence of high capacities of renewable generation. Accessing synchrophasor data is challenging since established protocols are rigidly hierarchical and 'point-to-point', based on serialized methodologies requiring 'data concentrators'. This makes real-time and in-stream analysis of synchrophasor data very cumbersome. An alternative is explored in this paper. This novel method is database independent, and allows for synchrophasSaveor data transport, analysis and archival. Using a publish-subscribe MQTT broker, real-time stream analytics are made available in real-time through republishing to new MQTT topics. The advantages of MQTT as a development and deployment platform are presented; in terms of scalability, computational efficiency, latency, modular development, data rate and failover. The dependency chain of an event detector is presented in detail, highlighting the JSON communication protocol used and the implemented topic structure. An intention of this paper is to present the topic name convention and JSON schema employed and invite debate on conventions.

KW - Failover

KW - MQTT

KW - PMU

KW - Stream Analytics

U2 - 10.1109/ISSC52156.2021.9467849

DO - 10.1109/ISSC52156.2021.9467849

M3 - Conference contribution

AN - SCOPUS:85114428143

T3 - 2021 32nd Irish Signals and Systems Conference, ISSC 2021

BT - 2021 32nd Irish Signals and Systems Conference (ISSC 2021): Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 32nd Irish Signals and Systems Conference, ISSC 2021

Y2 - 10 June 2021 through 11 June 2021

ER -

MQTT Architecture for Stream Analytics of PMU Data

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

UN SDGs

Access to Document

Fingerprint

Cite this