Pentaho Data Integration
InstallationBusiness AnalyticsCToolsData CatalogData QualityLLMs
  • Overview
    • Pentaho Data Integration ..
  • Data Integration
    • Getting Started
      • Configuring PDI UI
      • KETTLE Variables
    • Concepts & Terminolgy
      • Hello World
      • Logging
      • Error Handling
    • Data Sources
      • Flat Files
        • Text
          • Text File Input
          • Text File Output
        • Excel
          • Excel Writer
        • XML
          • Read XML
        • JSON
          • Read JSON
      • Databases
        • CRUID
          • Database Connections
          • Create DB
          • Read DB
          • Update DB
          • Insert / Update DB
          • Delete DB
        • SCDs
          • SCDs
      • Object Stores
        • MinIO
      • SMB
      • Big Data
        • Hadoop
          • Apache Hadoop
    • Enrich Data
      • Merge
        • Merge Streams
        • Merge Rows (diff)
      • Joins
        • Cross Join
        • Merge Join
        • Database Join
        • XML Join
      • Lookups
        • Database Lookups
      • Scripting
        • Formula
        • Modified JavaScript Value
        • User Defined Java Class
    • Enterprise Solution
      • Jobs
        • Job - Hello World
        • Backward Chaining
        • Parallel
      • Parameters & Variables
        • Parameters
        • Variables
      • Scalability
        • Run Configurations
        • Partition
      • Monitoring & Scheduling
        • Monitoring & Scheduling
      • Logging
        • Logging
      • Dockmaker
        • BA & DI Servers
      • Metadata Injection
        • MDI
    • Plugins
      • Hierarchical Data Type
  • Use Cases
    • Streaming Data
      • MQTT
        • Mosquitto
        • HiveMQ
      • AMQP
        • RabbitMQ
      • Kafka
        • Kafka
    • Machine Learning
      • Prerequiste Tasks
      • AutoML
      • Credit Card
    • RESTful API
    • Jenkins
    • GenAI
  • Reference
    • Page 1
Powered by GitBook
On this page
  1. Use Cases
  2. Streaming Data

MQTT

Publish / Subscribe

PreviousStreaming DataNextMosquitto

Last updated 1 month ago

Message Queuing Telemetry Transport

is a standard messaging protocol used for the (IoT) because it requires minimal resources and can be executed by small microcontrollers found in connected devices.

IoT devices have a real need for this type of lightweight protocol because it guarantees fast and reliable communication with minimal hardware requirements, keeping power consumption and manufacturing costs low.

IoT devices like smart temperature sensors regularly transmit information over the internet, but before you can deduce any meaningful information from that measurement, you need to store it in an adequate database. Smart sensor measurements are not complex, but they are highly dependent on the time constant — when the measurement was taken — and as a result, time-series databases, like InfluxDB, offer an efficient option to store and manipulate that kind of data.

Workshops

Mosquitto

In this Lab, we take a look at a logistics use case. Each of our delivery trucks is fitted with sensors monitoring:

  • Headlights

  • Axle vibration

  • Tyre pressure

  • Load

  • Engine temp

  • GPS co-ordinates

The streamed data will help optimize routes and enable predictive maintenance.

HiveMQ

Real-time data monitoring, from various devices and sensors such as pumps, motors, valves, and temperature sensors, with SCADA (Supervisory Control and Data Acquisition) systems is critical to modern industrial processes.

Various communication protocols, including Modbus and DNP3, enable Predictive maintenance and early fault detection, reducing the need for manual inspections and minimizing maintenance costs.

In this lab we're going to generate some robot sensor data that will be streamed to a broker that operates a 'Sparkplug' Architecture.

Mosquitto
HiveMQ
MQTT
Internet of Things
MQTT - Publish / Subscribe
Generate sensor data
HiveMQ