User Tools

Site Tools


tanszek:oktatas:iss_t:messaging_systems

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
tanszek:oktatas:iss_t:messaging_systems [2023/04/24 18:59] – [MQTT example] kneheztanszek:oktatas:iss_t:messaging_systems [2025/04/14 07:31] (current) – [MQTT example] knehez
Line 15: Line 15:
 A message queue is a software that enables communication between different software components in a distributed system. It allows components to exchange messages asynchronously, which can improve the overall reliability and scalability of the system. Message queues are commonly used in software integration, where they facilitate the exchange of messages between different applications, services, and systems. A message queue is a software that enables communication between different software components in a distributed system. It allows components to exchange messages asynchronously, which can improve the overall reliability and scalability of the system. Message queues are commonly used in software integration, where they facilitate the exchange of messages between different applications, services, and systems.
  
-RabbitMQ (https://www.rabbitmq.com/#features) is a popular open-source message broker that implements the Advanced Message Queuing Protocol AMQP ([[https://www.rabbitmq.com/resources/specs/amqp0-9-1]]). It allows applications to communicate with each other through a message queue, which can be hosted locally or in the cloud. RabbitMQ supports a wide range of messaging patterns, including point-to-point, publish-subscribe, and request-reply. It also provides features such as message persistence, routing, and priority queuing.+RabbitMQ (https://www.rabbitmq.com/#features) is a popular open-source message broker that implements the Advanced Message Queuing Protocol AMQP ([[https://docs.oasis-open.org/amqp/core/v1.0/os/amqp-core-types-v1.0-os.html]]). It allows applications to communicate with each other through a message queue, which can be hosted locally or in the cloud. RabbitMQ supports a wide range of messaging patterns, including point-to-point, publish-subscribe, and request-reply. It also provides features such as message persistence, routing, and priority queuing.
  
 In RabbitMQ, messages are published by producers to a specific exchange, which routes them to one or more queues based on the specified routing key. Consumers then subscribe to the queues and receive messages. RabbitMQ supports multiple programming languages, including Java, Python, .NET, and Node.js, making it a versatile messaging solution for various use cases. In RabbitMQ, messages are published by producers to a specific exchange, which routes them to one or more queues based on the specified routing key. Consumers then subscribe to the queues and receive messages. RabbitMQ supports multiple programming languages, including Java, Python, .NET, and Node.js, making it a versatile messaging solution for various use cases.
Line 53: Line 53:
 This code sets up a callback function that will be called every time a message is received from the 'my_queue' queue. The `auto_ack` parameter specifies whether to automatically acknowledge the message after it has been processed. Finally, the `start_consuming` method starts consuming messages from the queue. This code sets up a callback function that will be called every time a message is received from the 'my_queue' queue. The `auto_ack` parameter specifies whether to automatically acknowledge the message after it has been processed. Finally, the `start_consuming` method starts consuming messages from the queue.
  
-==== Type of "Exchange" in RabbitMQ ====+=====  Type of "Exchange" in RabbitMQ ===== 
  
 An exchange in RabbitMQ is a messaging entity that receives messages from producers and routes them to queues based on some criteria. When a producer sends a message to RabbitMQ, it sends the message to an exchange. The exchange then examines the message's routing key and decides which queue(s) the message should be sent to. An exchange in RabbitMQ is a messaging entity that receives messages from producers and routes them to queues based on some criteria. When a producer sends a message to RabbitMQ, it sends the message to an exchange. The exchange then examines the message's routing key and decides which queue(s) the message should be sent to.
Line 107: Line 107:
 Each exchange type has its own routing algorithm and is used in different messaging scenarios. Understanding the exchange types is important when designing RabbitMQ architectures that meet specific business requirements. Each exchange type has its own routing algorithm and is used in different messaging scenarios. Understanding the exchange types is important when designing RabbitMQ architectures that meet specific business requirements.
  
-==== MQTT example ====+===== MQTT example ===== 
  
 Clone repository into docker playground: Clone repository into docker playground:
  
     git clone https://github.com/knehez/isi.git     git clone https://github.com/knehez/isi.git
 +    cd isi/mqtt-python
 +    docker-compose up
  
-docker-compose.yml +docker-compose.yml defines a multi-container application with three services: mqtt, consumer, and producer.
- +
-This file defines a multi-container application with three services: mqtt, consumer, and producer.+
  
 The mqtt service is an instance of the //toke/mosquitto// Docker image, which is a popular open-source MQTT broker. The service is configured to automatically restart unless it is explicitly stopped by the user. Additionally, three volumes are defined for the service: "/mosquitto/conf", "/mosquitto/data", and "/mosquitto/log". These volumes are used to persist the configuration, data, and log files for the MQTT broker respectively. The mqtt service is an instance of the //toke/mosquitto// Docker image, which is a popular open-source MQTT broker. The service is configured to automatically restart unless it is explicitly stopped by the user. Additionally, three volumes are defined for the service: "/mosquitto/conf", "/mosquitto/data", and "/mosquitto/log". These volumes are used to persist the configuration, data, and log files for the MQTT broker respectively.
Line 122: Line 122:
  
 Finally, the depends_on key is used to specify that both the consumer and producer services depend on the mqtt service. This means that the mqtt service will be started before the other services, and will be available for use by those services. Finally, the depends_on key is used to specify that both the consumer and producer services depend on the mqtt service. This means that the mqtt service will be started before the other services, and will be available for use by those services.
 +
 +**docker-compose.yml**
  
 <code yml> <code yml>
Line 149: Line 151:
     volumes:     volumes:
         - .:/app               - .:/app      
-    depen+    depends_on: 
 +      - mqtt
 </code> </code>
 +
 +**Dockerfile-consumer**
 +
 +This Dockerfile defines a simple containerized Python application that can be used as a consumer for a message broker. The dependencies are installed in the container, and the consumer code is copied into the container's /app directory. When the container is started, the consumer.py script is executed to consume messages from the broker.
 +
 +<code yml>
 +FROM python:3.9-slim-buster
 +
 +WORKDIR /app
 +
 +COPY requirements.txt .
 +RUN pip install --no-cache-dir -r requirements.txt
 +
 +COPY consumer.py .
 +
 +CMD ["python", "-u", "consumer.py"]
 +</code>
 +
 +Here is a breakdown of the different parts of the Dockerfile:
 +
 +  * FROM python:3.9-slim-buster: This line specifies the base image for the Docker image. In this case, the image is based on Python 3.9 running on a slimmed-down version of the Debian Buster Linux distribution.
 +
 +  * WORKDIR /app: This line sets the working directory for the container to /app. This is where the consumer code and other related files will be located.
 +
 +  * COPY requirements.txt .: This line copies the requirements.txt file from the current directory on the host machine to the /app directory in the container. The requirements.txt file lists the dependencies that the consumer requires to run.
 +
 +  * RUN pip install --no-cache-dir -r requirements.txt: This line installs the dependencies listed in the requirements.txt file using pip. The --no-cache-dir option is used to ensure that pip does not cache the downloaded packages, which can help to reduce the size of the Docker image.
 +
 +  * COPY consumer.py .: This line copies the consumer.py file from the current directory on the host machine to the /app directory in the container. This is the main code file for the consumer.
 +
 +  * CMD ["python", "-u", "consumer.py"]: This line specifies the command to run when the container is started. In this case, it runs the consumer.py script using the Python interpreter (python). The -u flag is used to enable unbuffered output, which ensures that log messages are immediately visible in the console.
 +
 +**consumer.py**
 +
 +<code python>
 +import paho.mqtt.client as mqtt
 +
 +broker = "mqtt"
 +port = 1883
 +
 +timelive = 60
 +
 +def on_connect(client, userdata, flags, rc):
 +    print("Connected with result code "+str(rc))
 +    client.subscribe("/data")
 +
 +
 +def on_message(client, userdata, msg):
 +    print(msg.payload.decode())
 +
 +client = mqtt.Client()
 +client.connect(broker, port, timelive)
 +client.on_connect = on_connect
 +client.on_message = on_message
 +client.loop_forever()
 +</code>
 +
 +**producer.py**
 +
 +<code python>
 +# simulator device 1 for mqtt message publishing
 +import paho.mqtt.client as paho
 +import time
 +import random
 +
 +broker = "mqtt"
 +port = 1883
 +
 +def on_publish(client, userdata, result):
 +    print("Device 1 : Data published.")
 +
 +client = paho.Client("admin")
 +client.on_publish = on_publish
 +client.connect(broker, port)
 +
 +for i in range(20):
 +    d = random.randint(1, 5)
 +
 +    # telemetry to send
 +    message = "Device 1 : Data " + str(i)
 +
 +    time.sleep(d)
 +
 +    # publish message
 +    ret = client.publish("/data", message)
 +
 +print("Stopped...")
 +</code>
 +
 +
tanszek/oktatas/iss_t/messaging_systems.1682362786.txt.gz · Last modified: 2023/04/24 18:59 by knehez