Skip to content

add helm setup for the messaging service #6

@rochaporto

Description

@rochaporto

We want to have a single messaging service where all the components exchange work to be done and results as required. As an example, for the communication between the crawler and the cruncher:

  1. crawler fetches flights from a remote source (netcoupe, ...) and stores them in the db
  2. the cruncher has a 'picker' container that fetches from the db the entries requiring (re)processing, and pushes them to the messaging service. this container should have a single replica
  3. the cruncher has a 'cruncher' container that picks an entry from the messaging service, processes it, and stores the result in the db (thermal data, flights stats, etc). this container can have multiple replicas

Need to choose a valid msg service, redis pub/sub or such.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions