Processing a large number of real-time data streams

Dremio University
1

Hello ,
I’m working on the processing of a large number of real-time data streams.
The specification of a data stream :

  • Protocol : MQTT
  • Data format : JSON

2 goals :
1- Real-time data analysis and display
2- Real-time data storage (long-term) for machine learning and analysis

Thank you
Salim

2

@belgroune What is your question and is there an issue?