database
Data Engineering
check_circle Open
Real-Time Data Pipeline for IoT Sensor Network
schedule
Posted 3 weeks ago
business
SensorFlow Labs
group
2 proposals
description Project Description
Design and implement a real-time data pipeline that ingests data from 10,000+ IoT sensors, processes it through Apache Kafka, transforms it with Spark Streaming, and stores results in a time-series database for visualization in Grafana.
checklist Scope of Work
check
Data ingestion layer (MQTT → Kafka)
check
Stream processing with Spark Streaming
check
TimescaleDB schema design
check
Grafana dashboards for real-time monitoring
check
Alerting system for anomalies
check
Documentation & runbooks
code Required Skills
Apache Kafka
Spark
Python
TimescaleDB
Grafana
send Submit Your Proposal
Tell us why you're the best fit for this project.