About the Project
A cloud-native ETL pipeline built for a logistics enterprise. The system ingests data from 15+ sources including IoT sensors, ERP systems, and third-party APIs. It cleanses and transforms data using Apache Spark, and loads it into Snowflake for analytics.
Key Results
2M+ records/day
85% cost reduction
Real-time reporting
Project Gallery
"I think Njabulo was essential to our product because he truly cared to deliver world-class work results"
L
LogiTech SA
Data Engineering
Project Details
Category
Data Engineering
Client
LogiTech SA
Year
2024
Tech Stack
Python
Apache Spark
Snowflake
Airflow
AWS Glue
Kafka