Data Engineer
Real-Time Olist Lakehouse Data Platform | Databricks, PySpark, Delta Lake |
ViewDatabricks, PySpark, Spark Str, Auto Loader, Python, SQL, AWS
Built an end-to-end Lakehouse platform on Databricks + Delta Lake processing 500k+ records (orders, customers, order items), implementing scalable ETL
Autonomous Fleet Telemetry & Battery Degradation Anomaly Engine |
ViewDatabricks, PySpark, Spark Str, Auto Loader, Python, SQL, AWS , Pytest, Delta Liquid Clusterin
Architected real-time IoT Lakehouse pipeline processing high-frequency CAN-bus, GPS & BMS telemetry using Auto Loader, watermarked Structured Streamin