Abstract
The exponential growth of e-commerce has necessitated the development of robust real-time data pipelines capable of processing high-velocity transactional data for instant decision-making. This review paper systematically examines existing methodologies, tools, and challenges in designing and implementing such pipelines, focusing on ingestion, processing, and analytics layers. By analyzing recent literature, we evaluate architectural frameworks (e.g., Kafka, Spark, Flink), performance trade-offs (latency vs. throughput), and emerging trends (AutoML, event-driven architectures). The paper highlights gaps in scalability, privacy, and interpretability while proposing future directions for intelligent, self-optimizing pipelines.
Keywords
Real-Time Data Processing, E-Commerce, Stream Processing, Apache Kafka, Fraud Detection, Automl,Genai, E-Commerce Data
DOI
View DOI - (https://doi.org/10.36713/epra23838)
How to Cite:
Mahesha K, Sagar BR, Tejonidhi M, Yashwanth N , Ambika V , A REVIEW ON REAL-TIME DATA PIPELINES FOR E-COMMERCE TRANSACTIONAL DATA ANALYTICS , Volume 10 , Issue 8, august 2025, EPRA International Journal of Research & Development (IJRD), DOI: https://doi.org/10.36713/epra23838