Literature review : a comparative study of real time streaming technologies and Apache Kafka

Name: Vyas, Shubham

Organization : Amity School of Engineering and Technology

Email : r.shubhamvyas@gmail.com

Name: Tyagi, Rajesh Kumar

Organization : Amity School of Engineering and Technology. Department of Computer Science and Engineering

Email : rktyagi@ggn.amity.edu

Name: Jain, Char

Organization : Amity School of Engineering and Technology. Department of Computer Science and Engineering

Email : cjain@ggn.amity.edu

Name: Sahu, Shashank

Organization : Ajay Kumar Garg Engineering College. Computer Science and Engineering

Email : sahushank25@gmail.com

LCSH: Streaming technology (Telecommunications)

LCSH: Data transmission systems

LCSH: Real-time data processing

Abstract: For data ware housing projects, there are multiple licensed ETL (Extraction Transformation & Load) tools available in the market. To process and pass the data between two applications industry is using ETL tools like IBM Info- sphere Data Stage, Informatica, Ab Initio etc. These tools are exceptionally costly and has recurring enterprise licensees, and processed data is not available in real time, data is getting processed in batches and is available during pre-defined time intervals or on demand. Industry bas started adopting the Open Source technologies to avoid the buge licensing cost and that also includes the complete end to end IT infrastructure cost. Open Source technologies and frameworks enables users to run projects with best in class performance and within the budget. In this literature survey paper, all possible technologies have been studied and evaluated, available in the market capable of real," near-r'eal-time" streaming. All licensed and open source products which are utilized and evaluated by various IT organizations and which are also evaluated by researchers have been included in this survey. There is a need of a distributed scalable technology that enables the users to ensure availability of data from one end point to another in real time with good throughput, performance and low latency. To study this, a detailed comparative survey of an open source technology Apache Kafka has been done and it compared with the other available technologies capable of doing real time streaming.

King Mongkut's University of Technology North Bangkok. Central Library

Address: BANGKOK

Email: library@kmutnb.ac.th

Created: 2021

Modified: 2024-06-11

Issued: 2024-06-10

บทความ/Article

application/pdf

BibliograpyCitation : In IEEE Computer Society. 2021 Fourth International Conference on Computational Intelligence and Communication Technologies (CCICT 2021) (pp.146-153). Los Alamitos, CA : IEEE Computer Society

eng

©copyrights King Mongkut's University of Technology North Bangkok

ลำดับที่.	ชื่อแฟ้มข้อมูล	ขนาดแฟ้มข้อมูล	จำนวนเข้าถึง	วัน-เวลาเข้าถึงล่าสุด
1	CCICT 2021pp.146-153.pdf	732.45 KB

ใช้เวลา

0.029769 วินาที