ANALYSIS OF THE LARGE VOLUMED DATA FILES USING PYTHON PANDAS AND SNOWFLAKE QUERY

ANALYSIS OF THE LARGE VOLUMED DATA FILES USING PYTHON PANDAS AND SNOWFLAKE QUERY
Author(s):
Dr. Anita Mahajan, Ajay Varma
Keywords:
AWS, cloud-based databases, CSV, Database server.
Abstract
Due to increasing volume of the data that is being utilized every day, the efforts required to make the data into a proper presentable format is very tedious and time taking task. Since, the latest databases that are currently widely used by the various organizations do provide the integration facilities with the various cloud-based AWS technologies. However, since this kind of operations requires continuous communication with the database server and the AWS server. Also, in case of the data fetching from the staging area through the cloud-based databases, applying the file formatting options and the filtering the rows from the CSV file using various conditions on various columns needs time. That’s why querying the data from the staging files somehow fails in this scenario.
Article Details
Unique Paper ID: 157564 Publication Volume & Issue: Volume 9, Issue 7 Page(s): 897 - 901
Article Preview & Download

Share This Article

NCSEM 2024

National Conference on Sustainable Engineering and Management - 2024

Last Date: 15th March 2024

IJIRT.org enables door in research by providing high quality research articles in open access market.

Send us any query related to your research on editor@ijirt.org