In this paper, we aim to answer the following
research question: Is GPT-4 a good data analyst?
To answer this question, we conduct preliminary
studies on GPT-4 to demonstrate its potential capa-
bilities as a data analyst. We quantitatively evaluate
the pros and cons of LLM as a data analyst mainly
from the following metrics: performance,time, and
cost. In specific, we treat GPT-4 as a data analyst to
conduct several end-to-end data analysis problems.
Since there is no existing dataset for such data anal-
ysis problems, we choose one of the most related
dataset NyBench, and add the data analysis part
on top. We design several automatic and human
evaluation metrics to comprehensively evaluate the
quality of the data extracted, charts plotted and data
analysis generated. Experimental results show that
GPT-4 can beat an entry level data analyst in terms
of performance and have comparable performance
to a senior level data analyst. In terms of cost and
time, GPT-4 is much cheaper and faster than hiring
a data analyst.
本文来自知之小站
报告已上传知识星球，微信扫码加入立享4万+深度报告下载及1年更新。3天内不满意退出星球款项原路退回，欢迎试用。到期续费仅需5折
（如无法加入或其他事宜可联系zzxz_88@163.com）
