In this paper, we aim to answer the following
research question: Is GPT-4 a good data analyst?
To answer this question, we conduct preliminary
studies on GPT-4 to demonstrate its potential capa-
bilities as a data analyst. We quantitatively evaluate
the pros and cons of LLM as a data analyst mainly
from the following metrics: performance,time, and
cost. In specific, we treat GPT-4 as a data analyst to
conduct several end-to-end data analysis problems.
Since there is no existing dataset for such data anal-
ysis problems, we choose one of the most related
dataset NyBench, and add the data analysis part
on top. We design several automatic and human
evaluation metrics to comprehensively evaluate the
quality of the data extracted, charts plotted and data
analysis generated. Experimental results show that
GPT-4 can beat an entry level data analyst in terms
of performance and have comparable performance
to a senior level data analyst. In terms of cost and
time, GPT-4 is much cheaper and faster than hiring
a data analyst.
本文来自知之小站
PDF报告已分享至知识星球，微信扫码加入立享3万+精选资料，年更新1万+精选报告
（星球内含更多专属精选报告.其它事宜可联系zzxz_88@163.com）
