In this paper, we aim to answer the following
research question: Is GPT-4 a good data analyst?
To answer this question, we conduct preliminary
studies on GPT-4 to demonstrate its potential capa-
bilities as a data analyst. We quantitatively evaluate
the pros and cons of LLM as a data analyst mainly
from the following metrics: performance,time, and
cost. In specific, we treat GPT-4 as a data analyst to
conduct several end-to-end data analysis problems.
Since there is no existing dataset for such data anal-
ysis problems, we choose one of the most related
dataset NyBench, and add the data analysis part
on top. We design several automatic and human
evaluation metrics to comprehensively evaluate the
quality of the data extracted, charts plotted and data
analysis generated. Experimental results show that
GPT-4 can beat an entry level data analyst in terms
of performance and have comparable performance
to a senior level data analyst. In terms of cost and
time, GPT-4 is much cheaper and faster than hiring
a data analyst.
本文来自知之小站
报告已上传百度网盘群，限时15元即可入群及获得1年期更新
（如无法加入或其他事宜可联系zzxz_88@163.com）
