当我执行Clickhouse数据导入功能时,程序被系统终止。
执行命令如下:clickhouse-client --user default --password xxxxx --port 9000 -hxxx --database="bds" --input_format_allow_errors_ratio=0.1 --query="insert into ... FORMAT CSV" < /1.csv
报告的错误是:[2478416.927226] Out of memory: Kill process 19696 (clickhouse-serv) score 12 or sacrifice child [2478416.928855] Killed process 19696 (clickhouse-serv), UID 0, total-vm:46668916kB, anon-rss:1008480kB, file-rss:0kB, shmem-rss:0kB
数据文件有122g,服务器内存128G,如何让Clickhouse命令合理导入呢,希望大家能帮我,谢谢!
发布于 2021-04-29 20:51:01
最有可能是个bug。您使用的是什么版本的CH?
尝试添加参数--input_format_parallel_parsing=0 --optimize_on_insert=0
--input_format_parallel_parsing arg Enable parallel parsing for some data formats.
--optimize_on_insert arg Do the same transformation for inserted block of data as if merge was done on this block.https://stackoverflow.com/questions/67315549
复制相似问题