请选择 进入手机版 | 继续访问电脑版

大润晟泽博客

 找回密码
 立即注册
搜索
热搜: 活动 交友 discuz
查看: 503|回复: 0

Elasticsearch —— bulk批量导入数据

[复制链接]

16万

主题

16万

帖子

49万

积分

管理员

Rank: 9Rank: 9Rank: 9

积分
493071
发表于 2021-12-28 19:43:34 | 显示全部楼层 |阅读模式
  1. curl -XPOST localhost:9200/test333/type333/_bulk?pretty -H 'Content-Type: application/json' --data-binary @/www/backup/site/baiduyun.json
复制代码
  1. {"index":{"_id":"1"}}
  2. {"Id":"1173","Did":"9ae1c64b10d040225d5c6992aa691105","Title":null,"Content":null,"Link":"https:\/\/pan.baidu.com\/s\/17Glt9_DxpQhRwP8tniHAnw","PassWord":"LXXH","filename":"[\u814cHGX\u751f S04][ \u5fae\u4fe1\u516c\u4f17\u53f7\uff1a\u7231\u7535\u5f71\u5206\u4eab ]","filelist":"[\u814cHGX\u751f S04][ \u5fae\u4fe1\u516c\u4f17\u53f7\uff1a\u7231\u7535\u5f71\u5206\u4eab ]\r\nS04E01.mp4\r\n","CreateOn":"2021-09-18 20:04:44.889466","key":"\u814c","ReplyCount":"0","LastReplyUserId":null,"LastReplyTime":"0000-00-00 00:00:00"}
  3. {"index":{"_id":"2"}}
  4. {"Id":"1174","Did":"4d9dd36b43b225952354a556c8e2cdec","Title":null,"Content":null,"Link":"https:\/\/pan.baidu.com\/s\/1TD1HeHapucdLpz4B3jDXIA","PassWord":"LXXH","filename":"[\u814cHg\u5148\u751f S01~S03][ \u5fae\u4fe1\u516c\u4f17\u53f7\uff1a\u65b0\u5267\u5206\u4eab ]","filelist":"[\u814cHg\u5148\u751f S01~S03][ \u5fae\u4fe1\u516c\u4f17\u53f7\uff1a\u65b0\u5267\u5206\u4eab ]\r\n[\u814cHGx\u751f S03][ \u5fae\u4fe1\u516c\u4f17\u53f7\uff1a\u65b0\u5267\u5206\u4eab ]\r\n[\u814cHGX\u751f S02][ \u5fae\u4fe1\u516c\u4f17\u53f7\uff1a\u65b0\u5267\u5206\u4eab ]\r\n[\u814cHGX\u751f S01][ \u5fae\u4fe1\u516c\u4f17\u53f7\uff1a\u65b0\u5267\u5206\u4eab ]\r\nS01E10 The Lair WeChat 756290156.mp4\r\nS01E09 Where is WeChat 756290156.mp4\r\nS01E07 Grandpa's Night Out WeChat 756290156.mp4\r\nS01E06 Loose Tooth WeChat 756290156.mp4\r\nS01E05 Dead Man's Curve WeChat 756290156.mp4\r\nS01E03 Foul Ball WeChat 756290156.mp4\r\nS01E02 Father's Day Pie WeChat 756290156.mp4\r\nS01E01 Tommy's Big Job WeChat 756290156.mp4\r\nmr.pickles.s02e10.hdtv.x264-w4f[ettv].mkv\r\nmr.pickles.s02e08.hdtv.x264-mtg[ettv].mkv\r\nMr.Pickles.S02E07.HDTV.x264-BATV[ettv].mkv\r\n","CreateOn":"2021-09-18 20:04:48.575652","key":"\u814c","ReplyCount":"0","LastReplyUserId":null,"LastReplyTime":"0000-00-00 00:00:00"}
  5. {"index":{"_id":"3"}}
  6. {"Id":"1175","Did":"e974c5534bc1ce160220d17481bfccbb","Title":null,"Content":null,"Link":"https:\/\/pan.baidu.com\/s\/1_Sl3_CO7WAXlPwL-IMZpuQ","PassWord":"li7a","filename":"\u7b2c\u4e00\u6279\u4e0b\u8f7d","filelist":"\u7b2c\u4e00\u6279\u4e0b\u8f7d\r\n\u5c0f\u7532\u9c7c\u96f6\u57fa\u7840\u5165\u95e8\u5b66\u4e60Python\u89c6\u9891\u6559\u7a0b\u5168\u595796\u96c6\r\n\u96f6\u57fa\u7840\u5b66python\r\nPython\u5165\u95e8\u5b66\u4e60\u793c\u5305\r\nPython\u96f6\u57fa\u7840\u5230\u6570\u636e\u5206\u6790\u5f00\u53d1\r\nPython\u96f6\u57fa\u7840\u5230\u722c\u866b\u5f00\u53d1\r\nPython\u96f6\u57fa\u7840\u5230WEB\u5f00\u53d1\r\n3.python-Web\u6846\u67b6\r\n2019\u6700\u65b0python\u8fdb\u9636web\u6559\u7a0b\r\n2019\u6700\u65b0python-web\u6848\u4f8b\u6559\u5b66\r\n\u6700\u5168Pycharm\u6559\u7a0b - \u7cbe\u7f16\u7248.pdf\r\n\u8d44\u6599\u4e0b\u8f7d\u5fc5\u8bfb.docx\r\n\u7236\u4e0e\u5b50\u7684\u7f16\u7a0b\u4e4b\u65c5\uff1a\u4e0e\u5c0f\u5361\u7279\u4e00\u8d77\u5b66Python.pdf\r\n\u7f16\u7a0b\u5c0f\u767d\u7684\u7b2c\u4e00\u672c Python \u5165\u95e8\u4e66.pdf\r\n\u300aFlask Web\u5f00\u53d1\u5b9e\u6218\uff1a\u5165\u95e8\u3001\u8fdb\u9636\u4e0e\u539f\u7406\u89e3\u6790\uff08\u674e\u8f89\u8457 \uff09\u300bPDF.pdf\r\n","CreateOn":"2021-09-18 20:04:52.027189","key":"\u814c","ReplyCount":"0","LastReplyUserId":null,"LastReplyTime":"0000-00-00 00:00:00"}



复制代码
需要注意的是{"index":{"_id":"1"}}和文件末尾另起一行换行是不可少的
例如
  1. {"index":{"_id":"1"}}
  2. {"title":"许宝江","url":"7254863","chineseName":"许宝江","sex":"男","occupation":" 滦县农业局局长","nationality":"中国"}
  3. {"index":{"_id":"2"}}
  4. {"title":"鲍志成","url":"2074015","chineseName":"鲍志成","occupation":"医师","nationality":"中国","birthDate":"1901年","deathDate":"1973年","graduatedFrom":"香港大学"}
复制代码
  1. 否则会出现400状态,错误提示分别为

  2. Malformed action/metadata line [1], expected START_OBJECT or END_OBJECT but found [VALUE_STRING]
  3. The bulk request must be terminated by a newline [\n]"
复制代码
在Url中设置默认的index和type
如果在路径中设置了index或者type,那么在JSON中就不需要设置了。如果在JSON中设置,会覆盖掉路径中的配置。





上一篇:安装nodejs指定版本,包含npm(替换数字即可)
下一篇:logstash把mysql数据导入elasticsearch
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

QQ|Archiver|手机版|小黑屋|大润晟泽博客 ( 鲁ICP备17022854号-3 )

GMT+8, 2024-3-29 17:10 , Processed in 0.102779 second(s), 23 queries .

Powered by Discuz! X3.4

Copyright © 2001-2021, Tencent Cloud.

快速回复 返回顶部 返回列表