Can I process multiline JSON data in HIVE ??

[debuggerrr]

I am able to create table and process data for single line JSON data but my question is can I process JSON data like below:

[{
	"field1": "data1",
	"field2": 100,
	"field3": "more data1",
	"field4": 123.001
}, {
	"field1": "data2",
	"field2": 200,
	"field3": "more data2",
	"field4": 123.002
}, {
	"field1": "data3",
	"field2": 300,
	"field3": "more data3",
	"field4": 123.003
}, {
	"field1": "data4",
	"field2": 400,
	"field3": "more data4",
	"field4": 123.004
}]

I have read that multiline JSON data wasn't supported in HIVE but can I use it now?? If yes, then please share the links where I can find this because I searched alot for this but I couldn't find any relevant material for this. Thanks in advance .

[rcongiu]

Do you have an actual file sample ? SerDe won't work unless there's one JSON record per line. R. ------------------------------------------------------- "Good judgment comes from experience. Experience comes from bad judgment" ------------------------------------------------------- On Sunday, November 12, 2017, 5:06:32 AM PST, debuggerrr <[email protected]> wrote: I want to load below JSON data and for that I am trying to create table as below: CREATE TABLE my_table (field1 string, field2 int, field3 string, field4 double) ROW FORMAT SERDE 'org.openx.data.jsonserde.JsonSerDe' ; I added below JAR files : - hive-json-serde.jar - hive-json-serde-0.2.jar - json-serde-1.3.6-SNAPSHOT-jar-with-dependencies.jar - json-serde-1.3.jar but it gives me below error: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Could not initialize class org.openx.data.jsonserde.objectinspector.JsonObjectInspectorFactory I want to load below data: [{ "field1": "data1", "field2": 100, "field3": "more data1", "field4": 123.001 }, { "field1": "data2", "field2": 200, "field3": "more data2", "field4": 123.002 }, { "field1": "data3", "field2": 300, "field3": "more data3", "field4": 123.003 }, { "field1": "data4", "field2": 400, "field3": "more data4", "field4": 123.004 }] I referred many links from stackoverflow as well as from github but of no use. Please help me with this. Let me know where I am going wrong. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or mute the thread.

[debuggerrr]

I am able to create table and process data for single line JSON data but my question is can I process JSON data like below:

[{
"field1": "data1",
"field2": 100,
"field3": "more data1",
"field4": 123.001
}, {
"field1": "data2",
"field2": 200,
"field3": "more data2",
"field4": 123.002
}, {
"field1": "data3",
"field2": 300,
"field3": "more data3",
"field4": 123.003
}, {
"field1": "data4",
"field2": 400,
"field3": "more data4",
"field4": 123.004
}]
I have read that multiline JSON data wasn't supported in HIVE but can I use it now?? If yes, then please share the links where I can find this because I searched alot for this but I couldn't find any relevant material for this. Thanks in advance .

[debuggerrr]

Can i have an answer for this ? @rcongiu

[vincenzocapel]

Has someone an answer to this question?
I have the same issue.
thanks

[fayedd]

Since a nomal json should start wih '{' and end with '}', maybe you can remove the '[' and ']' and then set row format delimited fields terminated by ','