Get value by key from json array

SAMER SAEID answered on May 15, 2022 Popularity 9/10 Helpfulness 1/10

answer Get value by key from json array

Get value by key from json array

Comment

import org.apache.spark.sql.types._
import org.apache.spark.sql.functions._
val df1 = spark.read.format("text").load("file path")
val schema = ArrayType(StructType(Array(
      StructField("key", StringType),
      StructField("value", StringType)
    )))

val arrayToMap = udf[Map[String, String], Seq[Row]] {
  array => array.map { case Row(key: String, value: String) => (key, value) }.toMap
}
val dfJSON = df1.withColumn("jsonData",from_json(col("value"),schema))
    .select("jsonData").withColumn("address", arrayToMap(col("jsonData")))
    .withColumn("city", when(col("address.city").isNotNull, col("address.city")).otherwise(lit(""))).withColumn("street",  when(col("address.street").isNotNull, col("address.street")).otherwise(lit("")))
dfJSON.printSchema()
dfJSON.show(false)

Popularity 9/10 Helpfulness 1/10 Language javascript

Source: Grepper

Tags: get javascript json key

Link to this answer
Share Copy Link

Contributed on May 15 2022

SAMER SAEID

0 Answers Avg Quality 2/10

Get value by key from json array

Contents

More Related Answers

Get value by key from json array

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.