Breaking News: Grepper is joining You.com. Read the official announcement!

Sorts this RDD, which is assumed to consist of (key, value) pairs

Ethercourt.ml answered on March 12, 2020 Popularity 3/10 Helpfulness 1/10

answer Sorts this RDD, which is assumed to consist of (key, value) pairs

Sorts this RDD, which is assumed to consist of (key, value) pairs

Comment

# sortByKey(ascending=True, numPartitions=None, keyfunc= <function <lambda> at 0x7fc35dbcf848>)
tmp = [('a', 1), ('b', 2), ('1', 3), ('d', 4), ('2', 5)]
sc.parallelize(tmp).sortByKey().first()
# ('1', 3)
sc.parallelize(tmp).sortByKey(True, 1).collect()
# [('1', 3), ('2', 5), ('a', 1), ('b', 2), ('d', 4)]
sc.parallelize(tmp).sortByKey(True, 2).collect()
# [('1', 3), ('2', 5), ('a', 1), ('b', 2), ('d', 4)]
tmp2 = [('Mary', 1), ('had', 2), ('a', 3), ('little', 4), ('lamb', 5)]
tmp2.extend([('whose', 6), ('fleece', 7), ('was', 8), ('white', 9)])
sc.parallelize(tmp2).sortByKey(True, 3, keyfunc=lambda k: k.lower()).collect()
# [('a', 3), ('fleece', 7), ('had', 2), ('lamb', 5),...('white', 9)]

Popularity 3/10 Helpfulness 1/10 Language python

Source: spark.apache.org

Tags: python this

Link to this answer
Share Copy Link

Contributed on Mar 12 2020

Ethercourt.ml

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

Sorts this RDD, which is assumed to consist of (key, value) pairs

Contents

More Related Answers

Sorts this RDD, which is assumed to consist of (key, value) pairs

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.