Sunday, January 20, 2019

Apache Spark Code Collection

January 20, 2019 by 
Read 'csv' File

 lines = sc.textFile("..../u.data")

Get the first line of  an RDD file type

 lines = sc.textFile("..../u.data")

firstRow=lines.first()

Count the number by Appearance and Show the Results

lines = sc.textFile("/Users/edmondlegaspi/Desktop/Datasets/u.data")

ratings = lines.map(lambda x: x.split()[2])

results = ratings.countByValue()

sortedResults = collections.OrderedDict(sorted(results.items()))

for key, value in sortedResults.items():
    print(key, value)



2 comments:

  1. sathyarameshMay 10, 2019 at 11:03 PM

    Hi,
    I must appreciate you for providing such a valuable content for us. This is one amazing piece of article. Helped a lot in increasing my knowledge.
    CCNA Course in Chennai
    CCNA Training in Chennai
    Blue Prism Training in Chennai
    CCNA Course in Chennai
    Cloud Computing Training in Chennai
    CCNA Training in Tnagar
    CCNA Training in Annanagar

    ReplyDelete
  2. vcubeJanuary 18, 2024 at 10:41 PM

    Good Post! Thank you so much for sharing this pretty post, it was so good to read and useful to improve my knowledge as updated one, keep blogging.
    Web Designing course in Hyderabad

    ReplyDelete

Subscribe to: Post Comments (Atom)