{"id":141,"date":"2022-05-08T00:46:44","date_gmt":"2022-05-08T00:46:44","guid":{"rendered":"https:\/\/codecrypt76.com\/?p=141"},"modified":"2022-11-25T16:54:37","modified_gmt":"2022-11-25T16:54:37","slug":"create-a-wordcloud-using-python","status":"publish","type":"post","link":"https:\/\/codecrypt76.com\/index.php\/2022\/05\/08\/create-a-wordcloud-using-python\/","title":{"rendered":"Create a WordCloud using Python"},"content":{"rendered":"\n
\"The
The Raven, by Edgar Allan Poe<\/figcaption><\/figure>\n\n\n\n

Here are the instructions I took to create a WordCloud<\/strong> project for the Google IT Automation with Python Course<\/a>. A word cloud is a simple yet powerful visual representation object for text processing<\/strong>, which shows the most frequent word with bigger and bolder letters, and with different colors. The smaller the size of the word the less important it is. The text I used for this project was The Raven<\/a> <\/em>, by Edgar Allan Poe<\/a>.<\/p>\n\n\n\n

The Raven 

by

Edgar Allan Poe


  Once upon a midnight dreary, while I pondered, weak and weary,
  Over many a quaint and curious volume of forgotten lore\u2014
  While I nodded, nearly napping, suddenly there came a tapping,
  As of some one gently rapping, rapping at my chamber door.
  \u201c\u2019Tis some visiter,\u201d I muttered, \u201ctapping at my chamber door\u2014
                                     Only this and nothing more.\u201d

  Ah, distinctly I remember it was in the bleak December,
  And each separate dying ember wrought its ghost upon the floor.
  Eagerly I wished the morrow;\u2014vainly I had sought to borrow
  From my books surcease of sorrow\u2014sorrow for the lost Lenore\u2014
  For the rare and radiant maiden whom the angels name Lenore\u2014
                                     Nameless here for evermore.

  And the silken sad uncertain rustling of each purple curtain
  Thrilled me\u2014filled me with fantastic terrors never felt before;
  So that now, to still the beating of my heart, I stood repeating
  \u201c\u2019Tis some visiter entreating entrance at my chamber door\u2014
  Some late visiter entreating entrance at my chamber door;
                                     This it is and nothing more.\u201d

  Presently my soul grew stronger; hesitating then no longer,
  \u201cSir,\u201d said I, \u201cor Madam, truly your forgiveness I implore;
  But the fact is I was napping, and so gently you came rapping,
  And so faintly you came tapping, tapping at my chamber door,
  That I scarce was sure I heard you\u201d\u2014here I opened wide the door\u2014
                                     Darkness there and nothing more.

  Deep into that darkness peering, long I stood there wondering, fearing,
  Doubting, dreaming dreams no mortals ever dared to dream before;
  But the silence was unbroken, and the stillness gave no token,
  And the only word there spoken was the whispered word, \u201cLenore?\u201d
  This I whispered, and an echo murmured back the word, \u201cLenore!\u201d\u2014
                                     Merely this and nothing more.

  Back into the chamber turning, all my soul within me burning,
  Soon again I heard a tapping something louder than before.
  \u201cSurely,\u201d said I, \u201csurely that is something at my window lattice;
  Let me see, then, what thereat is and this mystery explore\u2014
  Let my heart be still a moment and this mystery explore;\u2014
                                     \u2019Tis the wind and nothing more.\u201d

  Open here I flung the shutter, when, with many a flirt and flutter,
  In there stepped a stately Raven of the saintly days of yore.
  Not the least obeisance made he; not a minute stopped or stayed he,
  But, with mien of lord or lady, perched above my chamber door\u2014
  Perched upon a bust of Pallas just above my chamber door\u2014
                                     Perched, and sat, and nothing more.

  Then the ebony bird beguiling my sad fancy into smiling,
  By the grave and stern decorum of the countenance it wore,
  \u201cThough thy crest be shorn and shaven, thou,\u201d I said, \u201cart sure no craven,
  Ghastly grim and ancient Raven wandering from the Nightly shore\u2014
  Tell me what thy lordly name is on the Night\u2019s Plutonian shore!\u201d
                                     Quoth the Raven, \u201cNevermore.\u201d

  Much I marvelled this ungainly fowl to hear discourse so plainly,
  Though its answer little meaning\u2014little relevancy bore;
  For we cannot help agreeing that no living human being
  Ever yet was blessed with seeing bird above his chamber door\u2014
  Bird or beast upon the sculptured bust above his chamber door,
                                     With such name as \u201cNevermore.\u201d

  But the Raven, sitting lonely on that placid bust, spoke only
  That one word, as if its soul in that one word he did outpour
  Nothing farther then he uttered; not a feather then he fluttered\u2014
  Till I scarcely more than muttered: \u201cOther friends have flown before\u2014
  On the morrow _he_ will leave me, as my Hopes have flown before.\u201d
                                     Then the bird said \u201cNevermore.\u201d

  Startled at the stillness broken by reply so aptly spoken,
  \u201cDoubtless,\u201d said I, \u201cwhat it utters is its only stock and store,
  Caught from some unhappy master whom unmerciful Disaster
  Followed fast and followed faster till his songs one burden bore\u2014
  Till the dirges of his Hope that melancholy burden bore
                                     Of \u2018Never\u2014nevermore.\u2019\u201d

  But the Raven still beguiling all my sad soul into smiling,
  Straight I wheeled a cushioned seat in front of bird and bust and door;
  Then, upon the velvet sinking, I betook myself to linking
  Fancy unto fancy, thinking what this ominous bird of yore\u2014
  What this grim, ungainly, ghastly, gaunt, and ominous bird of yore
                                     Meant in croaking \u201cNevermore.\u201d

  This I sat engaged in guessing, but no syllable expressing
  To the fowl whose fiery eyes now burned into my bosom\u2019s core;
  This and more I sat divining, with my head at ease reclining
  On the cushion\u2019s velvet lining that the lamp-light gloated o\u2019er,
  But whose velvet violet lining with the lamp-light gloating o\u2019er
                                     _She_ shall press, ah, nevermore!

  Then, methought, the air grew denser, perfumed from an unseen censer
  Swung by Seraphim whose foot-falls tinkled on the tufted floor.
  \u201cWretch,\u201d I cried, \u201cthy God hath lent thee\u2014by these angels he hath sent thee
  Respite\u2014respite and nepenthe from thy memories of Lenore!
  Quaff, oh quaff this kind nepenthe and forget this lost Lenore!\u201d
                                     Quoth the Raven, \u201cNevermore.\u201d

  \u201cProphet!\u201d said I, \u201cthing of evil!\u2014prophet still, if bird or devil!\u2014
  Whether Tempter sent, or whether tempest tossed thee here ashore,
  Desolate, yet all undaunted, on this desert land enchanted\u2014
  On this home by Horror haunted\u2014tell me truly, I implore\u2014
  Is there\u2014_is_ there balm in Gilead?\u2014tell me\u2014tell me, I implore!\u201d
                                     Quoth the Raven, \u201cNevermore.\u201d

  \u201cProphet!\u201d said I, \u201cthing of evil!\u2014prophet still, if bird or devil!
  By that Heaven that bends above us\u2014by that God we both adore\u2014
  Tell this soul with sorrow laden if, within the distant Aidenn,
  It shall clasp a sainted maiden whom the angels name Lenore\u2014
  Clasp a rare and radiant maiden whom the angels name Lenore.\u201d
                                     Quoth the Raven, \u201cNevermore.\u201d

  \u201cBe that our sign of parting, bird or fiend!\u201d I shrieked, upstarting\u2014
  \u201cGet thee back into the tempest and the Night\u2019s Plutonian shore!
  Leave no black plume as a token of that lie thy soul has spoken!
  Leave my loneliness unbroken!\u2014quit the bust above my door!
  Take thy beak from out my heart, and take thy form from off my door!\u201d
                                     Quoth the Raven, \u201cNevermore.\u201d

  And the Raven, never flitting, still is sitting, still is sitting
  On the pallid bust of Pallas just above my chamber door;
  And his eyes have all the seeming of a demon\u2019s that is dreaming
  And the lamp-light o\u2019er him streaming throws his shadows on the floor;
  And my soul from out that shadow that lies floating on the floor
                                     Shall be lifted\u2014nevermore!<\/pre>\n\n\n\n
Step 1: Import the necessary libraries <\/h2>\n\n\n\n
\nimport os\nimport re\nfrom collections import Counter\nfrom wordcloud import WordCloud<\/code><\/pre><\/div>\n\n\n\n
The os <\/code>module will be used for setting the path <\/code>of the text file. The re <\/code>module is used for removing punctuations, the  Counter <\/code>module is used for creating a frequency map of the text file, and the wordcloud<\/code> module is used for creating the actual WordCloud Image.<\/p>\n\n\n\n
Step 2: Open the File<\/h2>\n\n\n\n
def get_file(filename):\n    with open(filename, encoding='utf-8') as fo:\n        content = [i.lower().strip() for i in fo]\n    return ' '.join(content)<\/code><\/pre><\/div>\n\n\n\n
Step 3: Clean the Data<\/h2>\n\n\n\n
def clean_file(data):\n    data = re.sub(r'[^\\w\\s]', '', data)\n    stopwords = ('a', 'an', 'and', 'as', 'at', 'but', 'by', 'from', 'he', 'him', 'i', 'is', 'my', 'of', 'or',\n                 'on', 'said', 'that', 'the', 'there', 'this', 'to', 'with')\n    return Counter([word for word in data.split() if word not in stopwords])<\/code><\/pre><\/div>\n\n\n\n
We are using the re <\/code>module to remove all punctuations from the text. Next, we remove all non-interesting words as seen in the tuple stopwords <\/code>in the code above. Finally, we use the Counter <\/code>module  to create a frequency map<\/code> of the new list and return it. <\/p>\n\n\n\n
Step 4: Generate the WordCloud <\/h2>\n\n\n\n
def generate_wordcloud(data):\n    return WordCloud(height=800, width=1200).generate_from_frequencies(data)<\/code><\/pre><\/div>\n\n\n\n
Now we generate the WordCloud. Here I am creating an WordCloud image that is 800×1200 pixels in dimension. <\/p>\n\n\n\n
Step 5: Save the Image  File<\/h2>\n\n\n\n
def save_wordcloud(data, filename):\n    data.to_file(os.path.join(filename))\n    print(f'{filename} has been successfully saved.')<\/code><\/pre><\/div>\n\n\n\n
Finally, we save the WordCloud image. Here the os <\/code>module is used to create a complete path.<\/p>\n\n\n\n
The Complete Code<\/h2>\n\n\n\n
Now lets take a look at the complete code.<\/p>\n\n\n\n
#!\/usr\/bin\/env python3\n\nimport os\nimport re\nfrom collections import Counter\nfrom wordcloud import WordCloud\n\n\ndef get_file(filename):\n    with open(filename, encoding='utf-8') as fo:\n        content = [i.lower().strip() for i in fo]\n    return ' '.join(content)\n\n\ndef clean_file(data):\n    data = re.sub(r'[^\\w\\s]', '', data)\n    stopwords = ('a', 'an', 'and', 'as', 'at', 'but', 'by', 'from', 'he', 'him', 'i', 'is', 'my', 'of', 'or',\n                 'on', 'said', 'that', 'the', 'there', 'this', 'to', 'with')\n    return Counter([word for word in data.split() if word not in stopwords])\n\n\ndef generate_wordcloud(data):\n    return WordCloud(height=800, width=1200).generate_from_frequencies(data)\n\n\ndef save_wordcloud(data, filename):\n    data.to_file(os.path.join(filename))\n    print(f'{filename} has been successfully saved.')\n\n\ndef main():\n    raven_path = os.path.join('the_raven.txt')\n    raven_file = get_file(raven_path)\n\n    process_file = clean_file(raven_file)\n    raven_cloud = generate_wordcloud(process_file)\n    save_wordcloud(raven_cloud, 'raven_cloud.jpg')\n\n\nif __name__ == '__main__':\n    main()<\/code><\/pre><\/div>\n\n\n\n
Final Results<\/h2>\n\n\n\n
\"The<\/figure>\n","protected":false},"excerpt":{"rendered":"
Learn how to create a WordCloud Image using Python and words from the poem “The Raven” by Edgar Allan Poe!<\/p>\n","protected":false},"author":1,"featured_media":146,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[36,7,11,35,12],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/codecrypt76.com\/index.php\/wp-json\/wp\/v2\/posts\/141"}],"collection":[{"href":"https:\/\/codecrypt76.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/codecrypt76.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/codecrypt76.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/codecrypt76.com\/index.php\/wp-json\/wp\/v2\/comments?post=141"}],"version-history":[{"count":10,"href":"https:\/\/codecrypt76.com\/index.php\/wp-json\/wp\/v2\/posts\/141\/revisions"}],"predecessor-version":[{"id":461,"href":"https:\/\/codecrypt76.com\/index.php\/wp-json\/wp\/v2\/posts\/141\/revisions\/461"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/codecrypt76.com\/index.php\/wp-json\/wp\/v2\/media\/146"}],"wp:attachment":[{"href":"https:\/\/codecrypt76.com\/index.php\/wp-json\/wp\/v2\/media?parent=141"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/codecrypt76.com\/index.php\/wp-json\/wp\/v2\/categories?post=141"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/codecrypt76.com\/index.php\/wp-json\/wp\/v2\/tags?post=141"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}