• Christ and Church Life and Building Spirit and Bride

    基督與召會
    生命與建造
    那靈與新婦



    As a lover of Christ and a pursuer of truth, I write down my joys, memories and reflections.

    May God lead us all into the secret of His presence, and build us into the oneness of His body in love.
  • Categories

  • Archives

  • Recently Viewed

  • Recent Posts

Computing the keywords in the Bible

Many advances have been made in the field of natural language processing, a division of computer science. As a beginner learning this technique, I wrote a software program to identify the keywords for each book in the Bible. By keyword it means that words that occur often in a book but not in other book. This article summarizes my findings. I also plan on working on other more interesting projects in the near future.

The following steps were taken:

1. Web scraping: scraping the entire Bible, every book, chapter, and verse in the Recovery version and save into the database.

http://en.wikipedia.org/wiki/Web_scraping

2. Data model: I model the Bible as objects with chapters, which have verses.

3. Removing stop words

http://en.wikipedia.org/wiki/Stop_words

4. Stemming: basically  reduce words to their base or root form.

http://en.wikipedia.org/wiki/Stemming

5. Word frequency count: count the occurrence of each word in each book, chapter, and verse.

6. TF-IDF: Calculate term frequency–inverse document frequency

http://en.wikipedia.org/wiki/Tf*idf

 7. Rank and take the top keywords.

I think the results are acceptable.

Old Testament

Genesis
Laban, Abraham, Joseph, Esau, Jacob, Pharaoh, Rachel, Rebekah, clan

Exodus
Jehovah, Moses, Aaron, Pharaoh, socket, board, Egypt, strand, curtain, blue

Leviticus
infect, Jehovah, offer, priest, aaron, unclean, expiat, skin, valuat, discharg

Numbers
Jehovah, Moses, famili, aaron, offer, balaam, encamp, balak, male, tribe

Deuteronomy
Jehovah, land, todai, undertak, command, Egypt, possess, statut, dispossess, Jordan

Joshua
Joshua, Jehovah, Jordan, ai, border, tribe, pastur, manasseh, land, beth

Judges
gideon, samson, abimelech, Jehovah, Jephthah, manoah, Israel, micah, shechem, midian

Ruth
naomi, boaz, ruth, glean, kinsman, Elimelech, moabitess, mahlon, begot, reaper

1 Samuel
Saul, samuel, david, philistin, Jehovah, jonathan, eli, nabal, achish, Israel

2 Samuel
absalom, david, joab, Saul, abner, king, Jehovah, amnon, servant, ziba

1 Kings
solomon, Jehovah, jeroboam, ahab, king, elijah, Israel, david, asa, hiram

2 Kings
elisha, Jehovah, king, jehu, reign, hezekiah, samaria, assyria, ahab, syria

1 Chronicles
david, begot, Jehovah, son, Saul, joab, pastur, ob, thousand, divis

2 Chronicles
Jehovah, solomon, king, judah, jehoshaphat, levit, jerusalem, rehoboam, asa, hezekiah

Ezra
cyru, ezra, hundr, artaxerx, Persia, jeshua, jerusalem, king, levit, dariu

Nehemiah
repair, levit, jeshua, tobiah, Ezra, sanballat, singer, meshullam, hundr, eliashib

Esther
esther, haman, mordecai, ahasueru, king, Jew, provinc, susa, queen, banquet

Job
Job, Almighty, wick, answer, Satan, Iniquity, elihu, dread, Jehovah, shuhit

Psalms
Jehovah, lovingkindness, precept, psalm, wick, praise, hallelujah, sing, refuge, salvation

Proverbs
fool, wick, wise, sluggard, Jehovah, perver, simple, wisdom, sense, lip

Ecclesiastes
vanity, fool, advantage, preacher, wisdom, wise, labor, sun, travail, chase

Song of Songs
beloved, lily, fragrance, myrrh, gazel, beauty, bride, spice, twin, apple

Isaiah
Jehovah, host, Hezekiah, Assyria, zion, Jacob, land, king, coastland, nation

Jeremiah
Jehovah, Jeremiah, Babylon, Zedekiah, Judah, king, declare, Nebuchadrezzar, Chaldean, land

Lamentations
Jehovah, Zion, pursuer, street, adversary, daughter, faint, comfort, virgin, enemY

Ezekiel
Jehovah, cubit, reed, side, porch, width, gate, Israel, land, wheel

Daniel
Daniel, king, Nebuchadrezzar, ab, Shadrach, nego, Meshach, interpret, dream, Belteshazzar

Hosea
Ephraim, Jehovah, harlotri, lo, Israel, Ruhamah, iniquity, lover, Assyria, aven

Joel
Jehovah, locust, zion, waterwai, lick, fresh, howl, acquit, dri, swarm

Amos
Jehovah, Amos, palace, plumb, declare, Bethel, Israel, jeroboam, needi, captive

Obadiah
Esau, calam, Jehovah, substanc, possess, sepharad, confederaci, crossroad, Zarephath, spoiler

Jonah
Jonah, nineveh, Jehovah, tarshish, misfortun, ship, tempestu, befallen, overnight, sea

Micah
Jehovah, inhabitress, Zion, Jacob, limp, tread, assyria, wail, peopl, remnant

Nahum
locust, Jehovah, nineveh, fortress, prei, whelp, lion, sorceri, lioness, harlotri

Habakkuk
violenc, Jehovah, habakkuk, sein, bloodsh, woe, amaz, net, fortress, march

Zephaniah
Jehovah, Jubil, desol, battlement, seacoast, ashkelon, inhabit, remnant, wail, correct

Haggai
Haggai, Jehovah, Zerubbabel, Jehozadak, shealtiel, host, Joshua, dariu, month, declar

Zechariah
Jehovah, host, Jerusalem, horse, angel, Judah, sir, fro, declar, shepherd

Malachi
Jehovah, host, despice, treacher, sai, rob, curs, tith, sacrifice, Esau

New Testament

Matthew
disciple, Jesus, crowd, pharise, begot, John, behold, Peter, truly, hypocrite

Mark
disciple, Jesus, crowd, immediately, John, boat, Peter, question, James, demon

Luke
disciple, Jesus, crowd, John, pharise, recline, behold, demon, Simon, Mary

John
Jesus, disciple, Jew, truly, Peter, world, believe, Simon, John, Pilate

Acts
Paul, Peter, Jew, disciple, Jesus, Barnabas, Saul, sail, synagogue, John

Romans
Christ, gentile, Jesus, law, absolute, greet, graft, circumcision, grace, faith

1 Corinthians
Christ, member, spiritual, church, body, Jesus, baptize, unbeliev, apollos, tongue

2 Corinthians
Christ, boast, commend, titus, ministry, sorrow, danger, comfort, behalf, earnest

Galatians
Christ, gospel, circumcision, maidserv, Jesus, gentile, slavery, law, Cephas, faith

Ephesians
Christ, Jesus, church, grace, saint, mystery, heavenly, oper, have, gospel

Philippians
Christ, Jesus, gospel, fellowship, confid, virtu, epaphroditu, abound, conform, think

Colossians
Christ, laodicea, mysteri, circumcision, Jesus, epaphra, element, invis, struggle

1 Thessalonians
Jesus, Christ, unceasingly, gospel, exhort, sanctife, macedonia, abstain, timothY, lord

2 Thessalonians
Jesus, Christ, disorderly, oper, letter, lawless, Lord, imit, ought, belief

1 Timothy
godly, Christ, Jesus, manage, faith, teach, widow, assist, really, exhort

2 Timothy
Jesus, Christ, lover, onesiphoru, oppose, suffer, gospel, deni, faith, remind

Titus
healthy, sober, savior, exhort, unruly, unreprov, temper, self, maintain, mind

Philemon
Christ, Jesus, owe, fellow, Paul, Philemon, apphia, voluntari, refresh, epaphra

Hebrews
Melchisedec, priest, faith, promise, obtain, testament, discipline, heavenly, Jesus

James
doer, hearer, tame, tempt, faith, bridl, boast, religion, selfish, rust

1 Peter
Christ, suffer, Jesus, grace, subject, disobedience, sober, manner, unfad, revile

2 Peter
godli, Jesus, dissolve, Christ, licenti, ungodly, savior, intense, unstable, element

1 John
abide, world, begotten, anti-christ, overcome, manifest, Jesus, liar, fellowship, practice

2 John
ladi, abide, paper, anti-christ, Christ, ink, truth, teach, wrought, Jesus

3 John
church, diotreph, demetriu, health, beloved, truth, pen, gaiu, ink, babble

Jude
ungodly, Christ, Jesus, gloom, revil, crept, autumn, undergo, unnot, reef

Revelation
scroll, creature, throne, angel, dragon, seven, Lamb, seal, church, beast

Advertisements

One Response

  1. […] Computing the keywords in the Bible (lambfollower.wordpress.com) […]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: