Question: Use techniques such as web scraping to retrieve data from the Internet using both Python built-in functions as well as third-party libraries. You can use

Use techniques such as web scraping to retrieve data from the Internet using both Python built-in functions as well as third-party libraries. You can use Python's default editor IDLE (Integrated Development and Learning Environment) or a Python editor of your choice to complete this assessment. 

  1. Write a program to test if a given page is found or not on the server.
  2. Write a Python program to download and display the content of robots.txt for capella.edu
  3. Install the third-party library Beautiful Soup and review the Beautiful Soup Documentation.
  4. Use Beautiful Soup to write a Python program that will extract all of the HTML links from http://www.capella.edu
  5. Test your code and document testing by taking screenshots.
  6. Explain the approach taken to complete this assessment and the major decisions made.

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Algorithms Questions!