Question: You will create a Python script on HPC6 that will detect the presence of broken links on a given Web page. You will use Python

You will create a Python script on HPC6 that will detect the presence of broken links on a given Web page. You will use Python requests and BeautifulSoup to help you accomplish this.

The script should reside at ~/bin/check-links. The script can be run using the following syntax.

check-links

where is a valid Web address, like https://bvu.edu/Links to an external site. or http://10.92.21.106:8008/Links to an external site.. The latter Web address is the one your instructor would like you to use to test your code.

When run, the check-links script places a list of bad link text into the file ~/.links/bad-links.txt. If there are no bad links, the check-links script should ensure that ~/.links/bad-links.txt does not exist (that is, it may have to remove the file if it does exist).

Links

Links in HTML files look like this.

The BVU Academic Calendar page.

Visit the Office of the President.

From these examples, you can see that the link text (e.g., "BVU Academic Calendar" or "Office of the President") is surrounded by and , and the includes within its angle brackets an href attribute that gives the actual link itself. Thus, clicking on "BVU Academic Calendar" will take the user to the Web page found at https://bvu.edu/academics/calendar/Links to an external site.. The actual link may have several forms. In the case of https://bvu.edu/academics/calendar/Links to an external site., the link is a full Web address which consists of the host (bvu.edu) and a path (/academics/calendar). Another link form we may encounter is simply a path without a host. If there is no host given, a Web browser assumes the current host. In other words, if we were visiting a Web page located at bvu.edu, and we clicked on the "Office of the President" link, the browser would navigate us to https://bvu.edu/president/Links to an external site. by concatenating https://bvu.edu Links to an external site.and /president/.

Automating the Running of check-links

You will create a cron job that runs check-links at 7:00 a.m. every day. Then, in your ~/.profile, you will check to see if ~/.links/bad-links.txt exists. If it does, you will display its contents whenever you log in.

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer

Step: 1 Unlock

Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock

Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!

Ask an expert ASSIGNMENT 6 3 0 points Code Assignment: Web Application Security with Python Objective: This assignment focuses on analyzing web applications and developing Python scripts for web...

There are two problems due this week (each worth 35 points) as follows. Case 5-1David L. Miller: Portrait of a White-Collar Criminal (page 144). In comprehensive paragraphs, answerrequirements 1?6....

I have to create a program in C and I can't figure it out. The program has to read a source file. Please help. /******************************************************************** PROJECT: Glossary...

A creative engineer suggests structuring the TLB so that not all the bits of the presented address need match to result in a hit. Suggest how this might be achieved, and what might be the costs and...

1 Learning Outcome: Project/Lab (2) By the end of this project, the students will: Learn how to use Mininet. Become familiar with client-server systems. Be able to develop a client-server IM system....

MKT500 Week 8 Discussion Board 8 attached are the questions, scenario, and supportive reading materials. MKT500 DB 8 "The Importance of Social Media and Web Analytics" 1.) From the scenario,...

- Reddit Context: Andres really likes cooking. Trying to find something new to cook, Andres finds a subreddit where people share and talk about recipes: /r/recipes. After browsing the subreddit for a...

Al-Driven Contextual Advertising: Toward Relevant Messaging Without Personal Data E. Haglund and J. Bjorklund Department of Computing Science, Umea University, Umed, Sweden ABSTRACT In programmatic...

Describe the types of cybercrimes facing organizations and critical infrastructures, explain the motives of cybercriminals, and evaluate the financial Explain both low-tech and high-tech methods...

In the following figure, how many pounds of sugar are sellers willing to sell at a price of $20? How much is demanded at this price? What is the buyers willingness to pay when the quantity is 20...

Would inheritance of acquired characteristics (changes to the adult body) make evolution more efficient than having to wait for chance mutations?

Which of the following would be considered a non - francial performance measurement? variances from standards cost of engineering changes increase in morket share number of customer conplaints

Seved Help 14 Wisconsin Snowmobile Corp. is considering a switch to level production Cost efficiencies would occur under level production, and aftertax costs would decline by $31,500, but inventory...

=+1 What culture-related problems and issues do you see in these uses of thirdcountry nationals?

=+3 What role does international HR need to take in coping with the cultural issues presented by the use of TCNs?

=+4 Are there other alternatives for finding enough talent to fill global needs?