The goal of this task is to perform a web crawl on a URL string provided by the user. From the crawl, you will need to parse out all of the images on that web page and return a JSON array of strings that represent the URLs of all images on the page. [Jsoup](https://jsoup.org/) is a great basic library for crawling and is already included as a maven dependency in this project, however you are welcome to use whatever library you would like.
Required Functionality
We expect your submission to be able to achieve the following goals:
- Build a web crawler that can find all images on the web page(s) that it crawls.
- Crawl sub-pages to find more images.
- Implement multi-threading so that the crawl can be performed on multiple pages at a time.
- Keep your crawl within the same domain as the input URL.
- Avoid re-crawling any pages that have already been visited.
Extra Functionality
No individual point below is explicitly required, but we recommend trying to achieve the following goals as well:
- Make your crawler "friendly" - try not to get banned from the site by performing too many crawls.
- Try to detect what images might be considered logos.
- Show off your front-end dev skills with Javascript, HTML, and/or CSS to make the site look more engaging.
- Any other way you feel you can show off your strengths as a developer ????
PLEASE do not send us a submission with only a basic JSoup crawl and only a couple lines of code.** This is your chance to prove what you could contribute to our team.
Your project will be due exactly 48 hours after you receive this project. To submit, zip up your project (`imagefinder.zip`) and email it back to me. **Please include a list of URLs that you used to test in your submissions.** You should place them in the attached `test-links.txt` file found in the root of this project.
Structure
The ImageFinder servlet is found in `src/main/java/com/eulerity/hackathon/imagefinder/ImageFinder.java`. This is the only provided Java class. Feel free to add more classes or packages as you see fit.
The main landing page for this project can be found in `src/main/webapp/index.html`. This page contains more instructions and serves as the starting page for the web application. You may edit this page as much as it suits you, and/or add other pages.
Finally, in the root directory of this project, you will find the `pom.xml`. This contains the project configuration details used by maven to build the project. If you want/need to use outside dependencies, you should add them to this file.
Running the Project
Here we will detail how to setup and run this project so you may get started, as well as the requirements needed to do so.
Requirements
Before beginning, make sure you have the following installed and ready to use
- Maven 3.5 or higher
- Java 8
Setup
To start, open a terminal window and navigate to wherever you unzipped to the root directory `imagefinder`. To build the project, run the command:
>`mvn package`
If all goes well you should see some lines that ends with "BUILD SUCCESS". When you build your project, maven should build it in the `target` directory. To clear this, you may run the command:
>`mvn clean`
To run the project, use the following command to start the server:
>`mvn clean test package jetty:run`
You should see a line at the bottom that says "Started Jetty Server". Now, if you enter `localhost:8080` into your browser, you should see the `index.html` welcome page! If all has gone well to this point, you're ready to begin!
## Submission
When you are finished working on the project, before zipping up and emailing back your submission, **PLEASE RUN ONE LAST `mvn clean` COMMAND TO REMOVE ANY UNNECESSARY FILES FROM YOUR SUBMISSION**. Please also make sure to add the URLs you used to test your project to the `test-links.txt` file. After doing these things, you may zip up the root directory (`imagefinder`) and email it back to us.
## Final Notes
- If you feel you need more time to work, you are free to ask for it.
- If you are having any trouble, especially with the setup, please reach out and we will try to answer as soon as we can.
- The ideas listed above on how to expand the project are great starting points, but feel free to add in your own ideas as well.
- Try to follow some good-practice principles when working on your code, such as meaningful and clean variable/method names and other good coding practices.
- The code we have provided is to allow you to hit the ground running. You are free to use whatever web service you would like (as long as you use Java 8 and it is runnable from the command line).
- We look forward to seeing what you can do, so good luck and have fun

The goal of this task is to perform a web crawl on a URL string provided by the user by the Add one or numerous URLs to be visited.

The internet crawler will make use of a couple of threads. It may be capable of moving slowly all of the precise internet pages of a website. It may be capable of documenting again any 2XX and 4XX links. It will take withinside the area call from the command line. It will keep away from the cyclic traversal of links.

Here are the primary steps to construct a crawler:

Step 1: Add one or numerous URLs to be visited.

Step 2: Pop a hyperlink from the URLs to be visited and upload it to the Visited URLs thread.

Step 3: Fetch the page's content material and scrape the records you are interested by with the ScrapingBot API.

Read more about the web:

https://brainly.com/question/14680064

#SPJ1

With the advent of _____ that stored the games and could be interchanged in the console, users were no longer limited to a set number of games, leading many video game console makers to switch their emphasis to producing games

Explain different characteristics of computer?​

privacy principles need to be balanced against the ___ benefit that comes from the automated collection of private information. select 2 options.

corporate
political
ethical
societal
financial​

Use the svd() function in matlab to compute a, the rank-1 approximation of a. clearly state what a, is, rounded to 4 decimal places. also, compute the root-mean square error (rmse) between a and a.
a=[1 2 2]
[ 3 4 5]
[ 6 7 8]

Artificial intelligence (ai) in perspective is a complex and interdisciplinary field that involves several specialties, including:

which one of the following will reach every element in the array a? 1. for(int i = 0; i <= a.length; i++) 2. for(int i = 0; i < a.length; i++) 3. for(int i = 1; i <= a.length; i++) 4. for(int i= 1-1 ; i < a.length; i++)

help this poped up on my pc im on my laptop what does it mean HELP rC % M i \g e - A u t o M e r g e d - b a s e ~ 3 1 b f 3 8 5 6 a d 3 6 4 e 3 5 ~ a m d 6 4 ~ ~ 1 0 . 0 . 1 0 2 4 0 . 1 6 3 8 4 . c a t rC % M i c r o s o f t - W i n d o w s - C l i e n t - F e a t u r e s - P a c k a g e - A u t o M e r g e d - n e t ~ 3 1 b f 3 8 5 6 a d 3 6 4 e 3 5 ~ a m d 6 4 ~ ~ 1 0 . 0 . 1 0 2 4 0 . 1 6 3 8 4 . c

Disadvantages of the divisional organization structure are _____. each division is able to operate independently from the parent company each division is able to operate independently from the parent company cheap to operate cheap to operate cannot share resources with other divisions cannot share resources with other divisions more expensive to operate more expensive to operate

Non linear editing can cause _____ where edit and re-edit and re-edit again can cause video to be less true than the original material

which of the following is an output device ?

Choose the correct order for the process of a user attempting to access network resources: 1. network protocol 2. application 3. network client 4. nic driver

"The actual use and implementation of computer started after third generations". Justify this statement in your own words.​

The entities on which data are collected are _____.

Which file format produces a lock-down version of an access database? accdb accdb-be accde accdb-e

What does data warehousing allow organizations to achieve?

How many pages is 1500 words double spaced 12 font?.

a customer is traveling to a branch office, and the network administrator provides her with a static ip address for her laptop. which should the customer do to use the static ip address

what is a sub folder in ICT​

3 Select all the correct answers. Ana is creating a list of SMART goals. Which aspects should she pay attention to? The goal's success rate is at least 50%. The goal should be relevant to her career plan. The goal's success rate is more than 50%. The goal should be attainable within a given time frame. The goal to be attained should not be time bound. Jhy Reset Next​

He was called "The father of computing c_______ B_______​

Question 4 of 25
in which situation would modular design be least beneficial for a game
program?
a. the program is extremely simple.
b. the programmer wants each task to be unique.
c. the program has many different parts.
d. the programmer is concerned about errors.

If two devices simultaneously transmit data on an Ethernet network and a collision occurs, what does each station do in an attempt to resend the data and avoid another collision

“How does revenue affect profit. How do expenses affect profit

What does a primary key allow a user to do in a database?

PLEASE HELP

What does business informWhat does business information management do?
A.
identify information requirements for coworkers
B.
identify information requirements for different management levels
C.
create project plans for the project management team
D.
produce sales turnover summary for the sales professionals
E.
create financial documents for the finance departmentation management do?

What is the maximum number of elements that will be visited by the binary search algorithm when searching a sorted 45-element array

Why do people take off the keys on the school computers

PYTHON!


Build a simple restaurant program by serving this menu to the customer:
1. Muffin of the Day
2. Bagel and Cream Cheese
3. Granola, Fruit, and Yogurt
4. Steel Cut Oat with Fruits
5. exit.
===========================================================
requirements:
1. Create 4 classes for each course.
2. Each course will be having ingredients as their Attribute of class. example: Muffin - egg,oil,sugar.
3. First function of the course's menu is printing the steps of making the course by putting it into
functions. (you will just need "print statement" at least).
4. Second function of the course's menu is printing "Dish is served".
5. (you can add more functions for more points of the program).
6. Show the menu to the customer as long as they don't choose menu number 5.
7. When the customer choose a course, build the object and call all the functions that you built.

The efficiency, effectiveness, clarity, completeness and neatness of the program will be assessed.

Explain methods of managing digital databases including permission marketing and the application of suppressions/opt-outs

What sound(s) will you hear when this program is run
A. Just “meow”
B. A “Moo” and a “Baa”
C. Two “Moos” and three “Baas”
D. A “Moo” a “Baa” and “Hello”