kayvey,
As you have shown and seen in the screen shots, you have multiple errors in the project all pointing towards the junit package and associated classes.
The first thing to do is to add the JUnit Library to the build path of the project.
Right-click on your project "HW4", you will then see Build Path on the context menu. Click to get its sub menu and click on Configure Build Path...
Click on the Libraries tab.
Click the Add Library... button.
Select JUnit from the Add Library dialog.
Click next and you can select the JUnit library version (although the default of JUnit 3 should be just fine), click Finish.
Once the errors go away about build path, see if you can follow the rest of the tutorial. Typically in Eclipse, you simply name the @Test methods as testXXXX. You can then Run As or Debug As JUnit Test.
M-1