Interesting. The one thing that I have noticed using Google is that they have a tendency to try and put you on a road... So a lot of times when you enter coordinates that aren't on a road, they return with the coordinates of the point on a road that is closest to the coordinates entered.
I entered both 33.865554, -84.68664 and 33°51'56.0"N 84°41'11.9"W and was taken to the same spot - at least with in a few feet.
And reading further, I realized I skipped part of your question. Coordinates are based off the geometry of the earth. Latitude (north and south) are the easiest to understand. Picture the earth from space - it is a circle. Draw an imaginary horizontal line around the center of the circle - the equator. Now draw a vertical line going through the north and south poles. these two lines create a 90* angle at the center of the earth. This is where degrees come from. So any coordinates that are 0* are a spot on the equator, 90* north is the north pole, and 90* south is the south pole. 45* would be halfway between the equator and a pole (etc etc etc). Some sites/people use a positive value to represent north (rather than a N), and a negative value to represent south (rather than a S). Then each degree gets divided in to 60 minutes, and each minute is divided in to 60 seconds. It can be confusing, but these are not based of of the time units - they are angular units. If that is all as clear as mud, keep reading for longitude.
Longitude is a bit stranger. This time, look as the earth from space, but directly above the north pole. Now draw an imaginary line from the north pole to the south. This line is 0*. So a line 90* to the left of your line would be 90* west, and a line opposite yours would be 180* east OR west. This is where things get tricky... since there is no obvious spot to draw this line (like the equator for latitude). Most modern systems use the Greenwich Prime Meridian - an arbitrary line running from the north to south pole that goes through the Royal Observatory in Greenwich England. As any good treasure map reader should know, there are and were other meridians used, but that is another discussion. Again, the degrees are divided in the 60 minutes, and those are divided in to 60 seconds.
So if any of that doesn't make sense, speak up. I know it isn't the best job, but hopefully I have made things better rather than worse....