No, it is not a meteorite. The fact that a magnet sticks, however weakly or strongly, means that it has enough iron for a magnet to stick. Much of the crushed basalt in my driveway jumps to magnets, so I frequently discount that as an indicator, unless there are visual cluess, which your rock does not have.
Get yourself a few guidebooks on meteorites. I keep mine in the truck at all times. They come in helpful.
Agreed. There are a lot of earth rocks with iron in them. The off tan color material looks like some form of quartz. You can find a lot on mindat.org about various metals, minerals, and the ones that are commonly found together. You can also look up more about the geology in your area. I got really excited about one I found thinking it was a meteorite.. I am still wondering because it has some characteristics of a possible stony iron. The thing is that some of the same crystals and minerals found in meteorites are also found here on earth. You really need to learn as much as possible to educate yourself.