Try checking out your local/nearest record store and see if they have a second hand vinyl bin.

I'd either steal some from your parents or grandparents just to beat on (just make sure you're not destroying a hendrix LP or something) and then go to a store like a newbury comics or something. They won't have anything great, but they usually have sale racks with $3-4 records, new ones too. And just like Fyx said, alot of local record shops that only deal in records will have second hand stuff. Those are usually a couple bucks, just make sure you checkout the record before you by it to make sure it's used, but not abused.

If u lived close to me, or could come pick it p, i'd give u some of my old un-used vinyl... but its your choice... if ya wanna come to Australia...