If your amplifier has a 3.5mm jack, then get an audio cable with 3.5mm audio plug on both end (they are cheap and available on local computer store, ebay, electronic store, etc) and connect where you plug your headphone on your laptop to the jack of the amplifier with the cable.
If the amplifier has a 2.5mm or 6.5mm jack, then use a size adapter as well.