Yes, the refinancing costs do matter for your Bucks, PA refinance (i.e. for refinancing your Bucks, PA home mortgage loan). In fact, high refinancing costs can sometimes make the option of mortgage refinancing unviable altogether. General recommendation for going for a mortgage refinance (Bucks, PA refinance or any other) is that the difference between the prevailing mortgage rate and the mortgage rate on your mortgage should be more than 1.75-2.00 percentage points. This calculation itself is based on the refinancing costs of your mortgage loan. 
The refinancing costs don’t include only the closing costs of the mortgage refinance; they also include the costs related to house inspection, the mortgage broker’s fee, attorney fee and other charges. You also need to check if there is a pre-payment penalty or a pre-payment charge on your existing mortgage.
You will need to know all these costs in order to arrive at your Bucks, PA refinance total cost. Once you have got a general idea of the refinancing cost, you can compare various mortgage refinance offers to see if the Bucks, PA refinance will make sense for you. If you can get a lower mortgage rate (through Bucks, PA refinance), the refinance costs might actually get recovered in a very short time period. So it would make sense to go for refinance in such a case too.
You might have to evaluate a number of offers (you can get mortgage offers through sites online together with the refinancing costs, in order to determine the viability of your Bucks, PA refinance.