That sort of depends on what the queries are being used for, how often they are running, and what the user expectation is for response time.
If the query is running slow over a small set of data, there's probably a problem with your SQL, your indexes, or your network connection between your web server and your database server. Optimization of the query is probably your best first task to address this.
Also, if the queries are running often, or in an area of the system where you need a fast response time, you may want to look at optimizing the query a little.
If the query NEEDS to run for that length of time and cannot be optimized further, but the data doesn't change very often, perhaps caching the result in the application would help improve response time.
If you have a small load of users who don't care about performance (ex. admins running a report) then you don't have to worry.