I do not think using a GPL-licensed build tool places any restrictions on how you distribute the resulting software.
A lot of commercial software is created using gcc, and they do not need to do anything because of that (not even telling the users what compiler they used).
For open-source software, unless the tool used is very uncommon (and maybe even then) you can fulfill your requirement to make the source available by just making the source (including build scripts) available, without going to great lengths to make it easier for anyone to get all the build tools and their environment set up (although you should of course do that).
Here is the relevant section from the GPL (emphasis added)
The source code for a work means the
preferred form of the work for
making modifications to it. For an executable work, complete source
code means all the source code for all modules it contains, plus any
associated interface definition files, plus the scripts used to
control compilation and installation of the executable.
However, as a
special exception, the source code distributed need not include
anything that is normally distributed (in either source or
binary
form) with the major components (compiler, kernel, and so on) of the
operating system on which the executable runs, unless that component
itself accompanies the executable.