parallel builds (ctest_build() ) for dashboards ?

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

parallel builds (ctest_build() ) for dashboards ?

Alexander Neundorf-3
Hi,

I'm running some dashboard builds and didn't find a way how to make the builds
(via ctest_build()) run parallel, e.g. make -4.
For ctest_test() there is a PARALLEL_LEVEL option, I didn't find this for
ctest_build().
Is it possible to do this ?

Alex
_______________________________________________
Powered by www.kitware.com

Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html

Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ

Follow this link to subscribe/unsubscribe:
http://www.cmake.org/mailman/listinfo/cmake
Reply | Threaded
Open this post in threaded view
|

Re: parallel builds (ctest_build() ) for dashboards ?

David Cole
In the script, prior to the ctest_build call, do:
set(CTEST_BUILD_FLAGS -j4)

(only works with make that supports -j, obviously...)


On Mon, Nov 30, 2009 at 3:05 PM, Alexander Neundorf <[hidden email]> wrote:
Hi,

I'm running some dashboard builds and didn't find a way how to make the builds
(via ctest_build()) run parallel, e.g. make -4.
For ctest_test() there is a PARALLEL_LEVEL option, I didn't find this for
ctest_build().
Is it possible to do this ?

Alex
_______________________________________________
Powered by www.kitware.com

Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html

Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ

Follow this link to subscribe/unsubscribe:
http://www.cmake.org/mailman/listinfo/cmake


_______________________________________________
Powered by www.kitware.com

Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html

Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ

Follow this link to subscribe/unsubscribe:
http://www.cmake.org/mailman/listinfo/cmake
Reply | Threaded
Open this post in threaded view
|

Re: parallel builds (ctest_build() ) for dashboards ?

Bill Hoffman
David Cole wrote:
> In the script, prior to the ctest_build call, do:
> set(CTEST_BUILD_FLAGS -j4)
>
> (only works with make that supports -j, obviously...)
>
We often do this in our scripts:

set(CTEST_BUILD_COMMAND "make -j4 -i")
MAKECOMMAND:STRING=/usr/bin/make -i -j4

I don't think we will add the make tool smarts into ctest_build to
handle this as it depends on which make you are actually using.

-Bill
_______________________________________________
Powered by www.kitware.com

Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html

Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ

Follow this link to subscribe/unsubscribe:
http://www.cmake.org/mailman/listinfo/cmake
Reply | Threaded
Open this post in threaded view
|

Re: parallel builds (ctest_build() ) for dashboards ?

Bill Hoffman
Sean McBride wrote:

> On 11/30/09 3:52 PM, Bill Hoffman said:
>
>> David Cole wrote:
>>> In the script, prior to the ctest_build call, do:
>>> set(CTEST_BUILD_FLAGS -j4)
>>>
>>> (only works with make that supports -j, obviously...)
>>>
>> We often do this in our scripts:
>>
>> set(CTEST_BUILD_COMMAND "make -j4 -i")
>> MAKECOMMAND:STRING=/usr/bin/make -i -j4
>
> Is that better/worse/equivalent to David's suggestion of:
>
> set(CTEST_BUILD_FLAGS -j4)  ?
>

Worse most likely. :)

Both should work.

-Bill
_______________________________________________
Powered by www.kitware.com

Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html

Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ

Follow this link to subscribe/unsubscribe:
http://www.cmake.org/mailman/listinfo/cmake
Reply | Threaded
Open this post in threaded view
|

Re: parallel builds (ctest_build() ) for dashboards ?

Sean McBride
On 12/1/09 12:30 PM, Bill Hoffman said:

>> Is that better/worse/equivalent to David's suggestion of:
>>
>> set(CTEST_BUILD_FLAGS -j4)  ?
>>
>
>Worse most likely. :)
>
>Both should work.

Thanks.  If our dashboards are all red tomorrow, you'll know why. :)

--
____________________________________________________________
Sean McBride, B. Eng                 [hidden email]
Rogue Research                        www.rogue-research.com
Mac Software Developer              Montréal, Québec, Canada


_______________________________________________
Powered by www.kitware.com

Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html

Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ

Follow this link to subscribe/unsubscribe:
http://www.cmake.org/mailman/listinfo/cmake
Reply | Threaded
Open this post in threaded view
|

Re: parallel builds (ctest_build() ) for dashboards ?

Bill Hoffman
Sean McBride wrote:

> On 12/1/09 12:30 PM, Bill Hoffman said:
>
>>> Is that better/worse/equivalent to David's suggestion of:
>>>
>>> set(CTEST_BUILD_FLAGS -j4)  ?
>>>
>> Worse most likely. :)
>>
>> Both should work.
>
> Thanks.  If our dashboards are all red tomorrow, you'll know why. :)
>
Well, as Dave mentioned the -j flag only works with gmake.  It does not
work with Xcode, as you tried here:  :)


http://www.cdash.org/CDash/viewNotes.php?buildid=484307

Which is why nothing built for that build. :)

-Bill
_______________________________________________
Powered by www.kitware.com

Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html

Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ

Follow this link to subscribe/unsubscribe:
http://www.cmake.org/mailman/listinfo/cmake
Reply | Threaded
Open this post in threaded view
|

Re: parallel builds (ctest_build() ) for dashboards ?

Sean McBride
On 12/2/09 10:10 AM, Bill Hoffman said:

>Well, as Dave mentioned the -j flag only works with gmake.  It does not
>work with Xcode, as you tried here:  :)
>
>
>http://www.cdash.org/CDash/viewNotes.php?buildid=484307
>
>Which is why nothing built for that build. :)

Doh!  I blindly changed all 30 of my scripts, should not have changed
that one obviously.  So in the Xcode case, how does it build?  Does it
invoke xcodebuild?  If so, that will already use many cores, so that's great.

Cheers,

--
____________________________________________________________
Sean McBride, B. Eng                 [hidden email]
Rogue Research                        www.rogue-research.com
Mac Software Developer              Montréal, Québec, Canada


_______________________________________________
Powered by www.kitware.com

Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html

Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ

Follow this link to subscribe/unsubscribe:
http://www.cmake.org/mailman/listinfo/cmake
Reply | Threaded
Open this post in threaded view
|

Re: parallel builds (ctest_build() ) for dashboards ?

Michael Wild

On 2. Dec, 2009, at 16:36 , Sean McBride wrote:

> On 12/2/09 10:10 AM, Bill Hoffman said:
>
>> Well, as Dave mentioned the -j flag only works with gmake.  It does  
>> not
>> work with Xcode, as you tried here:  :)
>>
>>
>> http://www.cdash.org/CDash/viewNotes.php?buildid=484307
>>
>> Which is why nothing built for that build. :)
>
> Doh!  I blindly changed all 30 of my scripts, should not have changed
> that one obviously.  So in the Xcode case, how does it build?  Does it
> invoke xcodebuild?  If so, that will already use many cores, so  
> that's great.
>
> Cheers,
>

xcodebuild also takes the -parallelizeTargets option.

Michael

_______________________________________________
Powered by www.kitware.com

Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html

Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ

Follow this link to subscribe/unsubscribe:
http://www.cmake.org/mailman/listinfo/cmake
Reply | Threaded
Open this post in threaded view
|

Re: parallel builds (ctest_build() ) for dashboards ?

Bill Hoffman
Michael Wild wrote:

>
> On 2. Dec, 2009, at 16:36 , Sean McBride wrote:
>
>> On 12/2/09 10:10 AM, Bill Hoffman said:
>>
>>> Well, as Dave mentioned the -j flag only works with gmake.  It does not
>>> work with Xcode, as you tried here:  :)
>>>
>>>
>>> http://www.cdash.org/CDash/viewNotes.php?buildid=484307
>>>
>>> Which is why nothing built for that build. :)
>>
>> Doh!  I blindly changed all 30 of my scripts, should not have changed
>> that one obviously.  So in the Xcode case, how does it build?  Does it
>> invoke xcodebuild?  If so, that will already use many cores, so that's
>> great.
>>
>> Cheers,
>>
>
> xcodebuild also takes the -parallelizeTargets option.
>

It actually runs cmakexbuild which is a very thin wrapper for xcodebuild
that has less verbose output, but the options should pass in just fine.

-Bill
_______________________________________________
Powered by www.kitware.com

Visit other Kitware open-source projects at http://www.kitware.com/opensource/opensource.html

Please keep messages on-topic and check the CMake FAQ at: http://www.cmake.org/Wiki/CMake_FAQ

Follow this link to subscribe/unsubscribe:
http://www.cmake.org/mailman/listinfo/cmake