Click Here
home features news forums classifieds faqs links search
5781 members 
Amiga Q&A /  Free for All /  Emulation /  Gaming / (Latest Posts)
Login

Nickname

Password

Lost Password?

Don't have an account yet?
Register now!

Support Amigaworld.net
Your support is needed and is appreciated as Amigaworld.net is primarily dependent upon the support of its users.
Donate

Menu
Main sections
Home
Features
News
Forums
Classifieds
Links
Downloads
Extras
OS4 Zone
IRC Network
AmigaWorld Radio
Newsfeed
Top Members
Amiga Dealers
Information
About Us
FAQs
Advertise
Polls
Terms of Service
Search

IRC Channel
Server: irc.amigaworld.net
Ports: 1024,5555, 6665-6669
SSL port: 6697
Channel: #Amigaworld
Channel Policy and Guidelines

Who's Online
26 crawler(s) on-line.
 12 guest(s) on-line.
 1 member(s) on-line.


 TRIPOS

You are an anonymous user.
Register Now!
 TRIPOS:  3 mins ago
 nottins:  6 mins ago
 MEGA_RJ_MICAL:  9 mins ago
 Livebyfaith:  10 mins ago
 terminills:  10 mins ago
 amisteph:  19 mins ago
 BSzili:  24 mins ago
 BigD:  27 mins ago
 Seaquest:  32 mins ago
 nikosidis:  56 mins ago

Software News   Software News : Distributed Compilation & Parallel Build Tools for OS4
   posted by ssolie on 21-Oct-2005 2:18:31 (4169 reads)
It is a common problem. You have one or two AmigaOne systems plus four or five Amy'05 systems and the sources for your fantastic OS4 project are on one machine. You run your native compile and wait while your one system does all the work with the rest of them doing useless RC5-72 crunching. How can you get all those lazy systems working on your fantastic OS4 project instead?

The answer has been around for a long time on other systems and now that same capability comes to AmigaOS in the form of GNU make and the distcc package. Simply install the OS4 SDK on each system along with the distccd daemon and you have an instant super-compiler. With cross-compilers and distcc installed on Linux, MacOS, etc. you could have a super-duper-compiler but that functionality will have to wait a bit longer.

I've managed to port the parallel job capability of GNU make as well as the entire distcc package (client and server) to AmigaOS. While working on these tools I also discovered missing OS4 features, a bug in OS4 and clib2-ts limitations so these tools are being released in beta form for the time being. I'd appreciate any feedback but keep in mind some things just won't work 100% properly until updates of OS4 and clib2 are released.

Grab the tools from OS4 Depot and give them a try. Unless of course you don't want your compiles to go any faster...

P.S. Parallel builds can eat up a lot of RAM so you might want to visit Revanche LLC and stock up on A1 RAM like I did. Thanks Kurt!
    

Related Links
· More about Software News
· News by ssolie


Most read story about Software News
UBoot 2010.06.04 for Sam460ex available

Last news about Software News
IBrowse 2.5 Released
Printer Friendly Page  Send this Story to a Friend

PosterThread
evilrich 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 5:30:22
#1 ]
Cult Member
Joined: 19-Oct-2003
Posts: 534
From: Unknown

@ssolie

Ah, so that's what you were up to. Nice one.

Cheers,
Rich

 Status: Offline
Profile     Report this post  
gregthecanuck 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 5:38:38
#2 ]
Cult Member
Joined: 30-Dec-2003
Posts: 844
From: Vancouver, Canada

Way too cool!

It is great that you are working on these projects with OS 4 in beta. This helps iron out any small issues before OS 4 goes into full release. The big bonus is future porting efforts all leverage off the time you spend now.

Great big thumbs up.

 Status: Offline
Profile     Report this post  
elwood 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 7:56:10
#3 ]
Elite Member
Joined: 17-Sep-2003
Posts: 3422
From: Lyon, France

Is it already Christmas ?

Thanks.


_________________
Philippe 'Elwood' Ferrucci
Sam460 1.10 Ghz
AmigaOS 4 betatester
Amiga Translator Organisation

 Status: Offline
Profile     Report this post  
AV 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 8:50:16
#4 ]
Regular Member
Joined: 1-Aug-2003
Posts: 184
From: Unknown

@ssolie

Simply GREAT!

 Status: Offline
Profile     Report this post  
zerohero 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 9:19:39
#5 ]
Team Member
Joined: 4-May-2004
Posts: 2524
From: Uddevalla, Sweden

I'm seeing things, there must be a gasleak or something around here...?

@ssolie

Great work, now I only need to buy myself a couple of A1's or AMY's ;)

Regards,
Jocke 'Zerohero' Birging


_________________
Common sense - So rare it's almost like a super power

 Status: Offline
Profile     Report this post  
Mr_Capehill 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 9:33:21
#6 ]
Super Member
Joined: 15-Mar-2003
Posts: 1924
From: Yharnam

@ssolie

Keep on rocking ;)

 Status: Offline
Profile     Report this post  
Bean 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 10:49:30
#7 ]
Super Member
Joined: 4-Apr-2003
Posts: 1225
From: U.K.



How cool is that!

Great work, now I just need another A1.


_________________
OS4.1 + SAM Flex
RIP my A1XE.. that used to have an appetite for batteries!

 Status: Offline
Profile     Report this post  
broadblues 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 10:54:18
#8 ]
Amiga Developer Team
Joined: 20-Jul-2004
Posts: 4402
From: Portsmouth England

Doesn't appear to work for AWeb build dispite being 3.81beta, I haven't had time
to investigate in detail but it just does the following.


make -f Makefile.os4
build/tubsfind -c build/tubscache -o build/Tubsfiles -e build/ -e distribution/ -e %/CV
Tubsengine.os4:266: Adding modules...
Tubsengine.os4:280: Finding out modules dependencies...
Tubsengine.os4:287: Building modules...
build/AWeb/awebamitcp.d:1: *** multiple target patterns. Stop.


Shame as I was hoping to be able to discard my custom build, maybe on the next iteration


_________________
BroadBlues On Blues BroadBlues On Amiga Walker Broad

 Status: Offline
Profile     Report this post  
zerohero 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 10:57:11
#9 ]
Team Member
Joined: 4-May-2004
Posts: 2524
From: Uddevalla, Sweden

@broadblues

I believe falemagn did some tubs patch to the one used with AWeb? I might remember things wrong though...

Regards,
Jocke 'Zerohero' Birging


_________________
Common sense - So rare it's almost like a super power

 Status: Offline
Profile     Report this post  
ssolie 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 13:45:18
#10 ]
Elite Member
Joined: 10-Mar-2003
Posts: 2745
From: Alberta, Canada

@broadblues
Quote:
build/AWeb/awebamitcp.d:1: *** multiple target patterns. Stop.

Looks like you are using some kind of automated dependency generation. Please email me your awebamitcp.d file so I can take a peek. I'm sure I applied that .ALIAS patch...


_________________
ExecSG Team Lead

 Status: Offline
Profile     Report this post  
freaks 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 14:30:24
#11 ]
Regular Member
Joined: 8-Jun-2004
Posts: 318
From: france

wow.. the kind of features that were missing on amiga..
distributed computing..
excellent news!
well done ssolie

 Status: Offline
Profile     Report this post  
shoe 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 14:41:28
#12 ]
Super Member
Joined: 14-Sep-2003
Posts: 1585
From: Gothenburg, Sweden

Thanks! I love distcc, use it all the time and now I can include my Amiga in my adventures aswell. Muwhahah...

/shoe

 Status: Offline
Profile     Report this post  
miksuh 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 14:47:44
#13 ]
Cult Member
Joined: 10-Mar-2003
Posts: 731
From: Espoo, Finland

Looks good, should be quite handy if you have more than one computer running AmigaOS4.

Quote:
You have one or two AmigaOne systems plus four or five Amy'05 systems


Only in my dreams I would be happy if i would have atleast one AmigaOne or Amy :-|
I would also need bigger apartment If i would have that many computers

Last edited by miksuh on 21-Oct-2005 at 02:52 PM.

 Status: Offline
Profile     Report this post  
firbodi 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 14:52:04
#14 ]
Super Member
Joined: 2-Sep-2003
Posts: 1046
From: Planet Earth!

Hi there,

My question is if this tool can be used over the internet too! Then, I may be a able to lend some CPU time to developers. (Especially if they are in Alberta! )

Firbodi


_________________
MicroA1 G3, 512MB RAM, DVD-RW; and A1-SE G3,512MB RAM, CD-RW & DVD-ROM
Avatar: Perspolis, Capital of Achaemenid Empire 500 B.C.

 Status: Offline
Profile     Report this post  
aldur 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 21-Oct-2005 15:40:50
#15 ]
Super Member
Joined: 16-Oct-2003
Posts: 1273
From: Birmingham, UK

YEs tell me what I need to do to give complitation time to amiga developers.

Ado


_________________
Aldur
------------------------------

 Status: Offline
Profile     Report this post  
KimmoK 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 22-Oct-2005 19:16:01
#16 ]
Elite Member
Joined: 14-Mar-2003
Posts: 5187
From: Ylikiiminki, Finland

Nice one!

Something that professionals would like to use!

(at work the compiling takes about 1.5 hours on modern 3Ghz P4 system and about 20 minutes on the cluster of 18 CPUs)


_________________
- KimmoK
// For freedom, for honor, for AMIGA
//
// Thing that I should find more time for: CC64 - 64bit Community Computer?

 Status: Offline
Profile     Report this post  
firbodi 
Re: Distributed Compilation & Parallel Build Tools for OS4
Posted on 24-Oct-2005 5:34:12
#17 ]
Super Member
Joined: 2-Sep-2003
Posts: 1046
From: Planet Earth!

I must have asked a very stupid question!

Firbodi


_________________
MicroA1 G3, 512MB RAM, DVD-RW; and A1-SE G3,512MB RAM, CD-RW & DVD-ROM
Avatar: Perspolis, Capital of Achaemenid Empire 500 B.C.

 Status: Offline
Profile     Report this post  
[ home ][ about us ][ privacy ] [ forums ][ classifieds ] [ links ][ news archive ] [ link to us ][ user account ]
Copyright (C) 2000 - 2019 Amigaworld.net.
Amigaworld.net was originally founded by David Doyle