LuxMark v3.1: LuxRender propaganda with OpenCL

Discussions related to GPU Acceleration in LuxRender

Moderators: Dade, jromang, tomb, coordinators

Re: LuxMark v3.1: LuxRender propaganda with OpenCL

Postby jensverwiebe » Tue Sep 15, 2015 6:02 am

Dade wrote:I'm using: viewtopic.php?f=34&t=11439

Note: it is a very hardcore solution good only for hardware geeks. It works using a PCIe bridge and it doesn't require any software driver. It based on the same idea used by NVIDIA/AMD to produce dual GPUs card.

I have tested both Windows and Linux and it works as advertised. However I haven't tried MacOS and you should assume it may not work.


Afaik some Mac guy uses this openair :D cluster succesfully, but you need an pci equipped Mac, aka up to 5.1 series.
TB attempts where made by Netkas and friends, calling it eGPU: http://forum.netkas.org/index.php?PHPSE ... &board=8.0
Careful, the latter stuff is experimental .... i would not bet on it.

Jens
User avatar
jensverwiebe
Developer
 
Posts: 3429
Joined: Wed Apr 02, 2008 4:34 pm

Re: LuxMark v3.1: LuxRender propaganda with OpenCL

Postby kroko » Tue Sep 15, 2015 6:18 am

Installed El Capitan on a partition for a report on ATI here (@pciccone has tested NVIDIA http://www.luxrender.net/forum/viewtopic.php?p=117129#p117129)

System Report on 10.11 shows same values for drivers as 10.10
Code: Select all
  Chipset Model:   AMD FirePro D700
  Type:   GPU
  Bus:   PCIe
  Slot:   Slot-1
  PCIe Lane Width:   x16
  VRAM (Total):   6144 MB
  Vendor:   ATI (0x1002)
  Device ID:   0x6798
  Revision ID:   0x0000
  ROM Revision:   113-C3861J-687
  gMux Version:   4.0.11 [3.2.8]
  EFI Driver Version:   01.00.687

  Chipset Model:   AMD FirePro D700
  Type:   GPU
  Bus:   PCIe
  Slot:   Slot-2
  PCIe Lane Width:   x16
  VRAM (Total):   6144 MB
  Vendor:   ATI (0x1002)
  Device ID:   0x6798
  Revision ID:   0x0000
  ROM Revision:   113-C3861J-687
  gMux Version:   4.0.11 [3.2.8]
  EFI Driver Version:   01.00.687
 


Did test LuxMark renderings

1)
Ball
Passes.
Score 21668. Image validation OK (5662 different pixels, 0.88%)


2)
Neumann
Passes.
Score 12479. Image validation OK (6278 different pixels, 0.98%)

Screen Shot 2015-09-15 at 14.03.37.png
neumann score

Screen Shot 2015-09-15 at 14.03.39.png
neumann image


3)
Hotel.
Fails.
Score 38. Image validation Failed (472361 different pixels 80.09%).

Screen Shot 2015-09-15 at 14.06.18.png
hotel score

Screen Shot 2015-09-15 at 14.06.21.png
hotel image


EDIT: OpenCL rendering for CPU-only works for all scenes.

As for LuxBlend. Same as previously, instant crash http://pastebin.com/Pm6Eyb8B when using OpenCL.

So they have done something (Neumann renders almost now (see green text on ring); 2xD700 on OSX gives 81% score of that with two GTX 980 on MSW), but still unusable.

EDIT2: This is how kext looks like http://pastebin.com/sRNDVrbA, this one contains D700 (Device ID: 0x6798, Vendor: 0x1002) in IOPCIMatch entry

For 10.10 kext the version plist says
Code: Select all
<dict>
        <key>BuildVersion</key>
        <string>13</string>
        <key>CFBundleShortVersionString</key>
        <string>1.32.25</string>
        <key>CFBundleVersion</key>
        <string>1.3.2</string>
        <key>ProjectName</key>
        <string>GPUDriversAMD</string>
        <key>SourceVersion</key>
        <string>1032025000000</string>
</dict>


for 10.11
Code: Select all
<dict>
   <key>BuildVersion</key>
   <string>52</string>
   <key>CFBundleShortVersionString</key>
   <string>1.36.46</string>
   <key>CFBundleVersion</key>
   <string>1.3.6</string>
   <key>ProjectName</key>
   <string>GPUDriversAMD</string>
   <key>SourceVersion</key>
   <string>1036046000000</string>
</dict>


thus 39 builds ahead but still not there :)


kroko
Last edited by kroko on Wed Sep 16, 2015 11:37 am, edited 5 times in total.
firmitas utilitas venustas baby!
User avatar
kroko
 
Posts: 39
Joined: Mon Jan 31, 2011 5:58 am
Location: Riga, Latvia

Re: LuxMark v3.1: LuxRender propaganda with OpenCL

Postby jensverwiebe » Tue Sep 15, 2015 6:26 am

Q.E.D.

EDIT:
thus 39 builds ahead but still not there :)

And while in Villarriba people are already celebrating, in Villabajo they still are scrubbing the dishes :twisted:

Jens
User avatar
jensverwiebe
Developer
 
Posts: 3429
Joined: Wed Apr 02, 2008 4:34 pm

Re: LuxMark v3.1: LuxRender propaganda with OpenCL

Postby kroko » Wed Sep 16, 2015 10:22 am

I have a past in reporting frustrating bugs to apple devs (I created and still maintain system wide spellcheck for Latvian language on OS X, you won’t believe (or now you do :)) how many bugs there are, corrections are still postponed by Apple after 6 years, efff meeeee).
I understand that for some - @pciccone and @jensverwiebe - this has been a painful struggle and the following will be received with a sad smile.
I have Apple Beta Software Program membership (for anyone wondering - is actually just one click away for everyone, just sign in with your apple id, doesn't have to be id used for development https://beta.apple.com/sp/betaprogram/).
So.. I just reported on bug found in OS X El Capitan GM Candidate. So yeah - I put it his way. Plus stating that Apple lies (which they do) and that their top of the line mac is incapable of GPGPU (which it does).
I installed MSW via Bootcamp on the system to gather all driver details there and run LuxMark (and Blender)
Feel free to use Feedback Assistant to report same issue. BTW, description cannot be longer than 4096 characters. That’s a bug in Feedback Assistant which allows longer texts in input field but then gives HTTPErrorDomain error 500 :), had to strip down the report.

What a mess. But this is the best I can do for the cause. OpenCL support on OS X is IMHO critical to the whole Blender community, weather one is using LuxRender and/or Cycles (http://developer.amd.com/community/blog ... er-cycles/, OS X still crashing).


Please provide a descriptive title for your report:
OS X 10.11 cannot take advantage of the modern GPU, Apple-shipped OpenCL drivers are broken

What are you seeing an issue with?
Something else not in this list

What type of issue are you reporting?
Incorrect/Unexpected Behaviour

Please describe the issue and what steps we can take to reproduce it:
Please include:
- A clear description of the problem
- A step-by-step set of instructions to reproduce the problem (if possible)
- What results you expected
- What results you actually saw


1) Clear description of the problem:
OS X 10.11 OpenCL drivers for GPU are out of date/corrupt, thus GPU/GPGPU computing is unusable. OS X 10.11 OpenCL computing works only on CPU.
By using OS X 10.11 one cannot "take full advantage of the modern graphics processor (GPU) in your Mac" https://support.apple.com/lv-lv/HT202823
OpenCL is open STANDARD for CROSSPLATFORM parallel programming of processors.
It is Apple reponsibility as OpenCL drivers are built in and shipped with OS. Vendors cannot do anything about (AMD has helped developers on OpenCL kernels, but to no avail, as OS X built-in-driver GCN device support is lacking).
On the same hardware, but different operating system OpenCL GPU/GPGPU computing works flawlessly.
Application developers for OS X now choose to implement CUDA, not that they don’t want to support OpenCL, but because OpenCL is broken on OS X. For specific hardware in question - Mac Pro - user cannot choose other (NVIDIA) GPUs, which would enable GPGPU computing (closed CUDA) for applications which is industry standard now for accelerating applications and work that has to be done.
Mac pro is unusable for GPGPU computing. Applications used on every day basis demand this functionality to be usable and work to be productive. A Mac Pro user that has bought multiple Macs specifically for OpenCL intensive tasks (as marketed by Apple) expects answer on exact timeframe this will be sorted out.

Hardware:
Mac Pro (Late 2013) / MacPro6,1, AMD FirePro D700

OS 1 installed - OS X 10.11, 15A282b
Apple built in GPU drivers

OS 2 installed - MSW 8.1, x64
AMD FirePro D700 (FireGL V)
Driver version: 15.200.1060.0
Tested both w/ and w/o CrossFireX

2) A step-by-step set of instructions to reproduce the problem:

2a)
Install OS X 10.11
Install MSW 8.1 x64 (Bootcamp)

2b)
Run MSW.
Download and install VisualStudio 2013 C++ runtime https://www.microsoft.com/en-US/downloa ... x?id=40784
Download and install industry standard OpenCL benchmarking utility LuxMark http://www.luxrender.net/release/luxmar ... 4-v3.1.zip
Run benchmark, using only GPUs as OpenCL compute devices. Save the visual results as well as scores.
Results should be ~
LuxBall HDR - Score 21161, validation OK, 5825 different pixels, 0.91%
Neumann TLM-102 SE - Score 9675, validation OK, 1075 different pixels, 0.17%
Hotel lobby - Score 3898, validation OK, 95072 different pixels, 16.12%

2c)
Run OS X El Capitan.
Download and install industry standard OpenCL benchmarking utility LuxMark http://www.luxrender.net/release/luxmar ... 4-v3.1.zip
Run benchmarks, using only GPUs as OpenCL compute devices. Save the visual results as well as scores.
Results should be ~
LuxBall HDR - Score 21668, validation OK, 5662 different pixels, 0.88%
Neumann TLM-102 SE - Score 9675, validation OK, 6278 different pixels, 0.98%
Hotel lobby - Score 38, validation Failed, 472361 different pixels 80.09%

3) What results you expected
The results should be the same on both OSes using latest GPU drivers. OpenCL is Crossplatform Standard.
There are some differences, so only Scores should differ slightly.
On both OSes all the tests should pass & there should not be any image errors. OpenCL kernel is identical https://bitbucket.org/luxrender/luxmark and requires standard support in drivers (which newest drivers HAVE TO supply)
It was expected that OS X 10.11 will fix known issues with OpenCL:
http://streamcomputing.eu/blog/2015-05- ... r-problem/
http://preta3d.com/os-x-users-unite/

4) What results you actually saw
MSW on MacPro6,1 passed all the benchmarks, generating results with Passing verification and no visual errors.
OS X El Capitan on MacPro6,1 test failed (Neumann, Hotel lobby).
OS X El Capitan has not fixed publicly known and discussed issues with OpenCL making Mac Pro with currently fastest GPU available on Macs (except for modded older Mac Pros with flashed NVIDA cards that offer CUDA, this it what it takes for Mac users to get GPGPU) not to be able to take advantage of the modern graphics processor.

In which build did you encounter this bug?
15A282a

Did you see this problem before you started using OS X El Capitan?
Yes

How often does this problem occur?
It happens every time

Does this prevent you from using OS X El Capitan?
The issue makes it very difficult for me to use OS X El Capitan


and here is MSW on MacPro w/ D700

MSW-BALL-IMAGE.PNG

MSW-BALL-SCORE.PNG


MSW-MIC-IMAGE.PNG

MSW-MIC-SCORE.PNG


MSW-HOTEL-IMAGE.PNG

MSW-HOTEL-SCORE.PNG
firmitas utilitas venustas baby!
User avatar
kroko
 
Posts: 39
Joined: Mon Jan 31, 2011 5:58 am
Location: Riga, Latvia

Re: LuxMark v3.1: LuxRender propaganda with OpenCL

Postby pciccone » Wed Sep 16, 2015 10:41 am

Thank you for the detailed report. Can you give me the radar's bug number? Once I get it I'll forward it to my contact in Apple. Every bit might help.

Thanks.
User avatar
pciccone
Developer
 
Posts: 1579
Joined: Wed Jan 13, 2010 11:02 am
Location: South Carolina

Re: LuxMark v3.1: LuxRender propaganda with OpenCL

Postby kroko » Wed Sep 16, 2015 10:53 am

Well, this is the first time I used Feedback Assistant app, always used dev mailing lists.
Feedback Assistant differs (good, I find it as a yet another tool/channel to talk about this w/ Apple) from dev lists that it is intended for public beta testers that are not developers. I have no idea how it connects with radar, plus I did not get any response containing any number assigned to this. All I can find is #1381709, which can be seen in header for the submitted issue, maybe this helps.

Screen Shot 2015-09-16 at 18.52.52.png
firmitas utilitas venustas baby!
User avatar
kroko
 
Posts: 39
Joined: Mon Jan 31, 2011 5:58 am
Location: Riga, Latvia

Re: LuxMark v3.1: LuxRender propaganda with OpenCL

Postby Dade » Wed Sep 16, 2015 10:56 am

You may want also to highlight as LuxMark is probably the most used OpenCL benchmark at world and Apple has used LuxMark (probably v2.1) to show the performance of the new MacPro: http://www.apple.com/mac-pro/performance/ (look for LuxMark keyword)
User avatar
Dade
Developer
 
Posts: 8404
Joined: Sat Apr 19, 2008 6:04 pm
Location: Italy

Re: LuxMark v3.1: LuxRender propaganda with OpenCL

Postby kroko » Wed Sep 16, 2015 11:09 am

I sent it already. Plus it took me effin hours to shorten my report to 4096 characters, I had a academic essay there :( I will expand on the topic if Apple responds to this.
One could really send in this LuxMark specific bug report for El Capitan. Mac Pro promo page promises me good LuxMark (thus OpenCL) performance. LuxMark fails.
The argumentation is kindergarten style, but IMHO it has to be this way when submitting issue in Feedback Assistant meant for end-users, flashy naive, DoS quantities. :)
firmitas utilitas venustas baby!
User avatar
kroko
 
Posts: 39
Joined: Mon Jan 31, 2011 5:58 am
Location: Riga, Latvia

Re: LuxMark v3.1: LuxRender propaganda with OpenCL

Postby jensverwiebe » Wed Sep 16, 2015 11:42 am

@ kroko

Good luck.
Your are completely right, as said exactly this situation ( not only opencl ) made me switch.

You can also read back opinions in Heise, BlenderNation, etc. when i officially gave up on
OSX maintaining Blender ( may 4th ). The following effords to fix this in Blender seems to be
stuck in half ( with the help of AMD/Apple even ) and ended in not being able to show opencl
on MacPro 6.1/OSX El Captain on Sigraph Blender booth.

I can still give some hints to workaround this and that, but 'am not using OSX anymore.

EDIT: to give you an idea about general performance, compare your mic-result to this: http://www.luxmark.info/node/1000 :oops:

Jens
User avatar
jensverwiebe
Developer
 
Posts: 3429
Joined: Wed Apr 02, 2008 4:34 pm

Re: LuxMark v3.1: LuxRender propaganda with OpenCL

Postby pciccone » Wed Sep 16, 2015 12:09 pm

Kroko, that number does not seem to be right.
Can you log in to bugreport.apple.com using your Apple credentials and check if that report shows in your list. If it does, it should have a number.

Thank you.
User avatar
pciccone
Developer
 
Posts: 1579
Joined: Wed Jan 13, 2010 11:02 am
Location: South Carolina

PreviousNext

Return to GPU Acceleration

Who is online

Users browsing this forum: No registered users and 1 guest

cron