Re: [Kaldi-developers] Query on GPU batching

[Tony R. <to...@ca...>]

On 09/05/2013 04:18 PM, Arnab Ghoshal wrote:
> On Thu, Sep 5, 2013 at 4:54 PM, Tony Robinson <to...@ca...> wrote:
>> I guess we can ask the question in the other way:  does anyone have any
>> profile information to share?   That is, what GPU utilisation does Kaldi
>> achieve?   Clearly if it's currently getting over (say) 50% then there
>> is no point in thinking about this any more.
> I don't think it is possible to look up the computation utilization of
> the GTX cards or at least I haven't figured out how to.

If you run the nvidia visual profiler (nvvp) which is available as part 
of the CUDA toolkit download 
(https://developer.nvidia.com/nvidia-visual-profiler) you can get the 
compute utilization and much else besides. All you need do is create a 
new session with the binary and relevant arguments (ensuring that you 
binary will only run for a short amount of time e.g ~3 secs) and then 
generate a timeline for your program. Once you have a timeline you can 
used the 'guided analysis' to measure different metrics 
(http://docs.nvidia.com/cuda/profiler-users-guide/index.html#analysis-view) 
including compute utilization.

Tony
(who cheated - I'm not a GPU guru - I had to ask a colleague to write 
the above paragraph for me)

-- 
Dr A J Robinson, Founder and Director of Cantab Research Limited.
St Johns Innovation Centre, Cowley Road, Cambridge, CB4 0WS, UK.
Company reg no 05697423 (England and Wales), VAT reg no 925606030.