The CUDA Handbook: A Comprehensive Guide to GPU Programming (2nd Edition) / Nicholas Wilt

The CUDA Handbook is the only comprehensive reference to CUDA that exists. Every CUDA developer, from the casual to the most sophisticated, will find something here of interest and immediate usefulness. Newer CUDA developers will see how the hardware processes commands and how the driver checks progress; more experienced CUDA developers will appreciate the expert coverage of topics such as the driver API and context migration, as well as the guidance on how best to structure CPU/GPU data interchange and synchronization.

The accompanying open source code—more than 30,000 lines of it, freely available from github — is specifically intended to be reused and repurposed by developers.