WebGL2
A browser 3D graphics API based on OpenGL ES 3.0. It supports general-purpose computing features such as transform feedback, but lacks GPU computing infrastructure such as shared memory and atomic operations.
Timeline (last 90 days)
A Reddit user tried to hand-build an inference engine from scratch to run a GGUF Q4 model in the browser via WebGL2, and ended up going through a great deal of debugging difficulty.
Projects such as WebLLM have already verified the feasibility of running large models with the browser GPU (WebGL2).
WebGL2's transform feedback allows vertex shaders to write computation results back to GPU buffers, and it is used by some browser-side inference projects to implement general-purpose computation such as matrix multiplication.
WebGL2 is still essentially a graphics API, lacking shared memory, atomic operations and mature performance profiling tools like CUDA, with data types mainly floating-point vectors and limited support for integer arithmetic and bit operations.
All Facts (4)
Projects such as WebLLM have already verified the feasibility of running large models with the browser GPU (WebGL2).
50%UnverifiedWebGL2's transform feedback allows vertex shaders to write computation results back to GPU buffers, and it is used by some browser-side inference projects to implement general-purpose computation such as matrix multiplication.
50%UnverifiedWebGL2 is still essentially a graphics API, lacking shared memory, atomic operations and mature performance profiling tools like CUDA, with data types mainly floating-point vectors and limited support for integer arithmetic and bit operations.
50%UnverifiedA Reddit user tried to hand-build an inference engine from scratch to run a GGUF Q4 model in the browser via WebGL2, and ended up going through a great deal of debugging difficulty.
50%