Open
Description
Hi Triton team,
I wan to leverage Triton with AOT compile. I am looking at the fused attention kernel in the triton offical tutorial and I encountered an issue: how to type hint triton for the q tensor in the _attn_fwd_inner. I think q is a tensor, but I was unable to find the corresponding type hint example in compile.py entrypoint. I tried reading the str_to_ty function but it apperas to only be supporting pointer, tensordesc, constexpr.
I was also trying to go back and find an old version of the tutorial in which the _attn_fwd_inner has q being a loaded block and K_block_pt and V_block_ptr being two block pointers. Do we have ways to type hints Block and Block Ptr?
Thank you so much!
Metadata
Metadata
Assignees
Labels
No labels