← 返回首页
add int8 matmul support to CUDA backend by verstatx · Pull Request #3508 · arrayfire/arrayfire · GitHub
Skip to content

Navigation Menu

Toggle navigation
Sign in
Appearance settings
Search or jump to...

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted
Cancel Submit feedback

Saved searches

Use saved searches to filter your results more quickly

Cancel Create saved search
Appearance settings
Resetting focus

add int8 matmul support to CUDA backend#3508

Merged
edwinsolisf merged 1 commit into
arrayfire:masterfrom
verstatx:int8_matmul
Mar 28, 2025
Merged

add int8 matmul support to CUDA backend#3508
edwinsolisf merged 1 commit into
arrayfire:masterfrom
verstatx:int8_matmul

Conversation

Copy link
Copy Markdown
Contributor

verstatx commented Oct 4, 2023 •
edited
Loading

Description

Adds support for int8 matmul in the CUDA backend using cublasGemmEx functions. This modifies the gemm functions' api to support a different output array type, so all backends were modified.

This PR depends on s8 support: #3507
Fixes: #1656

Checklist

verstatx marked this pull request as draft October 4, 2023 10:52
melonakos marked this pull request as ready for review February 11, 2025 21:48
melonakos added this to the 3.10 milestone Feb 11, 2025
edwinsolisf previously approved these changes Mar 16, 2025
View reviewed changes
Copy link
Copy Markdown
Contributor

edwinsolisf left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Choose a reason Spam Abuse Off Topic Outdated Duplicate Resolved Low Quality Hide comment

Tested on RTX 3070Ti all backends on Ubuntu & Windows

Add int8 matmul support to the CUDA backend …
8341aca
changes to gemm account for differing input/output types
Copy link
Copy Markdown
Contributor Author

verstatx commented Mar 17, 2025

Squashed commits and rebased on master. Included a minor lint fix to whitespace that I apparently missed. My apologies if this interfered with your process!

edwinsolisf self-requested a review March 20, 2025 23:40
edwinsolisf merged commit ccac73e into arrayfire:master Mar 28, 2025
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Show hidden characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

edwinsolisf edwinsolisf approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

3.10

Development

Successfully merging this pull request may close these issues.

Add suport for int8 matmul in afcuda

3 participants

Footer

© 2026 GitHub, Inc.