Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement quantization on-the-fly #100

Draft
wants to merge 6 commits into
base: master
Choose a base branch
from
Draft

Implement quantization on-the-fly #100

wants to merge 6 commits into from

Commits on Jun 13, 2023

  1. Implement on-the-fly quantization

    @saharNooby
    saharNooby committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    65cdb51 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2023

  1. Resolve TODO items

    @saharNooby
    saharNooby committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    dca26e9 View commit details
    Browse the repository at this point in the history

  2. Fix error code

    @saharNooby
    saharNooby committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    7a13fd2 View commit details
    Browse the repository at this point in the history

  3. Reformat code

    @saharNooby
    saharNooby committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    4d27fa8 View commit details
    Browse the repository at this point in the history

  4. Consistently use FP16 and FP32 for rwkv.cpp data types

    @saharNooby
    saharNooby committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    d3b6749 View commit details
    Browse the repository at this point in the history

  5. Add test for on-the-fly quantization

    @saharNooby
    saharNooby committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    c49d3d8 View commit details
    Browse the repository at this point in the history