Skip to content

Verify and add tests for quantization support #16

@yairallouche

Description

@yairallouche

The GraniteSwitch model loading should be evaluated in quantized mode:

  • Verify that the GraniteSwitch model properly loads in quantized mode
  • Provide test coverage for quantized loading

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions