{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":634081686,"defaultBranch":"main","name":"mlc-llm","ownerLogin":"mlc-ai","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2023-04-29T01:59:25.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/106173866?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1717970884.0","currentOid":""},"activityList":{"items":[{"before":"61ca3ae8e6f403f98843d23d6b1369f825849885","after":"eca0898d2c2ad6292075d9df069b5e5bd3e36782","ref":"refs/heads/gh-pages","pushedAt":"2024-06-11T19:41:43.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Tue Jun 11 19:41:43 UTC 2024","shortMessageHtmlLink":"Build at Tue Jun 11 19:41:43 UTC 2024"}},{"before":"42f146d495862f36144a7bbe9a3e966c513e1e36","after":"a231ae1215bd7e06a2f5eddb4e826cd873e69820","ref":"refs/heads/main","pushedAt":"2024-06-11T19:34:36.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[Delivery] Update model delivery script (#2565)\n\nSome improvements of the delivery script:\r\n\r\n- provide different overrides for different quantization. e.g. we can change\r\nprefill chunk size for q0/q3/q4\r\n- rerun gen config only if only conv_template changes\r\n- do NOT recreate HF repo when the repo already exists. This will preserve\r\ncommit history\r\n- dry-run validation","shortMessageHtmlLink":"[Delivery] Update model delivery script (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2345869633\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2565\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2565/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2565\">#2565</a>)"}},{"before":"00b22dbde57a5a88c01d408abf6656b3512840d6","after":"61ca3ae8e6f403f98843d23d6b1369f825849885","ref":"refs/heads/gh-pages","pushedAt":"2024-06-11T17:11:11.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Tue Jun 11 17:11:11 UTC 2024","shortMessageHtmlLink":"Build at Tue Jun 11 17:11:11 UTC 2024"}},{"before":"4234262761b971c970be3c669bd8c8c41ba1db14","after":"42f146d495862f36144a7bbe9a3e966c513e1e36","ref":"refs/heads/main","pushedAt":"2024-06-11T17:04:35.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[Serving][Grammar] Jump-forward decoding (#2551)\n\n[Serve][Grammar] Jump-forward decoding\r\n\r\nThis PR supports the jump-forward decoding as described in\r\n<https://lmsys.org/blog/2024-02-05-compressed-fsm/>. The jump-forward\r\ndecoding uses the grammar constraint to predict the next output string and\r\ntokenize the string into tokens, and therefore speeds up the decoding.\r\n\r\nThis PR implements these optimizations to ensure the output quality:\r\n- Retokenization in jumpforward: Tokenize the last k token as string appended with the predicted\r\n  string. If the tokenization result differs from the old tokens, roll back\r\n  these tokens and accept the new ones.\r\n- Retokenization in decoding: Tokenize the last k token as string appended with\r\n  the decoded token. This will happen in decoding stage when the jumpforward decoding happens\r\n  in the last round. If the result differs, the old tokens will be rolled back.\r\n- Skip prefix tokens in jumpforward: We call tokens that is a prefix of another token\r\n  as prefix tokens. If the last token from jumpforward is a prefix token, it's highly possible\r\n  that it will be rolled back in the next decode stage, as it may be combined with the\r\n  decoded token. It also effects the output distribution as such pattern is rare in training data.\r\n  Therefore, we skip the last prefix token in jumpforward decoding.\r\n\r\nThis PR also includes the following changes:\r\n- Add several metrics for request and engine, especially about the jumpforward decoding\r\n- Fix a bug in `_async_query_engine_metrics` to avoid throwing CancelledError from early return\r\n\r\nPerformance and benchmark:\r\n\r\nSchema(Pydantic):\r\n```\r\nclass Product(BaseModel):\r\n    product_id: int\r\n    is_available: bool\r\n    price: float\r\n    is_featured: Literal[True]\r\n    category: Literal[\"Electronics\", \"Clothing\", \"Food\"]\r\n    tags: List[str]\r\n    stock: Dict[str, int]\r\n```\r\n\r\nPlatform: AMD Ryzen 9 5900X, NVIDIA 3080 10G\r\n\r\nResults:\r\n```\r\nJump forward: False, Batch: 1\r\nEngine metrics:\r\n{\r\n    \"engine_decode_time_sum\": 0.4988938220000001,\r\n    \"engine_jump_forward_time_sum\": 0,\r\n    \"completion_tokens_sum\": 66,\r\n    \"decode_tokens_sum\": 66,\r\n    \"jump_forward_tokens_sum\": 0,\r\n    \"decode_tokens_per_s\": 132.2926785010378,\r\n}\r\nJump forward: True, Batch: 1\r\nEngine metrics:\r\n{\r\n    \"engine_decode_time_sum\": 0.37242740600000007,\r\n    \"engine_jump_forward_time_sum\": 0.027989265000000006,\r\n    \"completion_tokens_sum\": 68,\r\n    \"decode_tokens_sum\": 68,\r\n    \"jump_forward_tokens_sum\": 28,\r\n    \"decode_tokens_per_s\": 182.58591850246378,\r\n}\r\nJump forward: False, Batch: 4\r\nEngine metrics:\r\n{\r\n    \"engine_decode_time_sum\": 0.9106805410000002,\r\n    \"engine_jump_forward_time_sum\": 0,\r\n    \"completion_tokens_sum\": 261,\r\n    \"decode_tokens_sum\": 261,\r\n    \"jump_forward_tokens_sum\": 0,\r\n    \"decode_tokens_per_s\": 286.5988546470984,\r\n}\r\nJump forward: True, Batch: 4\r\nEngine metrics:\r\n{\r\n    \"engine_decode_time_sum\": 0.6843025599999999,\r\n    \"engine_jump_forward_time_sum\": 0.028089531999999997,\r\n    \"completion_tokens_sum\": 266,\r\n    \"decode_tokens_sum\": 266,\r\n    \"jump_forward_tokens_sum\": 112,\r\n    \"decode_tokens_per_s\": 388.71694415405966,\r\n}\r\nJump forward: False, Batch: 8\r\nEngine metrics:\r\n{\r\n    \"engine_decode_time_sum\": 1.62462493,\r\n    \"engine_jump_forward_time_sum\": 0,\r\n    \"completion_tokens_sum\": 538,\r\n    \"decode_tokens_sum\": 538,\r\n    \"jump_forward_tokens_sum\": 0,\r\n    \"decode_tokens_per_s\": 331.1533573475325,\r\n}\r\nJump forward: True, Batch: 8\r\nEngine metrics:\r\n{\r\n    \"engine_decode_time_sum\": 1.0509048310000002,\r\n    \"engine_jump_forward_time_sum\": 0.027971332000000022,\r\n    \"completion_tokens_sum\": 525,\r\n    \"decode_tokens_sum\": 525,\r\n    \"jump_forward_tokens_sum\": 224,\r\n    \"decode_tokens_per_s\": 499.5694990767436,\r\n}\r\nJump forward: False, Batch: 16\r\nEngine metrics:\r\n{\r\n    \"engine_decode_time_sum\": 2.317279175,\r\n    \"engine_jump_forward_time_sum\": 0,\r\n    \"completion_tokens_sum\": 1068,\r\n    \"decode_tokens_sum\": 1068,\r\n    \"jump_forward_tokens_sum\": 0,\r\n    \"decode_tokens_per_s\": 460.8853398080531,\r\n}\r\nJump forward: True, Batch: 16\r\nEngine metrics:\r\n{\r\n    \"engine_decode_time_sum\": 1.3962938819999997,\r\n    \"engine_jump_forward_time_sum\": 0.030129287999999994,\r\n    \"completion_tokens_sum\": 1059,\r\n    \"decode_tokens_sum\": 1059,\r\n    \"jump_forward_tokens_sum\": 448,\r\n    \"decode_tokens_per_s\": 758.4363246533227,\r\n}\r\n```","shortMessageHtmlLink":"[Serving][Grammar] Jump-forward decoding (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2341114671\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2551\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2551/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2551\">#2551</a>)"}},{"before":"7f4d63d1d92b6696c20b10c334a6aa1a3030c7d3","after":"00b22dbde57a5a88c01d408abf6656b3512840d6","ref":"refs/heads/gh-pages","pushedAt":"2024-06-10T18:28:32.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Mon Jun 10 18:28:31 UTC 2024","shortMessageHtmlLink":"Build at Mon Jun 10 18:28:31 UTC 2024"}},{"before":"931587ba139ebfa8fd99ba9d908c8b3c8fbfa2dc","after":"4234262761b971c970be3c669bd8c8c41ba1db14","ref":"refs/heads/main","pushedAt":"2024-06-10T18:21:30.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[Tokenizer] Priorize HuggingFace/SentencePiece over ByteLevelBPE (#2559)\n\nThis PR updates the tokenzier load logic, so that we prioritize\r\nthe use of HuggingFace and SentencePiece tokenizers over the\r\nByteLevelBPE tokenizer.\r\n\r\nThis fixes the issue that token `<im_start>` in Qwen model is\r\ntokenized into multiple tokens when the ByteLevelBPE tokenizer\r\nis chosen when available.","shortMessageHtmlLink":"[Tokenizer] Priorize HuggingFace/SentencePiece over ByteLevelBPE (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2342339216\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2559\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2559/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2559\">#2559</a>)"}},{"before":"c25834da3b403c8c89784726a7269123ee5c0d91","after":"931587ba139ebfa8fd99ba9d908c8b3c8fbfa2dc","ref":"refs/heads/main","pushedAt":"2024-06-10T18:21:16.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"Fix compilation for gcc 13.2 (#2561)","shortMessageHtmlLink":"Fix compilation for gcc 13.2 (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2343638191\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2561\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2561/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2561\">#2561</a>)"}},{"before":"1e5f3994064cc54483b7e5de92d97490e28a4781","after":"7f4d63d1d92b6696c20b10c334a6aa1a3030c7d3","ref":"refs/heads/gh-pages","pushedAt":"2024-06-09T22:25:30.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Sun Jun  9 22:25:30 UTC 2024","shortMessageHtmlLink":"Build at Sun Jun 9 22:25:30 UTC 2024"}},{"before":"9633c9f6eaa37a41386c5d255efefe60e4cb1a63","after":"c25834da3b403c8c89784726a7269123ee5c0d91","ref":"refs/heads/main","pushedAt":"2024-06-09T22:18:25.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[Docs] Fix typo in mlc_llm chat command (#2560)","shortMessageHtmlLink":"[Docs] Fix typo in mlc_llm chat command (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2342513725\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2560\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2560/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2560\">#2560</a>)"}},{"before":null,"after":"9a6244fbc54cdc775ec8b891b9779cd7b576daba","ref":"refs/heads/docs_typo_mlc_chat","pushedAt":"2024-06-09T22:08:04.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Neet-Nestor","name":"Nestor Qin","path":"/Neet-Nestor","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23090573?s=80&v=4"},"commit":{"message":"[Docs] Fix typo in mlc_llm chat command","shortMessageHtmlLink":"[Docs] Fix typo in mlc_llm chat command"}},{"before":"b22a3c0b12aa4bb58bbc9ae50996b325b7580e64","after":"1e5f3994064cc54483b7e5de92d97490e28a4781","ref":"refs/heads/gh-pages","pushedAt":"2024-06-08T22:46:44.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Sat Jun  8 22:46:43 UTC 2024","shortMessageHtmlLink":"Build at Sat Jun 8 22:46:43 UTC 2024"}},{"before":"203cda6b5227407b614c24cc4965527de5b6ccfe","after":"9633c9f6eaa37a41386c5d255efefe60e4cb1a63","ref":"refs/heads/main","pushedAt":"2024-06-08T22:39:53.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"Update docs to remove mention of older models (#2557)","shortMessageHtmlLink":"Update docs to remove mention of older models (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2341620727\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2557\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2557/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2557\">#2557</a>)"}},{"before":"7ae907a4cbb0b5f6b606c1a15278db7e4f421b31","after":"b22a3c0b12aa4bb58bbc9ae50996b325b7580e64","ref":"refs/heads/gh-pages","pushedAt":"2024-06-08T11:55:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Sat Jun  8 11:55:23 UTC 2024","shortMessageHtmlLink":"Build at Sat Jun 8 11:55:23 UTC 2024"}},{"before":"db896d1b65aa481467a64d45c337ae754a39f7f6","after":"203cda6b5227407b614c24cc4965527de5b6ccfe","ref":"refs/heads/main","pushedAt":"2024-06-08T11:48:21.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[Preset] Add model preset for model delivery (#2553)\n\n[Preset] Add model preset for wasm delivery","shortMessageHtmlLink":"[Preset] Add model preset for model delivery (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2341405380\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2553\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2553/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2553\">#2553</a>)"}},{"before":"e0c2256d60f08b122a36a9e07c299c4987626e29","after":"7ae907a4cbb0b5f6b606c1a15278db7e4f421b31","ref":"refs/heads/gh-pages","pushedAt":"2024-06-08T02:43:00.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Sat Jun  8 02:42:59 UTC 2024","shortMessageHtmlLink":"Build at Sat Jun 8 02:42:59 UTC 2024"}},{"before":"f489d8dc62fe05be4459eab886f17168c7c44b93","after":"db896d1b65aa481467a64d45c337ae754a39f7f6","ref":"refs/heads/main","pushedAt":"2024-06-08T02:36:20.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Neet-Nestor","name":"Nestor Qin","path":"/Neet-Nestor","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23090573?s=80&v=4"},"commit":{"message":"[Site] Update heading","shortMessageHtmlLink":"[Site] Update heading"}},{"before":"45d030b4177b92c2063f52a68859dd21d23109d8","after":"e0c2256d60f08b122a36a9e07c299c4987626e29","ref":"refs/heads/gh-pages","pushedAt":"2024-06-08T02:20:35.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Sat Jun  8 02:20:35 UTC 2024","shortMessageHtmlLink":"Build at Sat Jun 8 02:20:35 UTC 2024"}},{"before":"6bbd49cb0ccd7751bc0a19cb8f07a0fea79b4bd4","after":"f489d8dc62fe05be4459eab886f17168c7c44b93","ref":"refs/heads/main","pushedAt":"2024-06-08T02:14:06.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Neet-Nestor","name":"Nestor Qin","path":"/Neet-Nestor","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23090573?s=80&v=4"},"commit":{"message":"[Site] Update link to webllm","shortMessageHtmlLink":"[Site] Update link to webllm"}},{"before":"423d79ed18465ed2f5d99f19b0e3591f10821867","after":"45d030b4177b92c2063f52a68859dd21d23109d8","ref":"refs/heads/gh-pages","pushedAt":"2024-06-07T19:17:25.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Fri Jun  7 19:17:24 UTC 2024","shortMessageHtmlLink":"Build at Fri Jun 7 19:17:24 UTC 2024"}},{"before":"26a9cf0d820a2b12ddcfbbec3ec63d90290d8a4d","after":"6bbd49cb0ccd7751bc0a19cb8f07a0fea79b4bd4","ref":"refs/heads/main","pushedAt":"2024-06-07T19:10:28.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[EngineConfig] Add override options (#2550)\n\nThis PR introduces override options to the Python side EngineConfig\r\nso that they'll be reflected in JIT model compilation.","shortMessageHtmlLink":"[EngineConfig] Add override options (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2340885054\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2550\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2550/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2550\">#2550</a>)"}},{"before":"465fcd66bb7ff16df6f9d72ea098446d206dcb78","after":"423d79ed18465ed2f5d99f19b0e3591f10821867","ref":"refs/heads/gh-pages","pushedAt":"2024-06-07T16:28:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Fri Jun  7 16:28:24 UTC 2024","shortMessageHtmlLink":"Build at Fri Jun 7 16:28:24 UTC 2024"}},{"before":"78b6e1f4e5d154132028691e1ba0605a230738fb","after":"26a9cf0d820a2b12ddcfbbec3ec63d90290d8a4d","ref":"refs/heads/main","pushedAt":"2024-06-07T16:22:18.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[Android] Escape backslashes and quotation marks (#2546)\n\nThis commit escapes the backslashes and quotation marks in Android\r\npackage build.","shortMessageHtmlLink":"[Android] Escape backslashes and quotation marks (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2340743434\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2546\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2546/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2546\">#2546</a>)"}},{"before":"961d5f188e2771453ec533c8138a0f85b92aebf6","after":"78b6e1f4e5d154132028691e1ba0605a230738fb","ref":"refs/heads/main","pushedAt":"2024-06-07T16:22:05.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[Android] Add Qwen2 support (#2548)","shortMessageHtmlLink":"[Android] Add Qwen2 support (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2340792235\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2548\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2548/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2548\">#2548</a>)"}},{"before":"0e7fdc3b0ddfafb226c383ab37544485d240757e","after":"465fcd66bb7ff16df6f9d72ea098446d206dcb78","ref":"refs/heads/gh-pages","pushedAt":"2024-06-07T15:54:08.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Fri Jun  7 15:54:07 UTC 2024","shortMessageHtmlLink":"Build at Fri Jun 7 15:54:07 UTC 2024"}},{"before":"6bd049ec3648edf015d0c2f6277e94007e42602c","after":"961d5f188e2771453ec533c8138a0f85b92aebf6","ref":"refs/heads/main","pushedAt":"2024-06-07T15:47:37.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"[iOS] Add Qwen2 support (#2547)\n\nThis PR add Qwen2 support to MLC Chat","shortMessageHtmlLink":"[iOS] Add Qwen2 support (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2340744239\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2547\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2547/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2547\">#2547</a>)"}},{"before":"ef60514627eac2e6a6d58a9197bde281bb54bb67","after":"0e7fdc3b0ddfafb226c383ab37544485d240757e","ref":"refs/heads/gh-pages","pushedAt":"2024-06-07T15:35:19.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Fri Jun  7 15:35:18 UTC 2024","shortMessageHtmlLink":"Build at Fri Jun 7 15:35:18 UTC 2024"}},{"before":"0a9809354748c65ca13bbb67e0b344a27df20e42","after":"ef60514627eac2e6a6d58a9197bde281bb54bb67","ref":"refs/heads/gh-pages","pushedAt":"2024-06-07T15:30:10.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Fri Jun  7 15:30:09 UTC 2024","shortMessageHtmlLink":"Build at Fri Jun 7 15:30:09 UTC 2024"}},{"before":"fcb50a217a59c01a32516d03ed53e590a81ca4b1","after":"6bd049ec3648edf015d0c2f6277e94007e42602c","ref":"refs/heads/main","pushedAt":"2024-06-07T15:28:55.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"MasterJH5574","name":"Ruihang Lai","path":"/MasterJH5574","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/45167100?s=80&v=4"},"commit":{"message":"[Fix] Fix attn kernel build issue (#2545)\n\nThis PR fixes TIR issues in the attn kernels.","shortMessageHtmlLink":"[Fix] Fix attn kernel build issue (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2340714330\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2545\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2545/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2545\">#2545</a>)"}},{"before":"208642d372e721c9f7157a6b2a13bd1f94b7361c","after":"fcb50a217a59c01a32516d03ed53e590a81ca4b1","ref":"refs/heads/main","pushedAt":"2024-06-07T15:14:58.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tqchen","name":"Tianqi Chen","path":"/tqchen","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2577440?s=80&v=4"},"commit":{"message":"fix: typo error (#2544)","shortMessageHtmlLink":"fix: typo error (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2340685194\" data-permission-text=\"Title is private\" data-url=\"https://github.com/mlc-ai/mlc-llm/issues/2544\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/mlc-ai/mlc-llm/pull/2544/hovercard\" href=\"https://github.com/mlc-ai/mlc-llm/pull/2544\">#2544</a>)"}},{"before":"9646a9ec48b1900282e9905fb727bcea3ebb79c0","after":"0a9809354748c65ca13bbb67e0b344a27df20e42","ref":"refs/heads/gh-pages","pushedAt":"2024-06-07T15:13:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Build at Fri Jun  7 15:13:24 UTC 2024","shortMessageHtmlLink":"Build at Fri Jun 7 15:13:24 UTC 2024"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEYpnH0wA","startCursor":null,"endCursor":null}},"title":"Activity · mlc-ai/mlc-llm"}