mirror of
https://github.com/pytorch/pytorch.git
synced 2025-10-21 13:44:15 +08:00
The trie-based approach was, apparently, not efficient. This incidentally fixes a bug where "not inp" and "is note" were lexed incorrectly; see test_lexer.cpp update. Differential Revision: [D73129443](https://our.internmc.facebook.com/intern/diff/D73129443/) Pull Request resolved: https://github.com/pytorch/pytorch/pull/151850 Approved by: https://github.com/Skylion007 ghstack dependencies: #151801, #151802, #151803, #151804, #151805, #151806, #151807, #151810, #151849
7 lines
158 B
C++
7 lines
158 B
C++
#pragma once
|
|
|
|
namespace torch::jit {
|
|
[[maybe_unused]] static const char* valid_single_char_tokens =
|
|
"+-*/%@()[]:,={}><.?!&^|~";
|
|
} // namespace torch::jit
|