Remove space and atWord tokens

`atWord` wasn't used at all and spaces should be eaten by the lexer

And added `unspecified` token
This commit is contained in:
Luis Ángel San Martín
2021-01-14 08:39:16 +01:00
parent ddb140d430
commit f09c5955d8
4 changed files with 8 additions and 23 deletions

View File

@ -62,7 +62,7 @@ private:
void advance();
QueryLexer lexer = QueryLexer("");
Token currentToken = Token(Token::Type::eof);
Token currentToken = Token(Token::Type::undefined);
template<typename T>
static bool isIn(const T &e, const std::list<T> &v)