Question: I think u can use both split() or regex Write a function named tokenize that takes a single argument named query, which is a string,

I think u can use both split() or regex
Write a function named "tokenize" that takes a single argument named "query", which is a string, and returns a list of strings with each string being a seperate token. You are welcome to write your own solution or use a solution similar to the one from the video. Full Screen v Grading 8 Run Te code.py New 1- def tokenize(query): 2 pass NOT RUN Not run NOT RUN Not run NOT RUN Not run NOT RUN Not run NOT RUN Not run NOT RUN Not run NOT RUN Not un
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
