Skip to content

Basic text splitter

Fallback option for parsing code when a treesitter implementation is not available (or fails).

DEFAULT_SPLITTER_ARGS = {'add_start_index': True, 'chunk_size': 1000, 'chunk_overlap': 200, 'length_function': len} module-attribute

parse_text(contents, lang, splitter_args=None)