[Feat] Switch to using Chonkie.Tokenizer for Chunkers, Refineries

[bhavnicksm]

This pull request includes various updates to improve code readability, consistency, and functionality across multiple files. The changes primarily focus on formatting adjustments, code refactoring, and configuration updates.

Code Formatting and Consistency:

• Updated string delimiters from single quotes to double quotes for consistency in cookbook/tutorials/Chonkie_RecursiveChunker_for_PDF_and_Markdown.ipynb and other files. [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12]

Code Refactoring:

• Refactored the BaseChef class and its methods in src/chonkie/chef/base.py to improve readability and ensure proper handling of optional parameters. [1] [2] [3] [4] [5]

Configuration Updates:

• Updated pyproject.toml to improve package management and linting configurations, including adding new packages and modifying linting rules. [1] [2]

New Additions:

• Added a new module chonkie.chef in pyproject.toml to include the new chef package.

Minor Adjustments:

• Added missing newlines and adjusted indentation for better readability in various files. [1] [2] [3]

These changes collectively enhance the maintainability and readability of the codebase, ensuring a more consistent and clean structure.