Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Parse markdown article, download images and replace images URL's with local paths

Reddit bot to preview and post hyperlinks as comments

NLP Web Service

Extract article or news by url or html, parse the title and content, output in markdown format.

📚 Сборник полезных штук из Natural Language Processing: Определение языка текста, Разделение текста на предложения, Получение основного содержимого из html документа

디시인사이드 Client-Side 글 검색기 입니다.

The program can be used to scrape the content from an article from web by an input of a set of URLs in a text file or a URL. This project uses newspaper3k and python-docx libraries. The output of this program will give a neatly modified Word Document in '.docx' format with the contents of the article.

Nebula Expired Article Hunter is a marketing tool you can use to get expired content from www.archive.org A.K.A. wayback machine, you could use this kind of content to grow up your blog with evergreen information, improve your marketing campaigns without investing in writing services, or whatever you imagine is useful for.

Simple HTTP API endpoint that takes URL to any article and returns JSON object containing information about the article.

A python script to scrap articles from Prothom Alo with the Headline, Category, URL, and Summary

Transform messy HTML from Google Docs into well-structured HTML!

The main goal of an AI-Powered News Summarizer is to assist users in quickly understanding the main points and essential information from a large volume of news articles or textual content. By automatically summarizing news articles, it saves time and effort by providing users with a brief overview without having to read the entire article.

Scrape Yılmaz Özdil articles and create Markov model to generate newspaper articles like Yılmaz Özdil. Turkish text dataset creator for data science and NLP projects.

This project creates a Retrieve-and-Generate (RAG) powered chatbot for summarizing and interacting with articles. The system processes articles provided as PDFs or URLs, extracts text, splits the content into chunks, generates embeddings, and stores them in a vector database.

Crawling articles from websites

A Simple Article Picker Simply it Scrapes the website http://mawdoo3.com and picks a random from it to show it you

Arachnio client library for Python 3.10+

Universal scraping platform for news and comments

Extract article (including images) by url and save to file.