Skip to content

Commit

Permalink
UPDATE docs
Browse files Browse the repository at this point in the history
  • Loading branch information
PascalSun committed Nov 17, 2024
1 parent e44d718 commit 780da54
Show file tree
Hide file tree
Showing 2 changed files with 27 additions and 12 deletions.
33 changes: 24 additions & 9 deletions docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,12 @@ Multimodal Open Source Framework for Conversational Agents Research and Developm
![Deployment](/~https://github.com/AI4WA/OpenOmniFramework/actions/workflows/deploy.yml/badge.svg)
![Lint](/~https://github.com/AI4WA/OpenOmniFramework/actions/workflows/tox.yml/badge.svg)
![Status](https://img.shields.io/badge/Status-Work%20in%20Progress-yellow)
[![Paper](https://img.shields.io/badge/Paper-View-green?style=flat&logo=adobeacrobatreader)](https://arxiv.org/pdf/2408.03047)
[![Paper](https://img.shields.io/badge/Paper-View-green?style=flat&logo=adobeacrobatreader)](https://aclanthology.org/2024.emnlp-demo.5.pdf)

## News

- **2024-11-15**: OpenOmni Framework has been awarded the Best Demo Paper Award at EMNLP 2024. [Award](https://2024.emnlp.org/program/best_papers/)
- **2024-10-06**: OpenOmni Framework is accepted by EMNLP 2024 Demo Track. [Paper](https://aclanthology.org/2024.emnlp-demo.5.pdf)

----

Expand Down Expand Up @@ -349,13 +354,23 @@ in [Deployment](./Deployment/index.md).
If you find this package useful, please consider citing our work:

```bibtex
@misc{sun2024openomnicollaborativeopensource,
title={OpenOmni: A Collaborative Open Source Tool for Building Future-Ready Multimodal Conversational Agents},
author={Qiang Sun and Yuanyi Luo and Sirui Li and Wenxiao Zhang and Wei Liu},
year={2024},
eprint={2408.03047},
archivePrefix={arXiv},
primaryClass={cs.HC},
url={https://arxiv.org/abs/2408.03047},
@inproceedings{sun-etal-2024-openomni,
title = "{O}pen{O}mni: A Collaborative Open Source Tool for Building Future-Ready Multimodal Conversational Agents",
author = "Sun, Qiang and
Luo, Yuanyi and
Li, Sirui and
Zhang, Wenxiao and
Liu, Wei",
editor = "Hernandez Farias, Delia Irazu and
Hope, Tom and
Li, Manling",
booktitle = "Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: System Demonstrations",
month = nov,
year = "2024",
address = "Miami, Florida, USA",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2024.emnlp-demo.5",
pages = "46--52",
abstract = "Multimodal conversational agents are highly desirable because they offer natural and human-like interaction.However, there is a lack of comprehensive end-to-end solutions to support collaborative development and benchmarking.While proprietary systems like GPT-4o and Gemini demonstrating impressive integration of audio, video, and text with response times of 200-250ms, challenges remain in balancing latency, accuracy, cost, and data privacy.To better understand and quantify these issues, we developed \textbf{OpenOmni}, an open-source, end-to-end pipeline benchmarking tool that integrates advanced technologies such as Speech-to-Text, Emotion Detection, Retrieval Augmented Generation, Large Language Models, along with the ability to integrate customized models.OpenOmni supports local and cloud deployment, ensuring data privacy and supporting latency and accuracy benchmarking. This flexible framework allows researchers to customize the pipeline, focusing on real bottlenecks and facilitating rapid proof-of-concept development. OpenOmni can significantly enhance applications like indoor assistance for visually impaired individuals, advancing human-computer interaction.Our demonstration video is available https://www.youtube.com/watch?v=zaSiT3clWqY, demo is available via https://openomni.ai4wa.com, code is available via /~https://github.com/AI4WA/OpenOmniFramework.",
}
```
6 changes: 3 additions & 3 deletions mkdocs.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
site_name: OpenOmni Framework by AI4WA
site_url: https://openbenang.ai4wa.com
site_url: https://openomni.ai4wa.com/
theme:
name: material
logo: images/AI4WA.png
Expand All @@ -9,7 +9,7 @@ theme:
- navigation.tabs
icon:
repo: fontawesome/brands/github
repo_url: /~https://github.com/AI4WA/OpenBenang
repo_url: /~https://github.com/AI4WA/OpenOmniFramework
nav:
- Home: index.md
- Tutorial:
Expand Down Expand Up @@ -185,7 +185,7 @@ plugins:
extra:
social:
- icon: fontawesome/brands/github
link: /~https://github.com/AI4WA/OpenBenang
link: /~https://github.com/AI4WA/OpenOmniFramework
- icon: fontawesome/brands/linkedin
link: https://www.linkedin.com/company/ai4wa
analytics:
Expand Down

0 comments on commit 780da54

Please sign in to comment.