Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scoring changes from tc meeting #946

Merged
merged 2 commits into from
Feb 24, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 8 additions & 13 deletions scoresheets/Receptionist.tex
Original file line number Diff line number Diff line change
@@ -1,28 +1,23 @@
\begin{scorelist}[startbutton=false,timelimit=5]
\begin{scorelist}[startbutton=false,timelimit=6]
\scoreheading{Main Goal}
\scoreitem[2]{100}{Offer a free seat to the new guest}
\scoreitem[2]{30}{Show the guest around (navigate to the beverage area and living room)}
\scoreitem[2]{15}{Look in the direction of navigation or at the navigation goal}
\scoreitem[2]{20}{Confirm favorite drink}
\scoreitem[2]{20}{Confirm interest of guest}
\scoreitem[2]{20}{Tell position of favorite drink}
\scoreitem[2]{100}{Offer a free seat to the new guest}
\scoreitem[2]{75}{Look at the person talking}
\scoreitem[1]{75}{Introduce both guests to each other}
\scoreitem[1]{180}{Introduce both guests to each other}


\scoreheading{Bonus Rewards}
\scoreitem[2]{200}{Open the entrance door for a guest}
\scoreitem[1]{50}{State a shared interest between two or more persons}
\scoreitem[4]{30}{Describe the first guest to the second guest (per correct attribute)}
\scoreitem[1]{50}{State a similarity between an interest between two or more persons}
\scoreitem[4]{30}{Describe the first guest to the second guest before reaching the living room (per correct visual attribute)}


\scoreheading{Penalties}
\penaltyitem[2]{50}{Wrong guest information was memorized (continue with wrong name or drink)}
\penaltyitem[2]{50}{Interest was not or wrongly memorized}
\penaltyitem{50}{Persistent inappropriate gaze (away from conversational partner)}
\penaltyitem{25}{Persistent gaze not in the direction of the navigation while moving.}
\penaltyitem[4]{30}{Describe the first guest to the second guest (per incorrect attribute)}
\penaltyitem[1]{30}{Wrongly stating a similarity}
\penaltyitem[6]{20}{Wrong guest information was memorized (continue with wrong name, drink or interest)}
\penaltyitem[4]{30}{Describe the first guest to the second guest before reaching the living room (per incorrect visual attribute)}
\penaltyitem[1]{120}{Introduce the wrong persons}

\scoreheading{Deus Ex Machina}
\penaltyitem[2]{75}{Alternative HRI}
Expand Down
14 changes: 8 additions & 6 deletions tasks/Receptionist.tex
Original file line number Diff line number Diff line change
Expand Up @@ -4,18 +4,18 @@ \subsection*{Description}
The robot has to take two new guests to the living room to introduce them and offer a free place to sit.\\

\textbf{Main goal:}
The robot welcomes and assists two newcomers at a party while maintaining appropriate gaze direction during conversation (at person speaking, direction of navigation).
The robot welcomes and assists two newcomers at a party, offering them a seat and maintaining appropriate gaze direction during conversation (at person speaking, direction of navigation).

% \vspace{-5pt}
\textbf{Optional goals:}
\begin{enumerate}[nosep]
\item Open the entrance door for each arriving guest.
\item Describe the first guest for the second guest before reaching the living room
\item Visually describe the first guest for the second guest before reaching the living room
\item Identify similarities between the guests and the host and incorporate them into the conversation.
\end{enumerate}

\subsection*{Focus}
\SysI{}, \HRI{}, \PerDet{}, \PerRec
\SysI{}, \HRI{}, \PerDet{}, \PerRec{}
% human detection and recognition, safe navigation and human-robot interaction with unknown people.

\subsection*{Setup}
Expand All @@ -30,7 +30,7 @@ \subsection*{Setup}

\item \textbf{People:}
\begin{itemize}
\item \textbf{Host:} The host's name, favorite drink and interest will be announced before the test. The host is already sitting in the living room.
\item \textbf{Host:} The host's name, favorite drink and interest will be announced before the test. The host is the only person sitting in the living room until the robot offers a free seat to another guest.

\item \textbf{Arriving Guests:} Both guests have a name, favorite drink, and a interest. An arriving guest will either step in front of the robot or wait behind the door to step in if the door is closed. Guests have to be guided to the beverage area and then the living room where the robot will introduce the guests to each other. Each of the guest will arrive separately.

Expand All @@ -57,12 +57,14 @@ \subsection*{Procedure}

\item \textbf{Switching Places:} Guests may switch places after they were seated.

\item \textbf{Introductions:} When introducing guests, the robot must clearly identify the person being introduced and state their name favorite drink and an interest. Introducing two people means to introduce them to each other.
\item \textbf{Introductions:} When introducing guests, the robot must clearly identify the person being introduced and state their name favorite drink and an interest. Introducing two people mean to introduce them to each other.
\end{itemize}

\subsection*{Additional rules and remarks}
\begin{enumerate}[nosep]
\item \textbf{Misunderstanding:} Not understanding the guests and asking them again is fine. Continuing with a wrong name, drink or interest causes a score reduction of 50pts.
\item \textbf{Opening Door Timing:} The Time of the test only starts after the fist person enters the arena or 2mins after start signal.

\item \textbf{Misunderstanding:} Not understanding the guests and asking them again is fine. Continuing with a wrong name, drink or interest causes a score reduction of 20pts per item.

\item \textbf{Partial Scoring:} The main task allows partial (per guest) scoring.

Expand Down
2 changes: 1 addition & 1 deletion tasks/StoringGroceries.tex
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ \subsection*{Setup}
\item \textbf{Furniture:}
\begin{itemize}
\item \textbf{Table:} The table has 5--10 objects placed on it and the robot can choose which ones to grasp and in what order. On small tables, objects will be added as the robot frees up space.
\item \textbf{Shopping Bag:} There is a shopping bag with 5--10 additional items on the ground next to the table.
\item \textbf{Shopping Bag:} There is a shopping bag with 5--10 additional normal items on the ground next to the table.
\item \textbf{Cabinet:} The cabinet contains objects arranged in groups --- either by category or likeliness --- on different shelves.
\item \textbf{Cabinet door:} The cabinet is closed. If the robot fails to open the door, it must clearly state this and request the referee to open it.
\end{itemize}
Expand Down