Overcooked Environment #355
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Introduced core files for the Overcooked multiagent environment, including `binding.c`, `overcooked.c`, `overcooked.h`, and `overcooked.py`. - Implemented initialization, logging, and step functions for agent interactions. - Added rendering and cleanup functionalities for the environment. - Provided a template for users to create their own multiagent environments based on Overcooked.
- Updated `binding.c`, `overcooked.c`, and `overcooked.h` to support a single-agent Overcooked environment. - Replaced multi-agent parameters with single-agent equivalents, including max steps and grid size. - Enhanced observation and action spaces to reflect the new gameplay structure. - Implemented item handling and grid management for the cooking environment. - Adjusted rendering logic to visualize the agent and items correctly.
- Added entry to ignore all dsym files to prevent them from being tracked in the repository.
- Changed default dimensions of the Overcooked environment from 10x10 to 5x5 in both C and Python implementations. - Updated grid size from 50 to 100 for better visualization. - Introduced a new cramped room layout for testing. - Enhanced grid parsing logic to accommodate the new layout and item types. - Adjusted agent starting position and rendering logic for improved gameplay experience.
- Updated the `is_valid_position` function to check for EMPTY instead of WALL, ensuring correct position validation within the grid.
- Implemented logic for agent interactions, allowing the agent to pick up items, put down items on specific tiles, and retrieve ingredients from boxes. - Enhanced the `handle_interaction` function to manage the agent's held item based on the current tile and agent's facing direction. - Added boundary checks to ensure valid interactions within the grid.
- Introduced helper functions for item management: `get_item_at`, `add_item`, and `remove_item`. - Implemented `get_agent_color` function to determine the agent's color based on the held item. - Updated rendering logic to draw the agent with the appropriate color based on the item they are holding.
- Introduced various chef images (EAST, NORTH, SOUTH, WEST) with different hats and dishes. - Added individual item images such as arrows and interaction icons. - Included object images for dishes, onions, and pots. - Added multiple soup images representing different cooking stages and states. - Updated terrain images for counters, dishes, and ingredients.
- Added new terrain textures for floor, counter, pot, serve, and ingredient boxes. - Introduced object textures for onions, tomatoes, dishes, and soups. - Implemented chef sprite textures for all directions and held items. - Updated rendering logic to utilize textures for grid tiles and items, improving visual fidelity. - Added texture unloading in cleanup to manage resources effectively.
- Changed chef sprite texture file names to remove specific hat identifiers, streamlining asset management. - Ensured consistency in texture naming for all chef directions (NORTH, SOUTH, EAST, WEST).
- Introduced cooking states and parameters for managing cooking pots. - Implemented logic for adding ingredients to pots, starting cooking, and handling cooked or burnt states. - Enhanced rendering to display cooking progress and states visually on stoves. - Added functions for initializing and updating cooking pots, ensuring proper resource management during gameplay.
- Introduced a new item type for plated soup, allowing players to hold and place soups with ingredient information. - Updated agent and item structures to track soup ingredients and states. - Modified interaction logic to require a plate for picking up cooked soup and to preserve ingredient data when placing plated soup. - Enhanced rendering logic to display appropriate textures for plated soups and their respective ingredients. - Added new chef sprite textures for holding soups, improving visual representation during gameplay.
- Introduced a new configuration file `overcooked.ini` for the Overcooked environment. - Defined parameters for the base, environment, and training settings, including package name, environment name, number of environments, agents, goals, and training hyperparameters. - This file will facilitate easier adjustments to gameplay settings and training configurations.
- Reduced the number of agents from 8 to 2 in the `overcooked.ini` configuration file. - This change aims to streamline gameplay dynamics and enhance performance by limiting the number of active agents in the environment.
- Updated the Overcooked environment to support multiple agents, allowing cooperative play. - Introduced new parameters for agent management, including `num_agents` in the environment configuration. - Modified initialization, action handling, and rendering logic to accommodate multiple agents. - Enhanced interaction mechanics to track actions and states for each agent, improving gameplay dynamics. - Updated documentation and comments to reflect the transition from a single-agent to a multi-agent environment.
- Updated the observation size calculation to reflect a one-hot encoded grid with detailed channel breakdown. - Enhanced the `compute_observations` function to include terrain types, item types, agent positions, and cooking states. - Added logic for encoding agent states and cooking progress, improving the observation data structure for multi-agent gameplay. - Included debug information for initial observations to assist in development and testing.
- Updated the observation size calculation to a flat array format, simplifying the structure for multi-agent gameplay. - Enhanced the `compute_observations` function to include detailed agent states, item positions, and cooking pot information. - Improved clarity in comments regarding the observation components, aiding future development and understanding of the observation space. - Removed outdated one-hot encoding logic, streamlining the observation process for better performance.
- Implemented a new function to evaluate served dishes and assign rewards based on ingredient correctness. - Added logic to handle the completion of serving a plated soup, including clearing the agent's held items. - Enhanced interaction mechanics to incorporate dish evaluation, improving gameplay dynamics and agent cooperation. - Updated comments for clarity on the new reward structure and potential future enhancements.
- Increased the maximum steps from 200 to 400 to allow for longer gameplay sessions. - Adjusted reward values for served dishes from 10.0 to 1.0 and step penalty from -0.1 to 0.0 to refine the reward system and enhance player experience. - These changes aim to improve the overall dynamics and strategy within the Overcooked environment.
…onment - Introduced a new function to evaluate dishes served by agents, improving gameplay dynamics. - Updated rendering logic to accommodate an additional status display area, enhancing visual feedback during gameplay. - Adjusted drawing positions for various elements to account for the new status area, ensuring a clear and organized interface. - Improved comments for clarity on the new rendering adjustments and dish evaluation mechanics.
- Included 'overcooked' as a new game type in the MAKE_FUNCTIONS dictionary. - This addition expands the available game modes, enhancing the versatility of the environment.
- Updated the Overcooked demo to include neural network functionality, allowing agents to make decisions based on learned weights. - Replaced random action selection with a neural network for agent actions, enhancing gameplay dynamics. - Added a performance testing function to evaluate agent actions over a specified time period. - Included necessary weight files for neural network operations, improving the overall complexity and strategy of the game.
Author
|
Currently training model for demo. Model is not producing meaningful actions. Still debugging. 
|
- Introduced new metrics to the Log structure, including correct and wrong dishes, ingredients picked, pots started, items dropped, agent collisions, and cooking time efficiency. - Updated relevant functions to increment these statistics during gameplay, enhancing performance tracking and gameplay analysis. - Initialized user stats upon environment reset to ensure accurate tracking from the start of each episode.
- Removed penalty for serving wrong dishes, now only tracking the count of wrong dishes. - This change simplifies the reward system and focuses on performance metrics without penalizing agents for incorrect actions.
- Simplified the dish evaluation function by removing unnecessary comments and streamlining the tracking of correct and wrong dishes. - Maintained the focus on performance metrics while ensuring clarity in the code structure.
- Updated the observation size to a fixed 96-dimensional vector per agent, improving clarity and consistency in agent state representation. - Introduced helper functions to find the nearest objects and items, streamlining the observation computation process. - Detailed the structure of the observation vector, including player features, teammate features, and absolute position, ensuring comprehensive agent information for gameplay. - Removed outdated comments and improved documentation for better understanding of the observation components.
- Updated the observation vector size from 96 to 76 dimensions, reflecting a more accurate representation of agent states. - Adjusted distance calculations to ensure proper type handling and consistency across functions. - Enhanced teammate feature extraction, including proximity to various objects and pot states, improving the overall observation detail. - Updated comments for clarity on the structure and purpose of the observation components, ensuring better understanding for future development.
…ed environment. Fix for displaying UserStats in CLI and logs. - Added initialization of the episode counter in the reset function to track the number of episodes accurately. - Updated performance metrics at the end of each episode, including normalization of dishes served and scoring based on episode returns. - These changes enhance the logging capabilities for better performance analysis and gameplay tracking.
Contributor
|
do you mind describing your reward structure and rules ? maybe i can help |
…o one neuralnet not separate ones - therefore mirroring is redundant.
- Introduced a TODO comment regarding the handling of Tomatoes in the ingredient box. - Added a note to implement logging for each ingredient type to improve tracking of items picked by agents. - These changes aim to enhance the clarity and future extensibility of the ingredient management system.
…d function - Introduced a TODO comment suggesting the creation of a struct for easier modification of reward distribution among agents. - This change aims to improve the flexibility and maintainability of the reward system in the Overcooked environment.
…ed environment - Eliminated the DEBUG_OBSERVATIONS flag and associated print statements to clean up the code. - Added a TODO comment to indicate future implementation of tomatoes in the ingredient handling. - Updated comments for clarity regarding the current rules for dish evaluation. - These changes aim to enhance code clarity and prepare for future ingredient management improvements.
…observations at time of writing - Introduced a comprehensive README file detailing the Overcooked environment, including observation and action spaces, reward system, and recipe instructions. - This addition aims to provide clear documentation for users and developers, facilitating understanding and usage of the multi-agent cooking coordination environment.
Author
|
@Hadrien-Cr Hello! I have written a concise README describing the rewards and observations. https://github.com/mmbajo/PufferLib/tree/roze-overcooked-dev/pufferlib/ocean/overcooked |
…environment - Reduced the maximum number of ingredients from 5 to 3 to refine gameplay dynamics. - Adjusted the observation logic to check for exactly MAX_INGREDIENTS instead of 3 or more, enhancing the accuracy of pot state observations. - These changes aim to improve the clarity and functionality of the Overcooked environment.
- Replaced individual reward parameters with a structured RewardConfig to streamline reward management. - Updated initialization and handling of rewards for various actions, enhancing clarity and maintainability. - Adjusted relevant code sections to utilize the new reward structure, ensuring consistent reward distribution across agents.
- Removed BURNT state from cooking states to simplify cooking logic. - Adjusted related code sections to reflect the removal of BURNT, including cooking progress updates and rendering logic. - Updated README to reflect changes in cooking time and ingredient limits, ensuring consistency with the codebase.
- Moved the increment of dishes_served to the correct location in the evaluate_dish_served function to ensure accurate tracking of served dishes. - Updated performance calculation in c_step to normalize based on correct_dishes instead of dishes_served, improving reward accuracy for agents.
- Updated the observation logic to check for any non-EMPTY tile (including walls, stoves, counters, serving areas, ingredient boxes, and cutting boards) instead of just walls, stoves, and counters. This change improves the accuracy of wall detection for agents navigating the environment.
- Updated binding.c to include reward for ingredient picked. - Modified overcooked.h to define ingredient_picked in rewards_config. - Adjusted overcooked.py to accept reward_ingredient_picked parameter. - Enhanced interaction handling to account for ingredient picking reward.
- Increased number of environments to 4096 and agents to 2 in overcooked.ini. - Adjusted training parameters including total timesteps and learning rate. - Added new reward metrics for dish serving and ingredient interactions. - Removed unused max_steps parameter from binding.c and updated logging structure. - Enhanced agent behavior and observation handling in overcooked.c. - Updated rendering to display correct dish counts.
- Removed deprecated policy and RNN settings from overcooked.ini. - Simplified main function in overcooked.c, consolidating agent setup and environment initialization. - Updated reward metrics for dish serving and ingredient interactions. - Enhanced observation handling and rendering logic in the main loop.
Author
Screen.Recording.2025-12-27.at.9.53.13.movSorry for the wait! Training is working and now I have a working demo! Can someone from the team please review? |
- Introduced overcooked_types.h to define constants, enums, and struct definitions for the Overcooked environment. - Moved tile types, item types, cooking states, and agent states definitions from overcooked.h to the new header file. - Added struct definitions for RewardConfig, Log, Client, Agent, Item, CookingPot, and Overcooked. - Updated overcooked.h to include overcooked_types.h and removed redundant definitions.
- Introduced overcooked_items.h to manage item and cooking pot functionalities within the Overcooked environment. - Implemented functions for retrieving, adding, and removing items, as well as initializing cooking pots and updating their cooking states. - Updated overcooked.h to include the new overcooked_items.h header, removing redundant function declarations.
- Introduced overcooked_obs.h to encapsulate observation computation functions for agents in the Overcooked environment. - Implemented functions to compute proximity features, find the nearest empty counter, and generate a comprehensive observation vector for each agent. - Updated overcooked.h to include the new overcooked_obs.h header, removing redundant function definitions from the main file.
- Introduced overcooked_logic.h to encapsulate game logic functions for the Overcooked environment, including dish evaluation, grid parsing, and agent interactions. - Moved relevant function definitions from overcooked.h to the new header to improve code organization and maintainability. - Updated overcooked.h to include overcooked_logic.h, removing redundant function declarations.
- Introduced overcooked_render.h to encapsulate all rendering and texture management functions for the Overcooked environment. - Implemented functions for agent color determination based on held items and texture unloading. - Integrated rendering logic into the Overcooked environment, including window initialization, texture loading, and drawing operations for agents, items, and cooking states. - Updated overcooked.h to include the new overcooked_render.h header, enhancing code organization and maintainability.
- Added include guards to overcooked.h to prevent multiple inclusions and improve compilation efficiency. - Ensured proper structure and organization of the header file by maintaining a consistent format with other headers in the project.
… spaces - Added a new section detailing the file structure of the Overcooked environment. - Updated references in the observation space to point to the correct lines in overcooked_obs.h and overcooked_logic.h. - Adjusted the action space section to reflect changes in the corresponding header file. - Enhanced clarity and organization of the README to improve user understanding of the environment's structure and functionality.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR introduces a Overcooked cooking game environment for PufferLib. Sprites were from OvercookedAI