Skip to content

Remove unused remove_duplicate_dicts helper #397

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
lalitheswar09-data wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Remove unused remove_duplicate_dicts helper #397

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 2 additions & 16 deletions concordia/utils/helper_functions.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -274,19 +274,7 @@ def print_pretty_prefabs(data_dict):
return '\n'.join(output_lines)


def remove_duplicate_dicts(
list_of_dicts: Sequence[dict[str, Any]],
) -> Sequence[dict[str, Any]]:
"""Removes duplicate dictionaries from a list of dictionaries."""
seen = set()
unique_dicts = []
for d in list_of_dicts:
# Convert the dictionary to a frozenset of its items, which is hashable
frozen_items = frozenset(d.items())
if frozen_items not in seen:
unique_dicts.append(d)
seen.add(frozen_items)
return unique_dicts



def _make_hashable(value: Any) -> Any:
Expand All @@ -307,9 +295,7 @@ def _make_hashable(value: Any) -> Any:
def remove_duplicate_values(values: Sequence[Any]) -> Sequence[Any]:
"""Removes duplicate values from a list, preserving first-seen order.

Unlike `remove_duplicate_dicts`, this works for any mix of dicts, lists and
scalar values.

This works for any mix of dicts, lists and scalar values.
Args:
values: the values to deduplicate.

Expand Down
Loading