🐛 [BUG] - quality___language___fasttext_filter function is not utilizing the 'subset' column's text values for filtering #54
Description
Environment Settings
default setting
Expected Behavior
The quality___language___fasttext_filter function is not utilizing the 'subset' column's text values for filtering. Although a subset parameter exists in the function, it is not used throughout the logic of the function. However, the function still operates because the language_predict_fasttext function used within automatically targets the 'text' column for filtering. In dataverse testing, the 'text' column is used as the column containing the text. Additionally, there are concerns about potential name conflicts with user input data since the function internally generates columns named labels and scores.
Translate this into easy-to-understand, yet precise English.
Actual Behavior
written above
Reproduction
Simply run with the quality___language___fasttext_filter function without 'text' column.