The following websites are references which show that the word "riff-raff" is used as an insult in the English language:
Only changes and comments from the current month and the previous three months are shown
All contributions to insult.wiki are considered to be
released into the public domain under the
CC0 1.0 Universal
Public Domain Dedication.
This means everybody may freely copy the information.