Preserve new sortable DIV so when filter is removed it remains the same

[half-metal]

Using sortable with data-id, if you move a div from a source table to a target table, and that source table had a filter on for the various rows, then if you remove that filter then the target table with the moved div will revert back to the div that was before the filter.

So imagine these rows in the source and target tables

Target Table 1
Red
Gold
Blue

Source Table 2
Yellow
Purple
Green

I put in a filter for "Gr" on Source Table 2
Then only Green shows up on Source Table 2
Then I drag and drop that into Target Table 1, so now you have:

Target Table 1
Red
Gold
Blue 
Green

Source Table 2
n/a

Then I remove the filter Target Table 1 becomes

Target table 1
Red
Gold
Blue
Yellow

Not ideal as the div that was Green is now Yellow. I could do a DB save and reload each table, but that's not reactive in my mind doing extra DB calls and not great for mobile. Is there some way for Sortable to freeze a table or hold in place the DIV that has been added to the Target Table?