Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

expanding drSubset output options #56

Open
amwhite opened this issue Feb 27, 2015 · 1 comment
Open

expanding drSubset output options #56

amwhite opened this issue Feb 27, 2015 · 1 comment

Comments

@amwhite
Copy link

amwhite commented Feb 27, 2015

Currently drSubset only allows the result to be returned in memory. It would be helpful if it had the option to save the result using and hdfsConn or localDiskConn (similar to the output parameter in functions such as drLapply, drSample, drFilter, etc).

@hafen
Copy link
Contributor

hafen commented Apr 9, 2015

Yes - I suppose the question is how to partition the results. The purpose of drSubset was to subset the data to a single data frame, in which case why not pull it into memory. If you want to subset the data and maintain the same subsetting, you can simply do it with drLapply. If you want a new partitioning you can do it with addTransform and divide. What do you think?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants