Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how works cache or persist with Spark Operator #2026

Open
masalinas opened this issue May 12, 2024 · 0 comments
Open

how works cache or persist with Spark Operator #2026

masalinas opened this issue May 12, 2024 · 0 comments
Labels
question Further information is requested

Comments

@masalinas
Copy link

masalinas commented May 12, 2024

Please describe your question here

I'm using spark operator in minikube + minio to send some SQL distributed queries over CSV 2.4GB files with 8883 lines with 20000 columns each one and recovering 8883 samples with only two columns.

I would like cache or persist this queries. my question is, If the runners and driver are delete after fisnish, how can I cache or persist this queries from operator?

@masalinas masalinas added the question Further information is requested label May 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

1 participant