The present disclosure provides a method and a system for processing queries with query filter on a server. The method includes receiving a query to be executed. The method analyses the received query and query filter. The method includes performing a search across metadata of Resilient Distributed Datasets (RDDs) associated with one or more files to identify whether the query filter is within a threshold of a given RDD. The method further identifies at least one RDD satisfying the query filter based on the search. Finally, the method includes executing the query to read the content from one or more files associated with the identified at least one RDD.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.