ModErn Text Analysis
META Enumerates Textual Applications
Classes | Namespaces | Typedefs | Functions
chunk_reader.h File Reference
#include <algorithm>
#include <fstream>
#include <memory>
#include <numeric>
#include <string>
#include "meta/config.h"
#include "meta/io/filesystem.h"
#include "meta/io/moveable_stream.h"
#include "meta/util/multiway_merge.h"
#include "meta/util/progress.h"

Go to the source code of this file.

Classes

class  meta::index::postings_record< PostingsData >
 Simple wrapper class to adapt PostingsData to the Record concept for multiway_merge. More...
 

Namespaces

 meta
 The ModErn Text Analysis toolkit is a suite of natural language processing, classification, information retrieval, data mining, and other applications of text processing.
 
 meta::index
 Indexes to create efficient representations of data.
 

Typedefs

template<class PostingsData >
using meta::index::chunk_reader = util::destructive_chunk_iterator< postings_record< PostingsData >>
 Represents an on-disk chunk to be merged with multi-way merge sort. More...
 

Functions

template<class PostingsData , class ForwardIterator >
uint64_t meta::index::multiway_merge (std::ostream &outstream, ForwardIterator begin, ForwardIterator end)
 Performs a multi-way merge sort of all of the provided chunks, writing to the provided output stream. More...
 

Detailed Description

Author
Chase Geigle

All files in META are dual-licensed under the MIT and NCSA licenses. For more details, consult the file LICENSE.mit and LICENSE.ncsa in the root of the project.