Uses of Class
org.apache.sysds.runtime.meta.DataCharacteristics
-
-
Uses of DataCharacteristics in org.apache.sysds.api.mlcontext
Constructors in org.apache.sysds.api.mlcontext with parameters of type DataCharacteristics Constructor Description FrameMetadata(DataCharacteristics dataCharacteristics)Constructor to create a FrameMetadata object based on a DataCharacteristics object.MatrixMetadata(DataCharacteristics dataCharacteristics)Constructor to create a MatrixMetadata object based on a DataCharacteristics object. -
Uses of DataCharacteristics in org.apache.sysds.hops
Methods in org.apache.sysds.hops that return DataCharacteristics Modifier and Type Method Description DataCharacteristics[]MemoTable. getAllInputStats(ArrayList<Hop> inputs)DataCharacteristicsMemoTable. getAllInputStats(Hop input)DataCharacteristicsHop. getDataCharacteristics()Methods in org.apache.sysds.hops with parameters of type DataCharacteristics Modifier and Type Method Description static booleanOptimizerUtils. checkSparkCollectMemoryBudget(DataCharacteristics dc, long memPinned)static booleanOptimizerUtils. checkSparkCollectMemoryBudget(DataCharacteristics dc, long memPinned, boolean checkBP)static booleanOptimizerUtils. checkSparseBlockCSRConversion(DataCharacteristics dcIn)static longOptimizerUtils. estimatePartitionedSizeExactSparsity(DataCharacteristics dc)Estimates the footprint (in bytes) for a partitioned in-memory representation of a matrix with the given matrix characteristicsstatic longOptimizerUtils. estimatePartitionedSizeExactSparsity(DataCharacteristics dc, boolean outputEmptyBlocks)static longOptimizerUtils. estimateSize(DataCharacteristics dc)static longOptimizerUtils. estimateSizeExactSparsity(DataCharacteristics dc)static doubleOptimizerUtils. getSparsity(DataCharacteristics dc)static booleanOptimizerUtils. isIndexingRangeBlockAligned(IndexRange ixrange, DataCharacteristics mc)Indicates if the given indexing range is block aligned, i.e., it does not require global aggregation of blocks.static booleanOptimizerUtils. isValidCPDimensions(DataCharacteristics mc)voidMemoTable. memoizeStatistics(long hopID, DataCharacteristics dc) -
Uses of DataCharacteristics in org.apache.sysds.hops.estim
Methods in org.apache.sysds.hops.estim that return DataCharacteristics Modifier and Type Method Description static DataCharacteristicsEstimatorMatrixHistogram.MatrixHistogram. deriveOutputCharacteristics(EstimatorMatrixHistogram.MatrixHistogram h1, EstimatorMatrixHistogram.MatrixHistogram h2, double spOut, SparsityEstimator.OpCode op, long[] misc)DataCharacteristicsEstimatorBasicAvg. estim(MMNode root)DataCharacteristicsEstimatorBasicWorst. estim(MMNode root)DataCharacteristicsEstimatorBitsetMM. estim(MMNode root)DataCharacteristicsEstimatorDensityMap. estim(MMNode root)DataCharacteristicsEstimatorLayeredGraph. estim(MMNode root)DataCharacteristicsEstimatorMatrixHistogram. estim(MMNode root)DataCharacteristicsEstimatorMatrixHistogram. estim(MMNode root, boolean topLevel)DataCharacteristicsEstimatorSample. estim(MMNode root)DataCharacteristicsEstimatorSampleRa. estim(MMNode root)abstract DataCharacteristicsSparsityEstimator. estim(MMNode root)Estimates the output sparsity of a DAG of matrix multiplications for the given operator graph of a single root node.DataCharacteristicsMMNode. getDataCharacteristics()DataCharacteristicsMMNode. setDataCharacteristics(DataCharacteristics mc)Methods in org.apache.sysds.hops.estim with parameters of type DataCharacteristics Modifier and Type Method Description DataCharacteristicsMMNode. setDataCharacteristics(DataCharacteristics mc) -
Uses of DataCharacteristics in org.apache.sysds.hops.recompile
Methods in org.apache.sysds.hops.recompile that return types with arguments of type DataCharacteristics Modifier and Type Method Description HashMap<String,DataCharacteristics>RecompileStatus. getTWriteStats()Methods in org.apache.sysds.hops.recompile with parameters of type DataCharacteristics Modifier and Type Method Description static booleanRecompiler. checkCPCheckpoint(DataCharacteristics dc) -
Uses of DataCharacteristics in org.apache.sysds.hops.rewrite
Methods in org.apache.sysds.hops.rewrite with parameters of type DataCharacteristics Modifier and Type Method Description static longHopRewriteUtils. getMaxInputDim(DataCharacteristics[] dc, boolean dim1)static longHopRewriteUtils. getSumValidInputDims(DataCharacteristics[] mc, boolean dim1)static longHopRewriteUtils. getSumValidInputNnz(DataCharacteristics[] mc, boolean worstcase)static booleanHopRewriteUtils. hasValidInputDims(DataCharacteristics[] mc, boolean dim1)static booleanHopRewriteUtils. hasValidInputNnz(DataCharacteristics[] mc, boolean worstcase) -
Uses of DataCharacteristics in org.apache.sysds.lops
Methods in org.apache.sysds.lops with parameters of type DataCharacteristics Modifier and Type Method Description voidOutputParameters. setDimensions(DataCharacteristics dc) -
Uses of DataCharacteristics in org.apache.sysds.runtime.controlprogram
Methods in org.apache.sysds.runtime.controlprogram with parameters of type DataCharacteristics Modifier and Type Method Description longParForProgramBlock.PartitionFormat. getNumColumns(DataCharacteristics mc)longParForProgramBlock.PartitionFormat. getNumParts(DataCharacteristics mc)longParForProgramBlock.PartitionFormat. getNumRows(DataCharacteristics mc) -
Uses of DataCharacteristics in org.apache.sysds.runtime.controlprogram.caching
Methods in org.apache.sysds.runtime.controlprogram.caching that return DataCharacteristics Modifier and Type Method Description DataCharacteristicsCacheableData. getDataCharacteristics()DataCharacteristicsCacheBlock. getDataCharacteristics()Methods in org.apache.sysds.runtime.controlprogram.caching with parameters of type DataCharacteristics Modifier and Type Method Description voidMatrixObject. updateDataCharacteristics(DataCharacteristics dc) -
Uses of DataCharacteristics in org.apache.sysds.runtime.controlprogram.context
Methods in org.apache.sysds.runtime.controlprogram.context that return DataCharacteristics Modifier and Type Method Description DataCharacteristicsExecutionContext. getDataCharacteristics(String varname)Methods in org.apache.sysds.runtime.controlprogram.context with parameters of type DataCharacteristics Modifier and Type Method Description static FrameObjectExecutionContext. createFrameObject(DataCharacteristics dc)static MatrixObjectExecutionContext. createMatrixObject(DataCharacteristics dc)static TensorBlockSparkExecutionContext. toTensorBlock(org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock> rdd, DataCharacteristics dc) -
Uses of DataCharacteristics in org.apache.sysds.runtime.controlprogram.federated
Methods in org.apache.sysds.runtime.controlprogram.federated that return DataCharacteristics Modifier and Type Method Description DataCharacteristicsMatrixLineagePair. getDataCharacteristics() -
Uses of DataCharacteristics in org.apache.sysds.runtime.controlprogram.parfor
Constructors in org.apache.sysds.runtime.controlprogram.parfor with parameters of type DataCharacteristics Constructor Description DataPartitionerRemoteSparkMapper(DataCharacteristics mc, Types.FileFormat fmt, ParForProgramBlock.PDataPartitionFormat dpf, int n)RemoteDPParForSparkWorker(String program, boolean isLocal, HashMap<String,byte[]> clsMap, String inputVar, String iterVar, boolean cpCaching, DataCharacteristics mc, boolean tSparseCol, ParForProgramBlock.PartitionFormat dpf, Types.FileFormat fmt, org.apache.spark.util.LongAccumulator atasks, org.apache.spark.util.LongAccumulator aiters) -
Uses of DataCharacteristics in org.apache.sysds.runtime.data
Methods in org.apache.sysds.runtime.data that return DataCharacteristics Modifier and Type Method Description DataCharacteristicsTensorBlock. getDataCharacteristics()Methods in org.apache.sysds.runtime.data with parameters of type DataCharacteristics Modifier and Type Method Description static List<IndexedTensorBlock>LibTensorReorg. reshape(IndexedTensorBlock in, DataCharacteristics mcIn, DataCharacteristics mcOut, boolean rowwise, boolean outputEmptyBlocks)MR/SPARK reshape interface - for reshape we cannot view blocks independently, and hence, there are different CP and MR interfaces. -
Uses of DataCharacteristics in org.apache.sysds.runtime.functionobjects
-
Uses of DataCharacteristics in org.apache.sysds.runtime.instructions.cp
Methods in org.apache.sysds.runtime.instructions.cp that return DataCharacteristics Modifier and Type Method Description DataCharacteristicsEncrypted. getDataCharacteristics()Methods in org.apache.sysds.runtime.instructions.cp with parameters of type DataCharacteristics Modifier and Type Method Description static InstructionVariableCPInstruction. prepCreatevarInstruction(String varName, String fileName, boolean fNameOverride, Types.DataType dt, String format, DataCharacteristics mc, MatrixObject.UpdateType update)static InstructionVariableCPInstruction. prepCreatevarInstruction(String varName, String fileName, boolean fNameOverride, Types.DataType dt, String format, DataCharacteristics mc, MatrixObject.UpdateType update, boolean hasHeader, String delim, boolean sparse)voidData. updateDataCharacteristics(DataCharacteristics mc)Constructors in org.apache.sysds.runtime.instructions.cp with parameters of type DataCharacteristics Constructor Description CiphertextMatrix(int[] dims, DataCharacteristics dc, byte[] data)Encrypted(int[] dims, DataCharacteristics dc, byte[] data, Types.DataType dt)PlaintextMatrix(int[] dims, DataCharacteristics dc, byte[] data) -
Uses of DataCharacteristics in org.apache.sysds.runtime.instructions.spark
Methods in org.apache.sysds.runtime.instructions.spark with parameters of type DataCharacteristics Modifier and Type Method Description static MatrixBlockMatrixIndexingSPInstruction. inmemoryIndexing(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in1, DataCharacteristics mcIn, DataCharacteristics mcOut, IndexRange ixrange)static booleanMatrixIndexingSPInstruction. isMultiBlockLookup(org.apache.spark.api.java.JavaPairRDD<?,?> in, DataCharacteristics mcIn, DataCharacteristics mcOut, IndexRange ixrange)Indicates if the given index range and input matrix exhibit the following properties: (1) existing hash partitioner, (2) out-of-core input matrix (larger than aggregated memory), (3) aligned indexing range (which does not required aggregation), and (4) the output fits twice in memory (in order to collect the result).static booleanMatrixIndexingSPInstruction. isSingleBlockLookup(DataCharacteristics mcIn, IndexRange ixrange)Indicates if the given index range only covers a single blocks of the inputs matrix.voidParameterizedBuiltinSPInstruction. setOutputCharacteristicsForGroupedAgg(DataCharacteristics mc1, DataCharacteristics mcOut, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixCell> out)Constructors in org.apache.sysds.runtime.instructions.spark with parameters of type DataCharacteristics Constructor Description MergeWithShiftedBlocks(DataCharacteristics mc1, DataCharacteristics mc2, boolean cbind)PadBlocksFunction(DataCharacteristics mcOut)ShiftMatrix(DataCharacteristics mc1, DataCharacteristics mc2, boolean cbind) -
Uses of DataCharacteristics in org.apache.sysds.runtime.instructions.spark.data
Methods in org.apache.sysds.runtime.instructions.spark.data that return DataCharacteristics Modifier and Type Method Description DataCharacteristicsPartitionedBroadcast. getDataCharacteristics()Constructors in org.apache.sysds.runtime.instructions.spark.data with parameters of type DataCharacteristics Constructor Description BlockPartitioner(DataCharacteristics mc, int numParts)PartitionedBroadcast(org.apache.spark.broadcast.Broadcast<PartitionedBlock<T>>[] broadcasts, DataCharacteristics dc) -
Uses of DataCharacteristics in org.apache.sysds.runtime.instructions.spark.functions
Constructors in org.apache.sysds.runtime.instructions.spark.functions with parameters of type DataCharacteristics Constructor Description ExtractBlockForBinaryReblock(DataCharacteristics mcIn, DataCharacteristics mcOut)IsBlockInList(long[] cols, DataCharacteristics mc)IsBlockInRange(long rl, long ru, long cl, long cu, DataCharacteristics mc)IsFrameBlockInRange(long rl, long ru, DataCharacteristics mcOut) -
Uses of DataCharacteristics in org.apache.sysds.runtime.instructions.spark.utils
Methods in org.apache.sysds.runtime.instructions.spark.utils that return DataCharacteristics Modifier and Type Method Description static DataCharacteristicsSparkUtils. computeDataCharacteristics(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixCell> input)Utility to compute dimensions and non-zeros in a given RDD of binary cells.Methods in org.apache.sysds.runtime.instructions.spark.utils with parameters of type DataCharacteristics Modifier and Type Method Description static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. binaryBlockToBinaryBlock(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, DataCharacteristics mcIn, DataCharacteristics mcOut)static org.apache.spark.api.java.JavaRDD<String>FrameRDDConverterUtils. binaryBlockToCsv(org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> in, DataCharacteristics mcIn, FileFormatPropertiesCSV props, boolean strict)static org.apache.spark.api.java.JavaRDD<String>RDDConverterUtils. binaryBlockToCsv(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, DataCharacteristics mcIn, FileFormatPropertiesCSV props, boolean strict)static org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>FrameRDDConverterUtils. binaryBlockToDataFrame(org.apache.spark.sql.SparkSession sparkSession, org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> in, DataCharacteristics mc, Types.ValueType[] schema)static org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>FrameRDDConverterUtils. binaryBlockToDataFrame(org.apache.spark.sql.SQLContext sqlContext, org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> in, DataCharacteristics mc, Types.ValueType[] schema)Deprecated.static org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>RDDConverterUtils. binaryBlockToDataFrame(org.apache.spark.sql.SparkSession sparkSession, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, DataCharacteristics mc, boolean toVector)static org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>RDDConverterUtils. binaryBlockToDataFrame(org.apache.spark.sql.SQLContext sqlContext, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, DataCharacteristics mc, boolean toVector)Deprecated.static org.apache.spark.api.java.JavaRDD<String>RDDConverterUtils. binaryBlockToLibsvm(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, DataCharacteristics mcIn, FileFormatPropertiesLIBSVM props, boolean strict)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>FrameRDDConverterUtils. binaryBlockToMatrixBlock(org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> input, DataCharacteristics mcIn, DataCharacteristics mcOut)static org.apache.spark.api.java.JavaRDD<String>FrameRDDConverterUtils. binaryBlockToTextCell(org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> input, DataCharacteristics mcIn)static org.apache.spark.api.java.JavaRDD<String>RDDConverterUtils. binaryBlockToTextCell(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, DataCharacteristics mc)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. binaryCellToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixCell> input, DataCharacteristics mcOut, boolean outputEmptyBlocks)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtilsExt. coordinateMatrixToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.mllib.linalg.distributed.CoordinateMatrix input, DataCharacteristics mcIn, boolean outputEmptyBlocks)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtilsExt. coordinateMatrixToBinaryBlock(org.apache.spark.SparkContext sc, org.apache.spark.mllib.linalg.distributed.CoordinateMatrix input, DataCharacteristics mcIn, boolean outputEmptyBlocks)static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock>FrameRDDConverterUtils. csvToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> input, DataCharacteristics mc, Types.ValueType[] schema, boolean hasHeader, String delim, boolean fill, double fillValue, Set<String> naStrings)static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock>FrameRDDConverterUtils. csvToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaRDD<String> input, DataCharacteristics mcOut, Types.ValueType[] schema, boolean hasHeader, String delim, boolean fill, double fillValue, Set<String> naStrings)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. csvToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> input, DataCharacteristics mc, boolean hasHeader, String delim, boolean fill, double fillValue, Set<String> naStrings)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. csvToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaRDD<String> input, DataCharacteristics mcOut, boolean hasHeader, String delim, boolean fill, double fillValue, Set<String> naStrings)static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock>FrameRDDConverterUtils. dataFrameToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> df, DataCharacteristics mc, boolean containsID)static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock>FrameRDDConverterUtils. dataFrameToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> df, DataCharacteristics mc, boolean containsID, Pair<String[],Types.ValueType[]> out)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. dataFrameToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> df, DataCharacteristics mc, boolean containsID, boolean isVector)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>SparkUtils. getEmptyBlockRDD(org.apache.spark.api.java.JavaSparkContext sc, DataCharacteristics mc)Creates an RDD of empty blocks according to the given matrix characteristics.static intSparkUtils. getNumPreferredPartitions(DataCharacteristics dc)static intSparkUtils. getNumPreferredPartitions(DataCharacteristics dc, boolean outputEmptyBlocks)static intSparkUtils. getNumPreferredPartitions(DataCharacteristics dc, org.apache.spark.api.java.JavaPairRDD<?,?> in)static voidRDDConverterUtils. libsvmToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, String pathIn, String pathX, String pathY, DataCharacteristics mcOutX)Converts a libsvm text input file into two binary block matrices for features and labels, and saves these to the specified output files.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. libsvmToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> input, DataCharacteristics mc, String delim, String indexDelim)static org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,FrameBlock>FrameRDDConverterUtils. matrixBlockToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> input, DataCharacteristics mcIn)static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock>FrameRDDConverterUtils. matrixBlockToBinaryBlockLongIndex(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> input, DataCharacteristics dcIn)static voidSparkUtils. postprocessUltraSparseOutput(MatrixObject mo, DataCharacteristics mcOut)static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock>FrameRDDConverterUtils. textCellToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> in, DataCharacteristics mcOut, Types.ValueType[] schema)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. textCellToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> input, DataCharacteristics mcOut, boolean outputEmptyBlocks, FileFormatPropertiesMM mmProps)static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock>FrameRDDConverterUtils. textCellToBinaryBlockLongIndex(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<Long,org.apache.hadoop.io.Text> input, DataCharacteristics mc, Types.ValueType[] schema)Constructors in org.apache.sysds.runtime.instructions.spark.utils with parameters of type DataCharacteristics Constructor Description BinaryCellToBinaryBlockFunction(DataCharacteristics mc) -
Uses of DataCharacteristics in org.apache.sysds.runtime.io
Methods in org.apache.sysds.runtime.io with parameters of type DataCharacteristics Modifier and Type Method Description static List<org.apache.commons.lang3.tuple.Pair<FederatedRange,FederatedData>>ReaderWriterFederated. read(String file, DataCharacteristics mc)Read a federated map from disk, It is not initialized before it is used in: org.apache.sysds.runtime.instructions.fed.InitFEDInstruction -
Uses of DataCharacteristics in org.apache.sysds.runtime.matrix.data
Methods in org.apache.sysds.runtime.matrix.data that return DataCharacteristics Modifier and Type Method Description DataCharacteristicsFrameBlock. getDataCharacteristics()DataCharacteristicsMatrixBlock. getDataCharacteristics()Methods in org.apache.sysds.runtime.matrix.data with parameters of type DataCharacteristics Modifier and Type Method Description static booleanMatrixBlock. evalSparseFormatInMemory(DataCharacteristics dc)static List<IndexedMatrixValue>LibMatrixReorg. reshape(IndexedMatrixValue in, DataCharacteristics mcIn, DataCharacteristics mcOut, boolean rowwise, boolean outputEmptyBlocks)MR/SPARK reshape interface - for reshape we cannot view blocks independently, and hence, there are different CP and MR interfaces. -
Uses of DataCharacteristics in org.apache.sysds.runtime.meta
Subclasses of DataCharacteristics in org.apache.sysds.runtime.meta Modifier and Type Class Description classMatrixCharacteristicsclassTensorCharacteristicsMethods in org.apache.sysds.runtime.meta that return DataCharacteristics Modifier and Type Method Description DataCharacteristicsMetaData. getDataCharacteristics()DataCharacteristicsMetaDataAll. getDataCharacteristics()DataCharacteristicsDataCharacteristics. set(long[] dims, int blocksize)DataCharacteristicsDataCharacteristics. set(long[] dims, int blocksize, long nnz)DataCharacteristicsDataCharacteristics. set(long nr, long nc, int blen)DataCharacteristicsDataCharacteristics. set(long nr, long nc, int blen, long nnz)DataCharacteristicsDataCharacteristics. set(DataCharacteristics that)DataCharacteristicsMatrixCharacteristics. set(long nr, long nc, int blen)DataCharacteristicsMatrixCharacteristics. set(long nr, long nc, int blen, long nnz)DataCharacteristicsMatrixCharacteristics. set(DataCharacteristics that)DataCharacteristicsTensorCharacteristics. set(long[] dims, int blocksize)DataCharacteristicsTensorCharacteristics. set(long[] dims, int blocksize, long nnz)DataCharacteristicsTensorCharacteristics. set(DataCharacteristics that)DataCharacteristicsDataCharacteristics. setBlocksize(int blen)DataCharacteristicsDataCharacteristics. setCols(long clen)DataCharacteristicsMatrixCharacteristics. setCols(long clen)DataCharacteristicsDataCharacteristics. setDim(int i, long dim)DataCharacteristicsTensorCharacteristics. setDim(int i, long dim)DataCharacteristicsDataCharacteristics. setDimension(long nr, long nc)DataCharacteristicsMatrixCharacteristics. setDimension(long nr, long nc)DataCharacteristicsDataCharacteristics. setDims(long[] dims)DataCharacteristicsTensorCharacteristics. setDims(long[] dims)DataCharacteristicsDataCharacteristics. setNoEmptyBlocks(boolean flag)DataCharacteristicsDataCharacteristics. setNonZeros(long nnz)DataCharacteristicsMatrixCharacteristics. setNonZeros(long nnz)DataCharacteristicsTensorCharacteristics. setNonZeros(long nnz)DataCharacteristicsDataCharacteristics. setNonZerosBound(long nnz)DataCharacteristicsMatrixCharacteristics. setNonZerosBound(long nnz)DataCharacteristicsDataCharacteristics. setRows(long rlen)DataCharacteristicsMatrixCharacteristics. setRows(long rlen)Methods in org.apache.sysds.runtime.meta with parameters of type DataCharacteristics Modifier and Type Method Description static voidDataCharacteristics. aggregateBinary(DataCharacteristics dim1, DataCharacteristics dim2, AggregateBinaryOperator op, DataCharacteristics dimOut)static voidDataCharacteristics. aggregateUnary(DataCharacteristics dim, AggregateUnaryOperator op, DataCharacteristics dimOut)static voidDataCharacteristics. reorg(DataCharacteristics dim, ReorgOperator op, DataCharacteristics dimOut)DataCharacteristicsDataCharacteristics. set(DataCharacteristics that)DataCharacteristicsMatrixCharacteristics. set(DataCharacteristics that)DataCharacteristicsTensorCharacteristics. set(DataCharacteristics that)static voidMetaDataUtils. updateAppendDataCharacteristics(DataCharacteristics mc1, DataCharacteristics mc2, DataCharacteristics mcOut, boolean cbind)Constructors in org.apache.sysds.runtime.meta with parameters of type DataCharacteristics Constructor Description MatrixCharacteristics(DataCharacteristics that)MetaData(DataCharacteristics dc)MetaDataFormat(DataCharacteristics dc, Types.FileFormat fmt)TensorCharacteristics(DataCharacteristics that) -
Uses of DataCharacteristics in org.apache.sysds.runtime.util
-