Package gaiasky.data.group
Class CsvCatalogDataProvider
java.lang.Object
gaiasky.data.group.AbstractStarGroupDataProvider
gaiasky.data.group.CsvCatalogDataProvider
- All Implemented Interfaces:
IParticleGroupDataProvider
,IStarGroupDataProvider
public class CsvCatalogDataProvider extends AbstractStarGroupDataProvider
Loads star catalogs in CSV format.
Source position and corresponding errors are in radians, parallax in mas and proper motion in mas/yr.
-
Nested Class Summary
Nested classes/interfaces inherited from class gaiasky.data.group.AbstractStarGroupDataProvider
AbstractStarGroupDataProvider.AdditionalCols, AbstractStarGroupDataProvider.ColId
-
Field Summary
Fields inherited from class gaiasky.data.group.AbstractStarGroupDataProvider
adaptiveParallax, additional, additionalFiles, colors, countsPerMag, distCap, fileNumberCap, indexMap, list, magCorrections, mustLoadIds, NEGATIVE_DIST, parallaxErrorFactorBright, parallaxErrorFactorFaint, parallaxZeroPoint, parallelism, ruwe, sphericalPositions, starNumberCap
-
Constructor Summary
Constructors Constructor Description CsvCatalogDataProvider()
-
Method Summary
Modifier and Type Method Description java.util.List<IParticleRecord>
loadData(java.io.InputStream is, double factor)
Loads the data applying a factor.java.util.List<IParticleRecord>
loadData(java.lang.String file)
Loads the data as it is.java.util.List<IParticleRecord>
loadData(java.lang.String file, double factor)
Loads the data applying a factor.java.util.List<IParticleRecord>
loadDataFh(java.lang.String file, double factor, int fileNumber, long totalFiles)
java.util.List<IParticleRecord>
loadDataMapped(java.lang.String file, double factor)
Loads the data applying a factor using a memory mapped file for improved speed.java.util.List<IParticleRecord>
loadDataMapped(java.lang.String file, double factor, int fileNumber, long totalFiles)
Uses memory mapped files to load catalog files.void
loadFileIs(java.io.InputStream is, double factor, java.util.concurrent.atomic.AtomicLong addedStars, java.util.concurrent.atomic.AtomicLong discardedStars)
void
setColumns(java.lang.String columns)
Set the CSV columns to work out the indices, as a comma-separated stringvoid
setColumns(java.lang.String... cols)
Set the CSV columns to work out the indices, as a comma-separated stringvoid
setDR2Columns()
Default columns for DR2void
setParallelBufferSize(int size)
Methods inherited from class gaiasky.data.group.AbstractStarGroupDataProvider
acceptDistance, acceptParallax, colIdFromStr, countLines, countLines, dumpToDisk, dumpToDiskBin, dumpToDiskCsv, getAdditionalValue, getColors, getCountsPerMag, getGeoDistance, getRuweValue, hasAdditional, hasAdditionalColumn, hasCol, idx, initLists, initLists, initLists, mustLoad, setAdaptiveParallax, setAdditionalFiles, setDistanceCap, setFileNumberCap, setMagCorrections, setMustLoadIds, setOutputFormatVersion, setParallaxErrorFactorBright, setParallaxErrorFactorFaint, setParallaxZeroPoint, setRUWECap, setStarNumberCap
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
Constructor Details
-
CsvCatalogDataProvider
public CsvCatalogDataProvider()
-
-
Method Details
-
setDR2Columns
public void setDR2Columns()Default columns for DR2 -
setColumns
public void setColumns(java.lang.String columns)Set the CSV columns to work out the indices, as a comma-separated string- Specified by:
setColumns
in interfaceIStarGroupDataProvider
- Overrides:
setColumns
in classAbstractStarGroupDataProvider
- Parameters:
columns
- Columns
-
setColumns
public void setColumns(java.lang.String... cols)Set the CSV columns to work out the indices, as a comma-separated string- Parameters:
cols
- The columns
-
loadData
Description copied from interface:IParticleGroupDataProvider
Loads the data as it is.- Specified by:
loadData
in interfaceIParticleGroupDataProvider
- Overrides:
loadData
in classAbstractStarGroupDataProvider
- Parameters:
file
- The file to load- Returns:
- Array of particle beans
-
loadData
Description copied from interface:IStarGroupDataProvider
Loads the data applying a factor.- Parameters:
file
- The file to loadfactor
- Factor to apply to the positions- Returns:
- Array of particle beans
-
loadData
Description copied from interface:IStarGroupDataProvider
Loads the data applying a factor.- Parameters:
is
- Input stream to load the data fromfactor
- Factor to apply to the positions- Returns:
- Array of particle beans
-
loadFileIs
public void loadFileIs(java.io.InputStream is, double factor, java.util.concurrent.atomic.AtomicLong addedStars, java.util.concurrent.atomic.AtomicLong discardedStars) -
loadDataMapped
Description copied from interface:IStarGroupDataProvider
Loads the data applying a factor using a memory mapped file for improved speed.- Parameters:
file
- The file to loadfactor
- Factor to apply to the positions- Returns:
- Array of particle beans
-
loadDataMapped
public java.util.List<IParticleRecord> loadDataMapped(java.lang.String file, double factor, int fileNumber, long totalFiles)Uses memory mapped files to load catalog files.- Parameters:
file
- The file to loadfactor
- Position factorfileNumber
- File numbertotalFiles
- Total number of files- Returns:
- List of particle records
-
loadDataFh
public java.util.List<IParticleRecord> loadDataFh(java.lang.String file, double factor, int fileNumber, long totalFiles) -
setParallelBufferSize
public void setParallelBufferSize(int size)
-