ImageFileCollection

class ccdproc.ImageFileCollection(location=None, keywords=None, info_file=None, filenames=None)

Bases: object

Representation of a collection of image files.

The class offers a table summarizing values of keywords in the FITS headers of the files in the collection and offers convenient methods for iterating over the files in the collection. The generator methods use simple filtering syntax and can automate storage of any FITS files modified in the loop using the generator.

Parameters:

location : str or None, optional

Path to directory containing FITS files. Default is None.

keywords : list of str, ‘*’ or None, optional

Keywords that should be used as column headings in the summary table. If the value is or includes ‘*’ then all keywords that appear in any of the FITS headers of the files in the collection become table columns. Default value is ‘*’ unless info_file is specified. Default is None.

info_file : str or None, optional

Path to file that contains a table of information about FITS files. In this case the keywords are set to the names of the columns of the info_file unless keywords is explicitly set to a different list. Default is None.

filenames: str, list of str, or None, optional

List of the names of FITS files which will be added to the collection. The filenames are assumed to be in location. Default is None.

Raises:

ValueError

Raised if keywords are set to a combination of ‘*’ and any other value.

Attributes Summary

files	list of str, Unfiltered list of FITS files in location.
keywords	list of str, Keywords currently in the summary table.
location	str, Path name to directory containing FITS files.
summary	Table of values of FITS keywords for files in the
summary_info	Deprecated – use summary instead – Table of values of FITS keywords for files in the collection.

Methods Summary

ccds([ccd_kwargs])	Generator that yields each CCDData in the collection.
data([do_not_scale_image_data])	Generator that yields each image in the collection.
files_filtered(**kwd)	Determine files whose keywords have listed values.
hdus([do_not_scale_image_data])	Generator that yields each HDU in the collection.
headers([do_not_scale_image_data])	Generator that yields each header in the collection.
refresh()	Refresh the collection by re-reading headers.
sort([keys])	Sort the list of files to determine the order of iteration.
values(keyword[, unique])	List of values for a keyword.

Attributes Documentation

files

list of str, Unfiltered list of FITS files in location.

keywords

list of str, Keywords currently in the summary table.

Setting the keywords causes the summary table to be regenerated unless the new keywords are a subset of the old.

location

str, Path name to directory containing FITS files.

summary

Table of values of FITS keywords for files in the collection.

Each keyword is a column heading. In addition, there is a column called file that contains the name of the FITS file. The directory is not included as part of that name.

The first column is always named file.

The order of the remaining columns depends on how the summary was constructed.

If a wildcard, * was used then the order is the order in which the keywords appear in the FITS files from which the summary is constructed.

If an explicit list of keywords was supplied in setting up the collection then the order of the columns is the order of the keywords.

summary_info

Deprecated – use summary instead – Table of values of FITS keywords for files in the collection.

Each keyword is a column heading. In addition, there is a column called ‘file’ that contains the name of the FITS file. The directory is not included as part of that name.

Methods Documentation

ccds(ccd_kwargs=None, **kwd)

Generator that yields each CCDData in the collection.

If any of the parameters save_with_name, save_location or overwrite evaluates to True the generator will write a copy of each FITS file it is iterating over. In other words, if save_with_name and/or save_location is a string with non-zero length, and/or overwrite is True, a copy of each FITS file will be made.

Parameters:

save_with_name : str, optional

string added to end of file name (before extension) if FITS file should be saved after iteration. Unless save_location is set, files will be saved to location of the source files self.location. Default is ''.

save_location : str, optional

Directory in which to save FITS files; implies that FITS files will be saved. Note this provides an easy way to copy a directory of files–loop over the CCDData with save_location set. Default is ''.

overwrite : bool, optional

If True, overwrite input FITS files. Default is False.

clobber : bool, optional

Alias for overwrite. Default is False.

do_not_scale_image_data : bool, optional

If True, prevents fits from scaling images. Default is True. Default is True.

return_fname : bool, optional

If True, return the tuple (header, file_name) instead of just header. The file name returned is the name of the file only, not the full path to the file. Default is False.

ccd_kwargs : dict, optional

Dict with parameters for fits_ccddata_reader. For instance, the key 'unit' can be used to specify the unit of the data. If 'unit' is not given then 'adu' is used as the default unit. See fits_ccddata_reader for a complete list of parameters that can be passed through ccd_kwargs.

kwd :

Any additional keywords are used to filter the items returned; see Examples for details.

Returns:

ccdproc.CCDData

If return_fname is False, yield the next CCDData in the collection.

(ccdproc.CCDData, str)

If return_fname is True, yield a tuple of (CCDData, file name) for the next item in the collection.

data(do_not_scale_image_data=False, **kwd)

Generator that yields each image in the collection.

If any of the parameters save_with_name, save_location or overwrite evaluates to True the generator will write a copy of each FITS file it is iterating over. In other words, if save_with_name and/or save_location is a string with non-zero length, and/or overwrite is True, a copy of each FITS file will be made.

Parameters:

save_with_name : str, optional

string added to end of file name (before extension) if FITS file should be saved after iteration. Unless save_location is set, files will be saved to location of the source files self.location. Default is ''.

save_location : str, optional

Directory in which to save FITS files; implies that FITS files will be saved. Note this provides an easy way to copy a directory of files–loop over the image with save_location set. Default is ''.

overwrite : bool, optional

If True, overwrite input FITS files. Default is False.

clobber : bool, optional

Alias for overwrite. Default is False.

do_not_scale_image_data : bool, optional

If True, prevents fits from scaling images. Default is False. Default is True.

return_fname : bool, optional

If True, return the tuple (header, file_name) instead of just header. The file name returned is the name of the file only, not the full path to the file. Default is False.

ccd_kwargs : dict, optional

Dict with parameters for fits_ccddata_reader. For instance, the key 'unit' can be used to specify the unit of the data. If 'unit' is not given then 'adu' is used as the default unit. See fits_ccddata_reader for a complete list of parameters that can be passed through ccd_kwargs.

kwd :

Any additional keywords are used to filter the items returned; see Examples for details.

Returns:

numpy.ndarray

If return_fname is False, yield the next image in the collection.

(numpy.ndarray, str)

If return_fname is True, yield a tuple of (image, file name) for the next item in the collection.

files_filtered(**kwd)

Determine files whose keywords have listed values.

**kwd is list of keywords and values the files must have.

If the keyword include_path=True is set, the returned list contains not just the filename, but the full path to each file.

The value ‘*’ represents any value. A missing keyword is indicated by value ‘’.

Example:

>>> keys = ['imagetyp','filter']
>>> collection = ImageFileCollection('test/data', keywords=keys)
>>> collection.files_filtered(imagetyp='LIGHT', filter='R')
>>> collection.files_filtered(imagetyp='*', filter='')

NOTE: Value comparison is case insensitive for strings.

hdus(do_not_scale_image_data=False, **kwd)

Generator that yields each HDU in the collection.

If any of the parameters save_with_name, save_location or overwrite evaluates to True the generator will write a copy of each FITS file it is iterating over. In other words, if save_with_name and/or save_location is a string with non-zero length, and/or overwrite is True, a copy of each FITS file will be made.

Parameters:

save_with_name : str, optional

string added to end of file name (before extension) if FITS file should be saved after iteration. Unless save_location is set, files will be saved to location of the source files self.location. Default is ''.

save_location : str, optional

Directory in which to save FITS files; implies that FITS files will be saved. Note this provides an easy way to copy a directory of files–loop over the HDU with save_location set. Default is ''.

overwrite : bool, optional

If True, overwrite input FITS files. Default is False.

clobber : bool, optional

Alias for overwrite. Default is False.

do_not_scale_image_data : bool, optional

If True, prevents fits from scaling images. Default is False. Default is True.

return_fname : bool, optional

If True, return the tuple (header, file_name) instead of just header. The file name returned is the name of the file only, not the full path to the file. Default is False.

ccd_kwargs : dict, optional

Dict with parameters for fits_ccddata_reader. For instance, the key 'unit' can be used to specify the unit of the data. If 'unit' is not given then 'adu' is used as the default unit. See fits_ccddata_reader for a complete list of parameters that can be passed through ccd_kwargs.

kwd :

Any additional keywords are used to filter the items returned; see Examples for details.

Returns:

astropy.io.fits.HDU

If return_fname is False, yield the next HDU in the collection.

(astropy.io.fits.HDU, str)

If return_fname is True, yield a tuple of (HDU, file name) for the next item in the collection.

headers(do_not_scale_image_data=True, **kwd)

Generator that yields each header in the collection.

If any of the parameters save_with_name, save_location or overwrite evaluates to True the generator will write a copy of each FITS file it is iterating over. In other words, if save_with_name and/or save_location is a string with non-zero length, and/or overwrite is True, a copy of each FITS file will be made.

Parameters:

save_with_name : str, optional

string added to end of file name (before extension) if FITS file should be saved after iteration. Unless save_location is set, files will be saved to location of the source files self.location. Default is ''.

save_location : str, optional

Directory in which to save FITS files; implies that FITS files will be saved. Note this provides an easy way to copy a directory of files–loop over the header with save_location set. Default is ''.

overwrite : bool, optional

If True, overwrite input FITS files. Default is False.

clobber : bool, optional

Alias for overwrite. Default is False.

do_not_scale_image_data : bool, optional

If True, prevents fits from scaling images. Default is True. Default is True.

return_fname : bool, optional

If True, return the tuple (header, file_name) instead of just header. The file name returned is the name of the file only, not the full path to the file. Default is False.

ccd_kwargs : dict, optional

Dict with parameters for fits_ccddata_reader. For instance, the key 'unit' can be used to specify the unit of the data. If 'unit' is not given then 'adu' is used as the default unit. See fits_ccddata_reader for a complete list of parameters that can be passed through ccd_kwargs.

kwd :

Any additional keywords are used to filter the items returned; see Examples for details.

Returns:

astropy.io.fits.Header

If return_fname is False, yield the next header in the collection.

(astropy.io.fits.Header, str)

If return_fname is True, yield a tuple of (header, file name) for the next item in the collection.

refresh()

Refresh the collection by re-reading headers.

sort(keys=None)

Sort the list of files to determine the order of iteration.

Sort the table of files according to one or more keys. This does not create a new object, instead is sorts in place.

Parameters:

keys : str, list of str or None, optional

The key(s) to order the table by. Default is None.

values(keyword, unique=False)

List of values for a keyword.

Parameters:

keyword : str

Keyword (i.e. table column) for which values are desired.

unique : bool, optional

If True, return only the unique values for the keyword. Default is False.

Returns:

list

Values as a list.