Changelog

The following are the changes that have been implemented since the previous version. All versions are tagged as releases and available as a clone off of the master branch.

Version 0.1.4

Upgraded to Julia version 0.6. To upgrade to this version of DiskJockey, you will first need to upgrade your own Julia distribution to 0.6 as well. I apologize for the frequent upgrades of Julia, but since Julia is itself a fast-developing language, it makes the most sense to just bite the bullet and upgrade every time the programming language upgrades as well. Once Julia reaches v1.0 (sometime in 2018, perhaps), these changes should become less frequent.

After you install the new version of Julia, make sure that it actually loads as

$ julia
               _
   _       _ _(_)_     |  A fresh approach to technical computing
  (_)     | (_) (_)    |  Documentation: https://docs.julialang.org
   _ _   _| |_  __ _   |  Type "?help" for help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 0.6.1-pre.92 (2017-10-07 01:18 UTC)
 _/ |\__'_|_|_|\__'_|  |  Commit 389b23cf6e* (6 days old release-0.6)
|__/                   |  x86_64-pc-linux-gnu

julia>

And then you will need to reinstall DiskJockey in this new version, which should automatically pull down all of the other packages.

julia> Pkg.clone("https://github.com/iancze/DiskJockey.git")

If you no longer plan on using Julia v0.4 or v0.5 or any of the packages, I would recommend deleting it from your system so as not to cause any PATH conflicts. Speaking of which, don't forget to update your PATH to point to the new v0.6 version scripts.

Updated RADMC-3D

We're now running the latest version of RADMC-3D (0.41), which is automatically downloaded and installed with DiskJockey. Although not strictly required for running DiskJockey, it might help to familiarize yourself with the RADMC-3D manual, in particular the sections on input files and LTE line transfer.

Renaming

The script max_baseline.jl is now DJ_max_baseline.jl. plot_walkers.py is now DJ_plot_walkers.py.

DJ_plot_walkers.py

Now has proper labeling for models that fix parameters.

DJ_verify_run.jl

A new script for checking that you've specified everything properly before launching a MCMC run. This way you can avoid syntax errors in the config scripts after queuing for a cluster job.

Version 0.1.3

Fix parameters

Now there is a flexible way to fix or free parameters in a fit.

To do this requires new config files (which you may need to copy over from assets/) that include a params_fixed field, where you list the parameters to fix. Then, it may also require modifying the InitializeWalkers.ipynb notebooks to incorporate more or fewer parameters than are currently available.

Cavity model

Now supports a cavity model, with parameters for the size of the cavity (r_cav), as well as the steepness (gamma_cav).

Truncated model

Now includes a model that has a variable outer exponential taper, allowing it to be steeper or shallower than the traditional (2 - gamma).

Change to Sigma_c

Instead of fitting with the parameter total gas mass, we now fit with the surface density normalization at the critical radius, Sigma_c. Note that this only truly the normalization constant for the standard, truncated, and vertical models. The reason for the switch from M_gas to Sigma_c is that for more complicated models, there is no analytic formula for the total gas mass, meaning that a numerical integral would be needed for each model evaluation. It is simpler and more accurate to sample in Sigma_c and then later convert the samples to M_gas if desired.

FITS export

Thanks to Jane Huang (@j6626), you can now export a RADMC image to a FITS file via the script DJ_image_to_FITS.py. You can then inspect these FITS files with ds9, or use them in CASA simobserve.

spectrum.png

The plotting routine now outputs integrated line flux, to be used as a sanity check against the measured value from a dataset.

Half-pixel offset

Has now been added to the code. This is a result from that RADMC synthesizes an image centered on (0,0), while the FFT routine expects the image to be centered on the middle of the central pixel. The only change you should see is a small, half-pixel sized offset in mu_RA and mu_DEC.

Visualizing the tau=1 surface

This functionality originally provided in RADMC is now exposed via DiskJockey to visualize the tau = 1 (or other value) surface.

$ DJ_initialize.jl && tausurf_model.jl && plot_tausurf.jl

This also introduces the TausurfImage type in src/image.jl. This is useful to see whether the tau=1 surface is in front of or behind the midplane of the disk, projected on the sky.

It will be more useful to plot this in 3D, however. ParaView export is hopefully coming in a future version.

Vertical temperature gradient

We now include support for fitting a vertical temperature gradient, via the vertical model type. We follow the parameterization in Williams and Best 14.

model.convert_vector

This routine is to simplify to ingesting kwargs, enabling easier selection of model types and parameters.

User-defined priors

As an experimental feature, it is now possible to assign user defined priors. This will require you to write some Julia code, but shouldn't be that difficult. An example is in assets/prior.jl, which will be read automatically from the current working directory. The main idea is to make it easier to assign disk-specific priors (i.e., constrain the disk gas mass to a specific value, or disk position, etc...).

Makefiles

Now, we include a makefile that should be copied to each source directory. In a typical analysis workflow, there isn't need to regenerate each intermediate product repeatedly. Details are in the cookbook.

Script renaming

To prevent these scripts from cluttering a users namespace when adding to their PATH, we've prefixed most things with DJ_. Moreover, for most tasks, the users will not need to run these tasks directly, but will just use the Makefile.

model.Grid

Grid type initialization now relies upon a dictionary.

Version 0.1.2

The package is now named DiskJockey (previously JudithExcalibur). Check out the new logo!

Installation

The README now provides installation instructions for tagged releases. Rather than requiring the user to install it separately, RADMC-3D is now installed automatically as part of the installation process.

UVHDF5

Conversion from UVFITS and CASA measurement set was previously handled by scripts in this repository. However, this import and export capability has be standardized via the UVHDF5 package. Please see that package for any issues with import and export.

Travis integration

Now the builds are tested on travis-ci, which should hopefully increase stability for the development cycle.

EnsembleSampler

There is now an expand_walkers.py script, designed to add the dpc dimension to the sampling routine from an ensemble of walkers used on a posterior with distance fixed.

Now the ensemble sampler takes an optional function, to be called at the end of each loop as func(sampler, outdir)

function run_schedule(sampler::Sampler, pos0, N::Int, loops::Int, outdir, func::Function=nothing)

See the src/EnsembleSampler.jl file for more details. This is primarily in support of the next feature...

Plotly script

If you run the sampling script as

$ venus.jl --plotly

Then after the completion of each sampling loop, this will create a plotly walkers plot corresponding to the name entry in config.yaml. This allows easy monitoring of many different chains that might be running on a cluster.

DJInitialize.jl

(Previously JudithInitialize.jl). Now this initialization script can easily spit out an exclude array so that fewer channels can be fit during initial testing.

Cavity model

By initializing a directory with

$ DJInitialize.jl --new-project=cavity

you can start exploring the cavity model, which has an exponential taper inside of some radius, r_cav.

gridding.jl

gridding.jl now exports a corrfun(img::SkyImage) routine, in addition to corrfun!(img::SkyImage). This new function returns a corrected image as a copy, leaving the original image in the arguments unchanged. This is useful for plotting and debugging scripts so that you don't need to copy the image manually.

visibilities.jl

FullModelVis now has a - method, which can be used to subtract two sets of dense visibilities.

image.jl

Image now has a - method, which can be used to subtract two images.

config.yaml copied to output directory

Now venus.jl will move a copy of your config.yaml file to the output directory. This creates an automatic record of what parameters you ran with, which will undoubtedly be useful when reviewing previous runs sometime in the near future. Default values in the initial config.yaml files have also been updated.

plot_baselines.jl

Will generate a plot of where your dataset has sampled the UV plane. Also will print out an average velocity of the dataset, to allow a good starting guess for the vel parameter.

Version 0.1.1

Model specification

New implementation of models through parameter types in model.jl. Instead of separate model files for each new parameterization, which duplicated a lot of code and made things difficult to maintain, we are now collating all model types in model.jl by their parameters. We have created the AbstractParameters umbrella type, with subtypes ParametersStandard, ParametersTruncated, and ParametersCavity. Previous model specification routines like Sigma(r::Float64, pars::Parameters) (surface density) are now have overloaded methods for different models based upon these parameter types

Sigma(r::Float64, pars::ParametersStandard)
Sigma(r::Float64, pars::ParametersTruncated)
Sigma(r::Float64, pars::ParametersCavity)

And routines that are general to all models (e.g. velocity specification) are denoted by

velocity{T}(r::T, pars::AbstractParameters)

Note that model types cavity and truncated are still experimental and likely to change.

To go along with this change, I have updated the automatic generation of the config.yaml file to include new fields like model: standard. Within the config.yaml file, items in the parameters dictionary are now simply a single Float64 number, not an array of [starting, jump] like it was previously.

model.jl now handles the implementation of priors, that dispatch off of the parameter types. This greatly streamlines the function fprob in venus.jl.

One-off model synthesis and plotting

I've simplified synthesizing and plotting of models. What was previously plot_model.jl is now split into synthesize_model.jl and plot_chmaps.jl.

Added new plot_moments.jl script which plots the zeroth-moment image. Soon it will plot first moment as well.

MCMC Sampling

The specification of parameter types allowed me to greatly simplify the MCMC sampling code into a single script, venus.jl. I have moved previous sampling scripts to the attic/ directory.

Created InitializeWalkers.ipynb that is copied to new directory to help specify walker starting positions. The user edits this with a Jupyter/IPython notebook.

Cookbook

We now have a cookbook for AK Sco, check it out to get started!

plot_walkers.py now includes ability to determine highest density interval for quoting credible intervals and should automatically label the parameters after reading from config.yaml.

Version 0.1.0

Initial commit on the new versioning roadmap.