Development News Brief

June 2, 2014

All News Briefs
Distribution Summary 2014_06_02


Get Galaxy

getgalaxy    getgalaxy.org
galaxy-dist.readthedocs.org
bitbucket.org/galaxy/galaxy-dist
new: $ hg clone https://bitbucket.org/galaxy/galaxy-dist#stable
upgrade: $ hg pull
$ hg update latest_2014.06.02

# Upgrades
# Upgrade Notice: latest_ tags

With this release comes the inclusion of new Mercurial tags designed to make the life of a Galaxy server administrator easier. The recommended tag to use for this release is now latest_2014.06.02. This tag will always point to the latest stable version of the 2014.06.02 release (we publish occasional bug fixes to stable releases). If you would like to ensure you always run a static release version with no additional changes since the release, you may use the traditional release_2014.06.02 tag (e.g. hg update release_2014.06.02). Both release_ and latest_ tags will be available for all releases going forward, and a latest_2014.04.14 tag was created for the latest stable version of the previous release.


# Upgrade Notice: "ucsc_build_sites.txt"

If you have made local modifications to the tool-data/shared/ucsc/ucsc_build_sites.txt file, you will need to exercise some caution when upgrading to this release (the easiest solution is to make a backup copy of the file prior to upgrading). See Pull Request #340 for more detailed instructions. There is also a related trello card.


# Dataset Collections

Dataset Collections (Technology Preview): Galaxy's data model, API, tool and workflow subsystems have been updated to incorporate the concept of dataset collections. Outlined in these 12 trello cards, dataset collections allow performing complex analyses over lists of dataset, paired datasets, lists of paired datasets, etc....

We are calling these a technology preview in this release because there is currently no rich user interface for creating or viewing dataset collections and there are a number of known issues. Check out this presentation, scheduled to given at this year's Galaxy Community Conference, for the most up to date information on dataset collections and example usages.

dataset collections
The workflow image above (created by Philip Mabon) demonstrates the usage of dataset collections in the context of the [Core Phylogenomics SNP](https://github.com/apetkau/core-phylogenomics) pipeline created by Aaron Petkau, Gary Van Domselaar, Philip Mabon, and Lee Katz.

# Pull Requests Merged

You will now find merged pull requested incorporated directly into the News Brief along side other changes. Thanks to our Galaxy community contributors!


# Galaxy Biostar

If you haven't claimed your account yet at Galaxy Biostar, now is a good time. This is the last reminder that the galaxy-user@bx.psu.edu mailing list will be retired Friday, June 6th. https://trello.com/c/0nQ5tHG7


# Data
  1. Data Manger:
  1. Reference Data:

# Tools
  1. Execution: Multi-dataset execution (a la workflows). https://trello.com/c/14OxiyMv
  2. Default value for data_column not working in tool XML. Peter Cock PR#389. https://trello.com/c/6ugfcLgI
  3. Provide mechanism to cleanly inject arbitrary environment variables from destinations (static and dynamic) into job script. PR#378. https://trello.com/c/t1FH1Q5P
  4. Enhancements for configuring tools that produce a variable number of outputs. PR#356. https://trello.com/c/3SNHcQlU
  5. Pull in a complete tool input parameters spec in JSON (e.g. recursion into Group parameters: Conditional and Repeat). https://trello.com/c/ydPxchL4
  6. Toolshed Tools: Display link to toolshed repository on form. https://trello.com/c/QRAP0eFj
  7. Changed selected_file to repo_file. Resolve NameError: global name 'selected_file' is not defined. Trevor Wennblom, PR#382. https://trello.com/c[/FhofbMxp](/archive/dev-news-briefs/2014-06-02/FhofbMxp/)

# Visualizations
  1. Trackster:
  1. External Display Applications:

# Workflows
  1. Workflow's with tool steps utilizing multiple input data params no longer break when edited (reported by Peter Cock). https://trello.com/c/9knsbvmx
  2. Corrected problematic backtrace when attempting to run workflow after upgrade. https://trello.com/c/zXkliR75
  3. Make workflow URLs pretty and establish conventions. https://trello.com/c/nvR6hktq
  4. Workflow editor now preserves conditionals (avoids a specific invalid state that previously broke connections). https://trello.com/c/4yWqzlRi

# UI
  1. Dataset provenance functionality improved for all user types. https://trello.com/c/ms6rtKmQ
  2. Improve public username handling at registration (including via API). https://trello.com/c/UAfb8SVX
  3. Improve History options -> Purge deleted datasets to update user disk usage. https://trello.com/c/bvOL9IBb
  4. Simplify localization of output and ensure acceptance of UTF-8 in history, dataset API, and client code. https://trello.com/c[/SxVszv0r](/archive/dev-news-briefs/2014-06-02/SxVszv0r/)
  5. Create a proper JS object to contain components (user, configuration, logger). https://trello.com/c/JXPol7vs
  6. Extending the UI library: new elements. https://trello.com/c/xYiHvOfl

# API
  1. API's authenticate/baseauth creation of API key. https://trello.com/c/zpK846FE
  2. Allow fetching input/output dataset association information through jobs API. https://trello.com/c/1ly1QN3a
  3. Include job id in dataset provenance API. https://trello.com/c/SH8mWi8J
  4. Expose use_remote_user via configuration API. https://trello.com/c/AGKePuHZ
  5. Update code checks and documentation after commit 17a2dc7. Nicola Soranzo, PR#383. https://trello.com/c[/Ms6E0enr](/archive/dev-news-briefs/2014-06-02/Ms6E0enr/)
  6. Fix for "'HistoryTagsController' object has no attribute 'security_check'". Nicola Soranzo, PR#394. https://trello.com/c/7iIv01zm

# Core
  1. Admin:
  1. Config:
  1. Jobs:

# Security
  1. Change to avoid potential privacy exploit during login. https://trello.com/c[/XlXwM866](/archive/dev-news-briefs/2014-06-02/XlXwM866/)
  2. Remove use of unencoded ids from history_common.mako, related controllers. https://trello.com/c/psDNnyRL

Fixes

  1. Fixed issue with 'bug report' submission using the Google Chrome web browser. https://trello.com/c/SX1WSchz
  2. Fixed library permissions API controller. https://trello.com/c/80EmYp19
  3. Fixed 'multiple input data parameters' in workflows. https://trello.com/c/0neRZzj9
  4. Fixed library permissions API controller. https://trello.com/c/80EmYp19
  5. Replaced loading indicator for Tabular View. https://trello.com/c/rP8xrqvH
  6. Fixed problem when uploading to a Library does not correctly generate external set_metadata command (auto-detect metadata also broken). https://trello.com/c/25XLSk0r https://trello.com/c/95t7B3EV
  7. Fixed the column alignment in the tabular format data. Jian-Long Huang, PR#366. https://trello.com/c/LXnPuIRR
  8. Fixed tag editing in Pages. https://trello.com/c/Yg7YGm6p
  9. Fixed 'multiple input parameters' causing repeated datasets in UI names. https://trello.com/c/LCEKxImR
  10. Fixed ToolShed installation using virtualenv that failed to automatically configure paths. https://trello.com/c/VFHrmuOS
  11. Fixed <conversion> tags within a DataToolParameter that no longer worked. https://trello.com/c/9diH0RFl
  12. Fixed grid templates that were inserting whole documents inside other documents. https://trello.com/c/iYloJMUF
  13. Fixed problem with primary dataset collection on cloned histories. https://trello.com/c/17McdFlx
  14. Fixed issue with Biostar "forgotten password" reset. https://trello.com/c/AX6zraeC
  15. Misc improvements: Remove unused methods, cleanup imports, fix old wiki links. Nicola Soranzo, PR#362. https://trello.com/c/5dE7l7YC

# Tool Shed

Tool Shed

Repositories

  1. Add assert file exists and directory exists actions to tool_dependencies.xml. https://trello.com/c/xBUhFvj0
  2. Making it easier to package tools using a local toolshed. https://trello.com/c/xtA7DsTz
  3. Display mercurial ctx revision number instead of hash string. https://trello.com/c/ldVAUyYL
  4. Reserved words $REPOSITORY_INSTALL_DIR and $INSTALL_DIR can now be used in certain tool actions such as 'move_file' and 'move_directory'. https://trello.com/c/XK5SqE1i

API

  1. Improve API error message when sent an incorrect user name. https://trello.com/c/bxZiluH3
  2. API installation of "Repository suite definition" no longer fails when there are multiple, different, owners. https://trello.com/c[/Bxe2E5Pp](/archive/dev-news-briefs/2014-06-02/Bxe2E5Pp/)
  3. Enhance the API to provide the current set of categories. https://trello.com/c/xaUy82rl

Test Framework

  1. Better handling of tool test results for tools missing tool test components on test tool shed. https://trello.com/c/rArkn49z
  2. Install and test framework Stage 2 now runs. https://trello.com/c/YElEsCWl

Tool Shed Fixes

  1. Fixed missing searchbar in Test Tool Shed via FireFox browser. https://trello.com/c/JgdgdgOH


Galaxy
**usegalaxy.org**

Project Updates

  1. News
  2. Events
  3. May 2014 Galaxy Update
  4. June 2014 Galaxy Update

# About

GalaxyProject.org

The Galaxy Team is a part of the Center for Comparative Genomics and Bioinformatics at Penn State, and the Department of Biology at Johns Hopkinis University.

Galaxy is supported in part by NSF, NHGRI, the Huck Institutes of the Life Sciences, and The Institute for CyberScience at Penn State, and Johns Hopkins University.

The public Main instance of Galaxy at http://usegalaxy.org utilizes infrastructure generously provided by the iPlant Collaborative at the Texas Advanced Computing Center, with support from the National Science Foundation.

Follow us on Twitter @galaxyproject or read our tweets at Galaxy on Twitter

Have a suggestion? Please see Using the Galaxy Issue Board, and be sure to up vote the issues important to YOU.