Redirected from page "DevNewsBriefs/2013_06_01"

Clear message
Locked History Actions

DevNewsBriefs/2013_06_03

All News Briefs


June 3, 2013 Galaxy Distribution News Brief


Get Galaxy

Please note new upgrade syntax

getgalaxy   

getgalaxy.org

galaxy-dist.readthedocs.org

bitbucket.org/galaxy/galaxy-dist

new:

$ hg clone https://bitbucket.org/galaxy/galaxy-dist#stable 

upgrade:

$ hg pull 
$ hg update release_2013.06.03 




Release Process

If you need a refresher about how to update or this is your first update in a while, please review the instructions at Get Galaxy. Even more details are in the prior News Brief.


Python 2.5 Support Has Ended

As of this release, Galaxy no longer supports Python 2.5. More in the ticket: http://trello.com/c/OQT8Iun8


Required metadata reset for installed tool shed repositories

It is critical that you reset the metadata on your installed tool shed repositories when you upgrade your Galaxy instance to this revision!

When a tool shed repository is installed into your local Galaxy instance, metadata is generated for the repository as a part of the installation process and stored in the tool_shed_repository.metadatatable column in the Galaxy database. This automatic process inspects the contents of the specific revision of the installed repository and generates and stores important information about it. This metadata information is used by certain Galaxy features. As new features are added to Galaxy or the tool shed, the process that generates this installed tool shed repository metadata within the Galaxy instance may be enhanced to accommodate information about the new features. Read more…


Tool Shed

Tool Shed

New Tool Shed Features

Resetting metadata on your repositories

There may be occasions when the entire changelog should be inspected and all of the metadata reset on it. You can reset all metadata on a repository that you are authorized to change by selecting the Reset all repository metadata option from the Repository Actions menu. Sometimes it may be necessary to reset metadata on multiple repositories. For example, if metadata is changed for a repository that is a dependency of another repository, it may be necessary to reset all metadata on each of the repositories in the dependency chain. Read more…

Tool Shed feature enhancements

  1. Supported tags sets for the tool_dependencies.xml file

    Several new tags and attributes are supported for tool dependency definitions. These tags and attributes are supported when installing repositories with tool dependencies in either a browser or using the enhanced Galaxy API. Read more…

  2. The bells and whistles of tool dependency definitions

    In some cases, a dependency definition author may want to write a definition whose dependency package (e.g., osra) can require a previously compiled binary (e.g., graphicsmagick) during compilation as well as tool execution time when the tool is using the compiled [osra] binary. This is possible using a combination of three tool dependency definition tag sets, which must be defined in the tool_dependencies.xml file in the order discussed here. Read more…

  3. Framework enhancements that process repository_dependencies.xml files Several enhancements have been made to the Tool Shed framework that processes repository dependency definitions contained in a repository_dependencies.xml file in a repository. Both of the previously required "toolshed" and "changeset_revision" attributes are now optional, and a new tag attribute is supported for ordering the installation of repository dependencies. This new attribute named "prior_installation_required", and if set to True in the repository dependency definition for a certain repository XYZ, then Galaxy's repository installation process will ensure that the required repository (XYZ's defined repository dependency) is installed prior to the installation of XYZ. These enhancements are supported when installing repositories with repository dependencies in either a browser or using the enhanced Galaxy API.

    Read more…

  4. The automated tool test framework

    The Tool Shed includes an extensive installation and test framework that works with repositories that contain valid tools. It is designed to be executed by cron regularly and sends email notification to a mail list when each run is completed. The framework is very flexible. It can be executed automatically or manually on a single repository revision or all revisions of all repositories in the tool shed. Read more…

  5. The Tool Shed API

    The RESTful Tool Shed API has been significantly enhanced. Read more…

  6. Tool Shed Functional Test Framework

    Many additional tests have been added to the tool shed functional test framework. Read more…

Miscellaneous Tool Shed fixes and enhancements

  1. Enhance the Repositories that contain tools with invalid functional tests grid to allow for sorting by repository owner. Enhance several of the repository review grids to enable sorting by repository owner.
  2. Clean up the main repositories by category grid and add a tools verified column.
  3. Raise exceptions when tool dependency definition <install> and <set_environment> tags define an unsupported version attribute.

  4. Add more granular lists of writable repositories for the current user: repositories with missing tool test components, repositories with failing tool tests and repositories with no failing tool tests.
  5. Move the My invalid tools menu item in the tool shed to a grid that filters to the latest metadata revision.

  6. The "Repository Actions" menu has been standardized so that the menu is virtually the same on all pages.
  7. Attempt to standardize the main page title for repository pages in the tool shed by displaying the repository name.
  8. Enable dynamic configuration of message box content and visibility in the wsgi .ini file. Display the configured brand, if any, in the <title> element.

  9. For tool dependencies whose installation ended in an error, still display them when attempting to uninstall them.
  10. Enhancements for the tool shed repository View changeset page: display the commit message, display both the ctx rev and the changeset hash in the title bar, and add Previous changeset and Next changeset buttons to allow for easier scrolling through the repository changelog.
  11. Fix for reinstalling an uninstalled repository when leaving the no changes checkbox checked and entering text into the new tool panel section field.
  12. Keep all contents (including comments) of dependency definition files when re-writing them to include missing toolshed and changeset_revision attributes.

  13. Eliminate the use of Galaxy's elementree egg within the tool shed.

Accepted Tool Shed pull requests

Support for Toolsheds with external auth enabled, pull request #155. Thanks to Roy Storey.

Tool Shed Tickets

https://trello.com/c/49vjZrJy

https://trello.com/c/zd0v8jHq

https://trello.com/c/20EykJrK

https://trello.com/c/G3MAzlEC

https://trello.com/c/9yERGRt8

https://trello.com/c/wNdXNOGU

https://trello.com/c/ezExflJd

https://trello.com/c/iICpByzT

https://trello.com/c/IXJjuXTm

https://trello.com/c/Djda4lD0

https://trello.com/c/hdV3C24u

https://trello.com/c/Qi7QRgdT

https://trello.com/c/45TRG5DY

https://trello.com/c/0Cljlxt3

https://trello.com/c/KQd4j3lz

https://trello.com/c/mqigrjfr

https://trello.com/c/QTeSmNSs

https://trello.com/c/O9YmzUT4

https://trello.com/c/71Bx8TcB

https://trello.com/c/2tkPpVkL

https://trello.com/c/0zvUBdJJ

https://trello.com/c/HTJWRo3Z

https://trello.com/c/AhNBPA8K

https://trello.com/c/hlYDzFQW

https://trello.com/c/hXNIbIMh

https://trello.com/c/ZDRQ6m3Y

https://trello.com/c/17HndRkh

https://trello.com/c/QY0Z7L7p

https://trello.com/c/ghUbjr8c

https://trello.com/c/iKiZytSf

https://trello.com/c/awKBxrGy

https://trello.com/c/noxRnGEv

https://trello.com/c/ondndIfd

https://trello.com/c/3TGyWggI

https://trello.com/c/zfQaURtr

https://trello.com/c/MxgHVnT9

https://trello.com/c/ZoslAcBD

https://trello.com/c/dL8dGPYf

https://trello.com/c/YRsP3wpS

https://trello.com/c/wJN65GdV

https://trello.com/c/wJN65GdV

https://trello.com/c/dcT7qOfc

https://trello.com/c/SMdJQ5zn


Tools

  1. GenomeSpace: Update serverurl.properties file location to work around issue with jumbo frames. https://trello.com/c/7tZli0PH

  2. MAF to BED corrected to fix problem with false error states. https://trello.com/c/y55KbTRt

  3. STDERR and STDOUT will now show beginning and end of contents, instead of just the beginning, when truncated. https://trello.com/c/v31ECJPr

  4. Fix displaying STDERR and STDOUT links in dataset info. https://trello.com/c/2ZTg6Tiq

  5. Auto Focus on first item on forms. https://trello.com/c/etlSFyEr

  6. Clarify tool tip FASTQ Summary Statistics. https://trello.com/c/LX0ma0uQ

  7. Resolve BSD/GNU grep version behavior differences. https://trello.com/c/dPUZ9zEA

  8. Filter and Sort: "Select" tool, improved handling of special characters. https://trello.com/c/cwrBpNP9

  9. Change file-merging to use copy.copyfileobj() rather than cat and mv. https://trello.com/c/Gaqoc6H8

  10. Data Manager: Fix for detecting job error in data manager tools; needed as a result of recent job flow changes. https://trello.com/c/EtXd4zqq


Scatterplot

  1. Enhancements to handlers, display, and data input parsing. https://trello.com/c/5jk3k7Td

scatterplot


Trackster

  1. Composite track improvements. https://trello.com/c/hPcrKfJl

  2. Insert a button for Trackster Visualization into data display viewer. https://trello.com/c/KGNfWZEH

  3. Add Bigwig support for BAM coverage. https://trello.com/c/GV7nTlg9

  4. VCF visualization in trackster. https://trello.com/c/1dj3lTtU


Histories & Datasets

  1. Delete Hidden Datasets menu option. https://trello.com/c/0SoREcMn

  2. When copying datasets to the current history always refresh history. https://trello.com/c/jY5HSdu1


Libraries

  1. Library API problem in galaxy-central default but not stable. https://trello.com/c/TbWP1tad


UI

  1. Unicode fixes for previewing large datasets. https://trello.com/c/BHRKkcaw

  2. Unicode fixes for uploading by file in upload tool. https://trello.com/c/O0M8W8X8

  3. Unicode fixes for displaying saved workflows in Tool Menu. https://trello.com/c/dAuDcE99

  4. Unicode fixes for form builder and toolparameters. https://trello.com/c/nVldKDiL

  5. Fix for TabularToolDataTable.get_column_name_list() when value column is overloaded by e.g. name. https://trello.com/c/6fPCLwn5

  6. Tool Parameter Validator: MetadataInDataTableColumnValidator fix issue where validator's list of valid options would become stale when e.g. a Data Manager was run. https://trello.com/c/dSEOinly


Admin

  1. Stop jobs on history deletion. https://trello.com/c/LBZxfcjx

  2. Track down decorator import failure that shows on some machines (see ticket). https://trello.com/c/It6q5Ul8

  3. Do not allow deleted datasets to be viewed / downloaded. https://trello.com/c/elIs7IHc

  4. Reports app: Fix util clash due to bad imports. https://trello.com/c/5d7EeeTq


Core

  1. Unify Web/API Transactions. https://trello.com/c/c5wZPVGd

  2. Eliminate PasteScript startup. https://trello.com/c/Q4bJNZuo

  3. Upgraded SQLAlchemy. https://trello.com/c/Q6kBeByD

  4. Error Logging with Sentry. https://trello.com/c/Yc1LXXTR

sentry-1

sentry-2


Pull Requests Merged

  1. Significantly enhance job resource definitions. https://trello.com/c/uNpYoYov

  2. More even distribution of job scheduling. https://trello.com/c/wBDXGcx2

  3. Workflows batch mode enhancements. #75. Thanks to John Chilton. https://trello.com/c/UoBadE0f

  4. Parallelism does work with from_work_dir attribute. #156. Thanks to John Chilton. https://trello.com/c/5fFZSCWn

  5. Galaxy Search Engine. #137. Thanks to Kyle Ellrott. https://trello.com/c/moZezGDP

  6. Validation on optional multi-select lists. #154. Thanks to John Chilton. https://trello.com/c/5PxgbL0b


Security Fixes

Although there are no specific known security fixes in this distribution, all Galaxy instance maintainers are strongly encouraged to run the latest release to take advantage of other improvements and fixes.


Bug Fixes

  1. Dataset display now honors preview flag. https://trello.com/c/p7zeJHlX

  2. Bug fix to report's web application. https://trello.com/c/o0S3klAF

  3. Correct display and masthead bugs upon logout/login cycle. https://trello.com/c/Dw0bUCv3, https://trello.com/c/cvzBIb63

  4. Fix problem where jobs were unable to run when job limits were set. https://trello.com/c/6vxkqdjT

  5. Fix Bug causing both upload_async_message and tool_executed.mako to refresh the history panel on upload. https://trello.com/c/8urL3hGW

  6. Fix Tophat2 Wrapper to properly quote read group attribute values. https://trello.com/c/nDBz5eoR

  7. Fix bug admin jobs 'AttributeError: 'NoopQueue' object has no attribute 'job_lock'. https://trello.com/c/uBlCbOFs

  8. ToolDataTables: Fix loading .loc files from locations other than galaxy's tool_data. https://trello.com/c/Xedp7bo5

  9. Fix API External Authentication. https://trello.com/c/UjBbWw4A

  10. Fix non-persistent workflow step hiding. https://trello.com/c/sVKvrw67

  11. Fix problem with search in workflow editor. https://trello.com/c/sAsC6lAK

  12. Fix to add confirm on delete permanently (footer button), saved histories. https://trello.com/c/8nUlUMew

  13. "Stop job" function in jobs admin interface corrected (as of April 2013 release). https://trello.com/c/3vkBCaWf


Project Updates

News, June 2013 Galaxy Update



GCC2013

2013 Galaxy Community Conference (GCC2013)









About

GalaxyProject.org

The Galaxy Team is a part of BX at Penn State, and the Biology and Mathematics and Computer Science departments at Emory University.

Galaxy is supported in part by NSF, NHGRI, the Huck Institutes of the Life Sciences, and The Institute for CyberScience at Penn State, and Emory University.

Join us at Twitter @galaxyproject or just read our tweets Galaxy on Twitter

Have a suggestion? Please see Using the Galaxy Issue Board.