

Advanced Pipeline

A list of changes more technical in nature.

Resources

• Copying of resources
  • Applied for projects (and eventually others)
  • generic copy operations for resource implemented at ao-lib
• Grouping of resources
  • Allow ability to create groups of resources
  • Group will be an array of object references of a specific resource with optional properties driven through config
    • ex. asset group for project with properties for distance to primary and rating
  • generic group operations for firebase implemented at ao-lib
  • Applied for Assets and Scenario Runs with user interface
• Bulk selection and options on resource list (i.e. batch delete)

Workspace

• Easily transfer files into and out of workspace
• Allow copy of workspace with files in workspace

Task system

• Improve integration python through library
• Improve development experience for task dev
  • Improved integration with workspaces
• Change schema to break file and events out of task definition
• Allow users to store events to use in task testing
• Public tasks to allow AO created task to be used by all teams (i.e. geoanalysis task)
• Promote task-dev to standard.
• Scaling on task queues

• Add queue for long running batch jobs

• View queue length by queue

• Admin queue length over time

Task Manager

• Store event in task run output
• Track task runs in presense system and counters
• Segment task system into own database shard

Scenario System

• Allow retry on step level in addition to current scenario retry system.
• User adjust queue rate limit

Columns

• Create columns through config files, pass through to web ui

Admin

• Company work
  • Create company
  • Add users
  • Add teams
• Team work
  • Create company

• Add user data

  • Transform to AO
  • Upload to firebase
  • Transfer to backend
  • Clear workspace cache

• Show message to logged in users. Remove message as needed.

  • Can be used to alert users of a slow down in a service