Skip to content

Key Concepts

Jobs

Jobs are the concrete set of operations to be executed. A job lists the operations to be executed, their order, whether they need to be executed sequentially or in parallel, and how input and output are passed around between them. Operations are executed as containers and offer similar ability to integrate with storage, networking, and resources like CPU and memory.

The job definition is a JSON specification that describes the container image, commands, and runtime requirements for each workload.

Deployments

Deployments are an orchestration layer on top of jobs. Through deployments, user can pick different strategies for how the underlying job lifecycles should be managed, for example, whether a job should run indefinitely is a possible strategy.

GPU Markets

GPU Markets represent pools of GPU resources where jobs are scheduled.

Hosts

Hosts are the individual GPU machines that actually run your jobs. Each host belongs to a specific GPU Market, and are matched onto suitable hosts in the selected market based on their resource requirements.

Access Methods

You can interact with Nosana through multiple methods:

  • Dashboard – Web-based interface at deploy.nosana.com for managing deployments visually
  • REST API – Direct HTTP API calls for programmatic access
  • TypeScript SDK – High-level client library (@nosana/kit) for seamless integration
  • CLI – Command-line interface for running inference jobs directly
  • Blockchain Programs – Direct interaction with Solana smart contracts for advanced use cases