DataSet

• Accessing data in a DataSet
  • Preparation: a DataSet from a dummy Measurement
  • DataSet indentification
  • Parameters in the DataSet
    • Run description
    • Interdependencies
      • Dependencies, inferences, standalones
      • ParamSpecBase objects
      • Other useful methods and properties
    • Shortcuts to important parameters
    • Note on inferences
    • Note on ParamSpec’s
  • Getting data from DataSet
    • get_parameter_data - the powerhorse
      • Avoid excessive calls to loading data
      • Loading data of selected parameters
    • to_pandas_dataframe_dict and to_pandas_dataframe - for pandas fans
    • Exporting to other file formats
    • Data extraction into “other” formats
• Dataset Benchmarking
  • Setup
  • Baseline: Generate data
  • Add to dataset inside double loop
  • Add the data in outer loop and store as np array
  • Save once after loop
  • Array parameter
  • Insert many
• DataSet class walkthrough
  • Note on DataSet object creation
  • Preparation: a DataSet from a dummy Measurement
  • Note on immutability of DataSet
  • DataSet indentity
    • GUID
    • Captured run ID
      • Note on run ID
    • Experiment and sample names
    • DataSet name
    • Note on experiments
      • Note on counter
  • DataSet info
    • Database file
    • Timestamps
    • Snapshot
    • Parent dataset links
    • Note on DataSet states
    • Note on metadata
  • Parameters in DataSet
    • Interdependencies
    • Shortcuts to important parameters
    • Note on ParamSpec’s
  • Data access in DataSet
    • Not recommended data access methods
  • What about the rest?
• Databases
  • Imports
  • Initialization, creation and upgrade
• Using datasaver_builder and dond_into to streamline measurements
  • Setup
    • Main Module Imports
    • Other imports
    • Set up database and experiment
    • Dummy Parameter Creation
    • ParameterWithSetpoints Creation
  • Using the datasaver_builder
  • Using dond_into
  • Using datasaver_builder with dond_into and LinSweeper
  • Using datasaver_builder and dond_into with ParameterWithSetpoints
• DataSet Performance
  • Comparison between numeric/array data and binary blob
    • Case1: Short experiment time
    • Case2: Long experiment time
  • Loading the data
• Exporting QCoDes Datasets
  • Setup
  • Exporting data manually
  • Export data automatically
  • Automatically post process exported datasets.
  • Importing exported datasets into a new database
• Extracting runs from one DB file to another
  • Setup
  • Extraction
  • Merging data from 2 databases
  • Uniquely identifying and loading runs
• In memory dataset
  • Reloading data from db and exported file
• Linking to parent datasets
  • Example 1: Measuring and then fitting
    • Step 1: measure raw data
    • Step 2: Set up a fit “measurement”
• Measuring X as a function of time
  • Prepatory footwork: setup database and experiment
    • The measurement itself
• Offline Plotting Tutorial
  • A single, simple 1D sweep
    • Rescaling units and ticks
  • Two interleaved 1D sweeps
  • Regular 2D rectangular sweep scan
    • Customisations
      • Changing the colormap
      • Setting the colorscale to logarithmic
      • Setting limits on the colorscale
  • Warped 2D rectangular sweep scan
  • Interrupted 2D scans (a hole in the cheese)
  • Fancy plotting
  • Rasterizing
• Offline plotting with categorical data
  • 1D plotting
    • Category is the independent parameter
    • Category is the dependent parameter
  • Both variables are categorical
  • 2D plotting
    • Categorical data on the x-axis
    • Categorical data on the y-axis
    • Categorical data on the z-axis
      • Gridded setpoints
      • Scattered setpoints
    • Categorical data on x-axis and z-axis
• Offline plotting with complex data
  • Case A: a complex number as a function of a real number
  • Case B: a complex number as a function of two real numbers
  • Case C: a real number as a function of a complex number
• Paramtypes explained
  • Numeric
    • Numeric example 1
  • Array
    • Array example 1
    • Array example 2
    • Array example 3
  • Text
• Pedestrian example of subscribing to a DataSet
  • Call signature
  • Frequency
  • Order
    • Example 1: A notification
    • Example 2: ASCII Plotter
• Performing measurements using QCoDeS parameters and DataSet
  • Implementing a measurement
  • Accessing and exporting the measured data
  • Reloading datasets
    • DataSet GUID
  • Specifying shape of measurement
  • Performing several measuments concurrently
  • Interrupting measurements early
  • QCoDeS Array and MultiParameter
  • Avoiding verbosity of the Measurement context manager for simple measurements
  • Optimizing measurement time
  • The power of the Measurement context manager construct
    • Finer sampling in 2D
    • Simple adaptive 2D sweep
    • Random sampling
    • Optimiser
  • Subscriptions
    • Subscription example 1: simple printing
    • Subscription example 2: using the state
• Saving data in the background
  • Can I haz speedup?
  • Example Measurement
  • Data saving in the main thread
  • Saving in a background thread
  • Conclusion
• The Experiment Container
  • Required imports
  • The experiments inside the database
• Threaded data acquisition
  • Measurement 1: Non threaded data acquisition
  • Measurement 2: Threaded data acquisition
  • Non threaded and threaded data acquisition with do1d
    • Measurement 3: Non threaded data acquisition with do1d
    • Measurement 4: Threaded data acquisition with do1d
• Using doNd functions in comparison to Measurement context manager for performing measurements
  • Setup before measurement
  • 1D measurement
    • Measurement
    • do1d
  • 2D measurement
    • Measurement
    • do2d
  • Handling plot, experiment, and measurement_name with doNd
  • Generalized n-dimensional measurement (dond)
  • dond with multiple measurements (multiple datasets)
  • Sweep multiple parameters in parallel
  • Getting a value after setting it.
  • Actions in dond
• Using the register_name kwarg to select how a parameter is saved to a dataset
  • Setup
    • Module Imports
    • Database and Experiment creation
  • Creating a Parameter with a register_name
  • Why is this useful?
  • ParameterWithSetpoints
• Working with snapshots
  • Useful imports
    • What is a snapshot?
    • How to create a snapshot?
  • Snapshot example for Parameter object
  • Snapshot of an Instrument
  • Station and its snapshot
    • Saving snapshots next to the measurement data
    • Extracting snapshot from dataset
• Working with Pandas and XArray
  • Setup
  • Working with Pandas
  • Working with XArray
    • Working with XArray on non gridded data.
• Importing data from legacy .dat files
• Subscriber with JSON export
• Example Measurements with Real Instruments
  • Measurement 1: Frequency sweeps
  • Measurement 2: Triangle Traces
• Read data from cache
• Write data to cache