Skip to content

Commit

Permalink
deploy: e7c0326
Browse files Browse the repository at this point in the history
  • Loading branch information
DmitryLitvintsev committed Nov 8, 2023
0 parents commit 215f19f
Show file tree
Hide file tree
Showing 59 changed files with 6,015 additions and 0 deletions.
4 changes: 4 additions & 0 deletions .buildinfo
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
config: 83836f4b32acb9583e0745f44c208d7b
tags: 645f666f9bcd5a90fca523b33c5a78b7
Binary file added .doctrees/cta_schema.doctree
Binary file not shown.
Binary file added .doctrees/enstore2cta_config.doctree
Binary file not shown.
Binary file added .doctrees/enstore2cta_script.doctree
Binary file not shown.
Binary file added .doctrees/enstore_schema.doctree
Binary file not shown.
Binary file added .doctrees/environment.pickle
Binary file not shown.
Binary file added .doctrees/index.doctree
Binary file not shown.
Empty file added .nojekyll
Empty file.
Binary file added _images/cta.relationships.real.compact.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added _images/enstoredb.relationships.real.compact.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
8 changes: 8 additions & 0 deletions _sources/cta_schema.rst.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
CTA Schema
==========

Here is CTA schema

.. image:: images/cta.relationships.real.compact.png

It also looks great.
7 changes: 7 additions & 0 deletions _sources/enstore2cta_config.rst.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@

Configuration
--------------

Script expects configuration file ``enstore2cta.yaml`` in the current directory or pointed to by environment variable ``MIGRATION_CONFIG``. The yaml file has to have "0600" permission bits and has to have the following parameters defned:

.. literalinclude:: ../etc/enstore2cta.yaml
55 changes: 55 additions & 0 deletions _sources/enstore2cta_script.rst.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,55 @@
enstore2cta - Enstore to CTA migration script
=============================================

Requirements
------------

Script works both with python2 and python3 and requires ``psycopg2`` module be installed (using ``pip`` or ``yum install python-psycopg2``).


Invocation
----------
To run the script a config file ``enstore2cta.yaml`` *must* exist in
the current directory or be pointed at by ``MIGRATION_CONFIG`` environment variable.
Look for example in ``enstore2cta/etc``. It must have "0600" permission (to protect database passwords if any).

::

$ python enstore2cta.py
usage: enstore2cta.py [-h] [--label LABEL] [--all] [--skip_locations] [--add]
[--storage_class STORAGE_CLASS] [--vo VO]
[--cpu_count CPU_COUNT]

This script converts Enstore metadata to CTA metadata. It looks for YAML
configuration file pointed to by MIGRATION_CONFIG environment variable or, if
it is not defined, it looks for file enstore2cta.yaml in current directory.
Script will quit if configuration YAML is not found.

optional arguments:
-h, --help show this help message and exit
--label LABEL comma separated list of labels (default: None)
--all do all labels (default: False)
--skip_locations skip filling chimera locations (good for testing)
(default: False)
--add add volume(s) to existing system, do not create vos,
pools, archive_routes etc. These need to pre-exist in
CTA db (default: False)
--storage_class STORAGE_CLASS
Add storage class corresponding to volume. Needed when
adding single volume to existing system using --add
option (default: None)
--vo VO vo corresponding to storage_class. Needed when adding
single volume to existing system using --add option
(default: None)
--cpu_count CPU_COUNT
override cpu count - number of simulateously processed
labels (default: 8)
single volume to existing system using --add option


(default cpu_count is equal to ``multiprocessing.cpu_count()``)

The script can work with individual label(s) passed as comma separated values to ``--label`` option. Or it can be invoked with ``--all`` switch to migrate all labels. The migration is done by label.

Additionally, on an existing CTA systenm one can use
``--add`` option to add a volume also specifying its ``--storage_class`` (e.g. "cms.foo") and ``--vo`` (e.g. "cms").
9 changes: 9 additions & 0 deletions _sources/enstore_schema.rst.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
Enstore Schema
==============

Here is Enstore DB schema that does not contain "unattached"
tables like `media_capacity`:

.. image:: images/enstoredb.relationships.real.compact.png

It looks great.
53 changes: 53 additions & 0 deletions _sources/index.rst.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,53 @@
Welcome to Enstore to CTA documentation
=======================================

enstore2cta script
==================

.. toctree::
:maxdepth: 1

enstore2cta_script.rst

Configuration
=============

.. toctree::
:maxdepth: 1

enstore2cta_config.rst


Enstore Schema
===============

.. toctree::
:maxdepth: 1

enstore_schema.rst


CTA Schema
===============

.. toctree::
:maxdepth: 1

cta_schema.rst


Source code
===========
.. toctree::
:maxdepth: 1

code/index
code/enstore2cta


Indices and tables
==================

* :ref:`genindex`
* :ref:`modindex`
* :ref:`search`
123 changes: 123 additions & 0 deletions _static/_sphinx_javascript_frameworks_compat.js
Original file line number Diff line number Diff line change
@@ -0,0 +1,123 @@
/* Compatability shim for jQuery and underscores.js.
*
* Copyright Sphinx contributors
* Released under the two clause BSD licence
*/

/**
* small helper function to urldecode strings
*
* See https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/decodeURIComponent#Decoding_query_parameters_from_a_URL
*/
jQuery.urldecode = function(x) {
if (!x) {
return x
}
return decodeURIComponent(x.replace(/\+/g, ' '));
};

/**
* small helper function to urlencode strings
*/
jQuery.urlencode = encodeURIComponent;

/**
* This function returns the parsed url parameters of the
* current request. Multiple values per key are supported,
* it will always return arrays of strings for the value parts.
*/
jQuery.getQueryParameters = function(s) {
if (typeof s === 'undefined')
s = document.location.search;
var parts = s.substr(s.indexOf('?') + 1).split('&');
var result = {};
for (var i = 0; i < parts.length; i++) {
var tmp = parts[i].split('=', 2);
var key = jQuery.urldecode(tmp[0]);
var value = jQuery.urldecode(tmp[1]);
if (key in result)
result[key].push(value);
else
result[key] = [value];
}
return result;
};

/**
* highlight a given string on a jquery object by wrapping it in
* span elements with the given class name.
*/
jQuery.fn.highlightText = function(text, className) {
function highlight(node, addItems) {
if (node.nodeType === 3) {
var val = node.nodeValue;
var pos = val.toLowerCase().indexOf(text);
if (pos >= 0 &&
!jQuery(node.parentNode).hasClass(className) &&
!jQuery(node.parentNode).hasClass("nohighlight")) {
var span;
var isInSVG = jQuery(node).closest("body, svg, foreignObject").is("svg");
if (isInSVG) {
span = document.createElementNS("http://www.w3.org/2000/svg", "tspan");
} else {
span = document.createElement("span");
span.className = className;
}
span.appendChild(document.createTextNode(val.substr(pos, text.length)));
node.parentNode.insertBefore(span, node.parentNode.insertBefore(
document.createTextNode(val.substr(pos + text.length)),
node.nextSibling));
node.nodeValue = val.substr(0, pos);
if (isInSVG) {
var rect = document.createElementNS("http://www.w3.org/2000/svg", "rect");
var bbox = node.parentElement.getBBox();
rect.x.baseVal.value = bbox.x;
rect.y.baseVal.value = bbox.y;
rect.width.baseVal.value = bbox.width;
rect.height.baseVal.value = bbox.height;
rect.setAttribute('class', className);
addItems.push({
"parent": node.parentNode,
"target": rect});
}
}
}
else if (!jQuery(node).is("button, select, textarea")) {
jQuery.each(node.childNodes, function() {
highlight(this, addItems);
});
}
}
var addItems = [];
var result = this.each(function() {
highlight(this, addItems);
});
for (var i = 0; i < addItems.length; ++i) {
jQuery(addItems[i].parent).before(addItems[i].target);
}
return result;
};

/*
* backward compatibility for jQuery.browser
* This will be supported until firefox bug is fixed.
*/
if (!jQuery.browser) {
jQuery.uaMatch = function(ua) {
ua = ua.toLowerCase();

var match = /(chrome)[ \/]([\w.]+)/.exec(ua) ||
/(webkit)[ \/]([\w.]+)/.exec(ua) ||
/(opera)(?:.*version|)[ \/]([\w.]+)/.exec(ua) ||
/(msie) ([\w.]+)/.exec(ua) ||
ua.indexOf("compatible") < 0 && /(mozilla)(?:.*? rv:([\w.]+)|)/.exec(ua) ||
[];

return {
browser: match[ 1 ] || "",
version: match[ 2 ] || "0"
};
};
jQuery.browser = {};
jQuery.browser[jQuery.uaMatch(navigator.userAgent).browser] = true;
}
Loading

0 comments on commit 215f19f

Please sign in to comment.