Moving `bob_dependency_graph.py` to `bob` driver

I use it sometimes.

assigned to @amohammadi and unassigned @mguenther

I made a simple script that maps the dependency graph using the conda API.

I would like to use this to parallelize our release procedure.

Check the code bellow.

#### Create a simple dependency graph using "conda search"

import conda.cli.python_api
import json
import numpy

packages_to_release = [       
        "bob.buildout",
        "bob.extension", "bob.blitz",
        "bob.core", "bob.io.base",
        "bob.math","bob.measure",
        "bob.io.image","bob.db.base","bob.io.video",
        "bob.io.matlab","bob.io.audio",
        "bob.sp","bob.ap","bob.ip.base",
        "bob.ip.color","bob.ip.draw",
        "bob.ip.gabor","bob.learn.activation"]


def get_dependencies(package_description, selected_packages=[]):
    """
    Given a dictionary containing the package description "conda search xx --info" get a selected set of 
    dependencies
    """

    # Fetching the dependencies of the most updated package
    all_dependencies = [p.split(" ")[0] for p in package_description[-1]["depends"]]
    
    # Filtering the dependencies
    return [d for d in selected_packages if d in all_dependencies]


#TODO: We can use some python libraries to handle graphs, but I
# have more fun doing like this
N = len(packages_to_release)
adjacency_matrix = numpy.zeros(shape=(N, N))

### Building the graph
for i,p in enumerate(packages_to_release):

    package_description = json.loads(conda.cli.python_api.run_command(conda.cli.python_api.Commands.SEARCH, p, "--info", "-c", "http://idiap.ch/software/bob/conda/label/beta/", "--json")[0])
    
    # Getting the "releasable" dependencies
    dependencies = get_dependencies(package_description[p], selected_packages=packages_to_release)

    # Handling the adjacency matrix
    indexes = [packages_to_release.index(d) for d in dependencies]
    for j in indexes:
        adjacency_matrix[i,j] = 1

print(adjacency_matrix)

This prints the nice adjacency matrix bellow.

[[0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 1. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 1. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 0. 0. 1. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 1. 1. 1. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 1. 1. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 1. 0. 0. 1. 0. 0. 1. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 1. 1. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 1. 1. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 1. 1. 0. 0. 0. 0. 0. 1. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 1. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 1. 0. 0. 0. 0. 0. 0. 0. 0. 1. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 1. 1. 1. 0. 0. 0. 0. 0. 0. 1. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 1. 1. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 1. 1. 0. 0. 0. 0. 0. 0. 0. 1. 0. 0. 0. 0. 0. 0.]
 [0. 1. 1. 1. 1. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.]]

mentioned in issue bob.devtools#43

Implemented here bob.devtools!126 (merged)

mentioned in merge request !106 (merged)

closed via merge request !106 (merged)

mentioned in commit 0425e8da

mentioned in issue bob#259 (closed)

Moving `bob_dependency_graph.py` to `bob` driver

Designs

Child items ...

Activity