Skip to content

dask problem with fitting GMMMachine ...

Can you guys check this error? The original script can be found at /idiap/temp/prahimi/latentplay/gmm/gmm.py

Loading latent data ...
Done loading.
(50000, 9216)
Working on GMMMachine with number of mixture models set to : 10
Traceback (most recent call last):
  File "/somewhere/exps/latentplay/gmm/gmm.py", line 38, in <module>
    machine = machine.fit(latents) 
  File "/somewhere/mambaforge/envs/latentplay/lib/python3.10/site-packages/bob/learn/em/gmm.py", line 792, in fit
    self.initialize_gaussians(X)
  File "/somewhere/mambaforge/envs/latentplay/lib/python3.10/site-packages/bob/learn/em/gmm.py", line 731, in initialize_gaussians
    kmeans_machine = kmeans_machine.fit(data)
  File "/somewhere/mambaforge/envs/latentplay/lib/python3.10/site-packages/bob/learn/em/kmeans.py", line 328, in fit
    self.initialize(data=X)
  File "/somewhere/mambaforge/envs/latentplay/lib/python3.10/site-packages/bob/learn/em/kmeans.py", line 312, in initialize
    self.centroids_ = k_init(
  File "/somewhere/mambaforge/envs/latentplay/lib/python3.10/site-packages/dask_ml/cluster/k_means.py", line 365, in k_init
    return init_scalable(X, n_clusters, random_state, max_iter, oversampling_factor)
  File "/somewhere/mambaforge/envs/latentplay/lib/python3.10/site-packages/dask_ml/utils.py", line 550, in wraps
    results = f(*args, **kwargs)
  File "/somewhere/mambaforge/envs/latentplay/lib/python3.10/site-packages/dask_ml/cluster/k_means.py", line 423, in init_scalable
    (cost,) = compute(evaluate_cost(X, centers))
  File "/somewhere/mambaforge/envs/latentplay/lib/python3.10/site-packages/dask_ml/cluster/k_means.py", line 486, in evaluate_cost
    return (pairwise_distances(X, centers).min(1) ** 2).sum()
  File "/somewhere/mambaforge/envs/latentplay/lib/python3.10/site-packages/dask_ml/metrics/pairwise.py", line 59, in pairwise_distances
    return X.map_blocks(
  File "/somewhere/mambaforge/envs/latentplay/lib/python3.10/site-packages/dask/array/core.py", line 2676, in map_blocks
    return map_blocks(func, self, *args, **kwargs)
  File "/somewhere/mambaforge/envs/latentplay/lib/python3.10/site-packages/dask/array/core.py", line 873, in map_blocks
    out = blockwise(
  File "/somewhere/mambaforge/envs/latentplay/lib/python3.10/site-packages/dask/array/blockwise.py", line 269, in blockwise
    raise ValueError(
ValueError: Dimension 1 has 2 blocks, adjust_chunks specified with 1 blocks
Edited by Parsa Rahimi