最完整的mac安装caffe

Dependencies :

[TIP : Though the official documentation suggests installing Anaconda, it would be better to avoid using the same. The following installation procedure assumes the absence of Anaconda]

OS X 10.10 :

• Install Homebrew Package Manager
  • Paste the following in a terminal prompt. The script explains what it will do and then pauses before it does it. This package manager would be of great use throughout the installation tasks.
  • ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"

• Get CUDA 7.0
  • Install CUDA 7.0 (for OSX) from here
  • Install latest standalone CUDA driver from here (apparently, one included in CUDA Toolkit is outdated)

• Install dependencies via homebrew
  • We will need to edit the OpenCV installation file a bit.
    • brew edit opencv
    • replace the following lines -
    • args « "-DPYTHON#{py_ver}_LIBRARY=#{py_lib}/libpython2.7.#{dylib}"
    • args « "-DPYTHON#{py_ver}_INCLUDE_DIR=#{py_prefix}/include/python2.7"
    • with -
    • args « "-DPYTHON_LIBRARY=#{py_prefix}/lib/libpython2.7.dylib"
    • args « "-DPYTHON_INCLUDE_DIR=#{py_prefix}/include/python2.7"
  • Install snappy, leveldb, gflags, glog, szip, lmdb and opencv.
    • brew install —fresh -vd snappy leveldb gflags glog szip lmdb homebrew/science/opencv
  • Install protobuf.
    • brew install —build-from-source —with-python —fresh -vd protobuf
  • Install boost libraries for python.
    • brew install —build-from-source —fresh -vd boost boost-python

UBUNTU 14.04 :

To be updated.

Download Caffe

Create a directory where you would like to install caffe. For all future reference, this will be called the <caffe-home>
From inside the <caffe-home> directory, execute the following commands :

$> git clone https://github.com/BVLC/caffe.git
$> cd caffe
$> cp Makefile.config.example Makefile.config

Edit the Makefile.config : [Very Imp]

Keep track of all the path variables set in the the Makefile.config (the smallest of mistakes can lead you off track for days together). Here's my complete Makefile.config for the hasty ones here… We'll tackle each step in the upcoming section.

## Refer to http://caffe.berkeleyvision.org/installation.html
# Contributions simplifying and improving our build system are welcome!

# cuDNN acceleration switch (uncomment to build with cuDNN).
# USE_CUDNN := 1

# CPU-only switch (uncomment to build without GPU support).
CPU_ONLY := 1

# To customize your choice of compiler, uncomment and set the following.
# N.B. the default for Linux is g++ and the default for OSX is clang++
# CUSTOM_CXX := g++

# CUDA directory contains bin/ and lib/ directories that we need.
CUDA_DIR := /usr/local/cuda
# On Ubuntu 14.04, if cuda tools are installed via
# "sudo apt-get install nvidia-cuda-toolkit" then use this instead:
# CUDA_DIR := /usr

# CUDA architecture setting: going with all of them.
# For CUDA < 6.0, comment the *_50 lines for compatibility.
CUDA_ARCH := -gencode arch=compute_20,code=sm_20 \
        -gencode arch=compute_20,code=sm_21 \
        -gencode arch=compute_30,code=sm_30 \
        -gencode arch=compute_35,code=sm_35 \
        -gencode arch=compute_50,code=sm_50 \
        -gencode arch=compute_50,code=compute_50

# BLAS choice:
# atlas for ATLAS (default)
# mkl for MKL
# open for OpenBlas
BLAS := atlas
# Custom (MKL/ATLAS/OpenBLAS) include and lib directories.
# Leave commented to accept the defaults for your choice of BLAS
# (which should work)!
# BLAS_INCLUDE := /path/to/your/blas
# BLAS_LIB := /path/to/your/blas

# This is required only if you will compile the matlab interface.
# MATLAB directory should contain the mex binary in /bin.
# MATLAB_DIR := /usr/local
# MATLAB_DIR := /Applications/MATLAB_R2012b.app

# NOTE: this is required only if you will compile the python interface.
# We need to be able to find Python.h and numpy/arrayobject.h.
PYTHON_INCLUDE := /usr/include/python2.7 \
        /usr/local/lib/python2.7/site-packages/numpy/core/include/
# Anaconda Python distribution is quite popular. Include path:
# Verify anaconda location, sometimes it's in root.
# ANACONDA_HOME := $(HOME)/anaconda
# PYTHON_INCLUDE := $(ANACONDA_HOME)/include \
        # $(ANACONDA_HOME)/include/python2.7 \
        # $(ANACONDA_HOME)/lib/python2.7/site-packages/numpy/core/include \

# We need to be able to find libpythonX.X.so or .dylib.
PYTHON_LIB := /usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/
# PYTHON_LIB := $(ANACONDA_HOME)/lib

# Uncomment to support layers written in Python (will link against Python libs)
# WITH_PYTHON_LAYER := 1

# Whatever else you find you need goes here.
INCLUDE_DIRS := $(PYTHON_INCLUDE) /usr/local/include
LIBRARY_DIRS := $(PYTHON_LIB) /usr/local/lib /usr/lib

# Uncomment to use `pkg-config` to specify OpenCV library paths.
# (Usually not necessary -- OpenCV libraries are normally installed in one of the above $LIBRARY_DIRS.)
# USE_PKG_CONFIG := 1

BUILD_DIR := build
DISTRIBUTE_DIR := distribute

# Uncomment for debugging. Does not work on OSX due to https://github.com/BVLC/caffe/issues/171
# DEBUG := 1

# The ID of the GPU that 'make runtest' will use to run unit tests.
TEST_GPUID := 0

# enable pretty build (comment to see full commands)
Q ?= @

Now lets look at the file step-by-step.

We leave this part commented out as we wont be using cuDNN in our installation. It speeds up the Caffe processes but for a general (simplistic and working) installation, it can be left out.

# cuDNN acceleration switch (uncomment to build with cuDNN).
# USE_CUDNN := 1

We build caffe without GPU support (following the idea of having a simplistic,working installation).

# CPU-only switch (uncomment to build without GPU support).
CPU_ONLY := 1

Pretty self-explanatory with the comments. This is the path to your local installation of CUDA.

# CUDA directory contains bin/ and lib/ directories that we need.
CUDA_DIR := /usr/local/cuda
# On Ubuntu 14.04, if cuda tools are installed via
# "sudo apt-get install nvidia-cuda-toolkit" then use this instead:
# CUDA_DIR := /usr

You can chose from ATLAS, MKL, or OpenBLAS for your BLAS choices.
OSX has in-built BLAS libs so leave the BLAS:=atlas (default)

# BLAS choice:
# atlas for ATLAS (default)
# mkl for MKL
# open for OpenBlas
BLAS := atlas
# Custom (MKL/ATLAS/OpenBLAS) include and lib directories.
# Leave commented to accept the defaults for your choice of BLAS
# (which should work)!
# BLAS_INCLUDE := /path/to/your/blas
# BLAS_LIB := /path/to/your/blas

Use this only if you need MatCaffe interface for Caffe. Following our idea of simplistic installation, we will skip this part.

# This is required only if you will compile the matlab interface.
# MATLAB directory should contain the mex binary in /bin.
# MATLAB_DIR := /usr/local
# MATLAB_DIR := /Applications/MATLAB_R2012b.app

Now this is a tricky part. To install Caffe with the python interface, PyCaffe (Recommended) you need to give the paths to your python include libs and the path where you have numpy stored. Path to numpy include folder must be given with great caution. You might land into unnecessary trouble by specifying this path incorrectly.

# NOTE: this is required only if you will compile the python interface.
# We need to be able to find Python.h and numpy/arrayobject.h.
PYTHON_INCLUDE := /usr/include/python2.7 \
        /usr/local/lib/python2.7/site-packages/numpy/core/include/

This was the most important tweak required to get PyCaffe up and running. You might have different versions of python installed on your local machine and in your homebrew instance. This would lead to problems when importing caffe from your python interpreter. To overcome this problem, make sure that you provide the correct path to your brewed python.

# We need to be able to find libpythonX.X.so or .dylib.
PYTHON_LIB := /usr/local/Cellar/python/2.7.9/Frameworks/Python.framework/Versions/2.7/lib/

The rest of the parts can be left out as they are not used anyways (commented out) and hold not much importance. You are all set to compile Caffe! Almost there!

Compile :

Now hoping that all the above steps went as planned, we can finally compile Caffe. So keeping your fingers crossed, execute the following from your <caffe-home>:

$> make clean
$> make all
$> make test
$> make runtest

These commands will take a few minutes to execute. I'd suggest you skim through the output of these commands being printed on the stdout and make sure you see no alarming warnings/errors. You might see quite a few warnings of unused variables and parallel threads (-pthread). These are not things you should worry about.

The output of the 'make runtest' command would be somewhat as the image below,

PyCaffe

Now to install and configure the python interface to Caffe, first lets make sure we have all the python dependencies installed. The requirements.txt file handles this list.

for req in $(cat requirements.txt); do pip install $req; done

Now, to compile the PyCaffe interface, from the <caffe-home> do

make pycaffe

IMP : Don't forget to set the PYTHONPATH variable in your ~/.bash_profile (OSX) or ~/.bashrc (Linux) to the caffe python.

export PYTHONPATH=<caffe-home>/python:$PYTHONPATH

Some versions of the official documentation show that the PYTHONPATH variable needs to be set to <caffe-home>/python/caffe, however this is an error in the documentation and the above path should be set.

You might also run the following command to create a distribute directory with all the Caffe headers, compiled libraries, binaries, etc. needed for distribution to other machines.

make distribute

To finally import caffe in the python interpreter, go the python folder in <caffe-home> and execute

$> cd <caffe-home>/python
$> python
Python 2.7.9 (default, Jan 29 2015, 06:27:40)
[GCC 4.2.1 Compatible Apple LLVM 6.0 (clang-600.0.56)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import caffe

Done!

Now you are all set to rock! Play around with a few examples like Training LeNet on MNIST or see how to use the pre-trained models like ImageNet.

End-Note :

• Hope this page helps reduce some effort required to install Caffe on your machines. To view our bigger attempts at reducing this overload, checkout the CloudCV organisation page.

• The BVLC Caffe issues and the caffe-users google-group are excellent sources to get your queries solved and debug the errors you face.

• I have taken references from a lot of sources I found online and one can easily find them through the sources cited in above bullet. This wiki is for educational purposes only.