码迷,mamicode.com
首页 > 数据库 > 详细

pycaffe对lmdb的写入与读取

时间:2016-03-31 07:09:02      阅读:322      评论:0      收藏:0      [点我收藏+]

标签:

轻量数据库,删和改就没啥必要了。

1,将图片数据写入lmdb。

def image_dataset_to_lmdb(image_folder_path,lmdb_path):
    # 创建db
    db = lmdb.open(lmdb_path, map_size=int(1e12))
    # 开始事务
    with db.begin(write=True) as db_txn:
        # 枚举图片地址
        for parent, dirnames, filenames in os.walk(image_folder_path):
            # 限制目录范围,子目录跳过
            if (parent == image_folder_path):
                for index, filename in enumerate(filenames, start=0):
                    image_path = image_folder_path + filename

                    # read image into numpy.narray
                    image_array = numpy.array(Image.open(image_path))

                    # image type recognition
                    if type(image_array[0][0]) is numpy.uint8:
                        print(image_path +  => image type : grayscale, this function can not handle this case, skip.)
                        continue
                    elif type(image_array[0][0]) is numpy.ndarray:
                        print(image_path +  => image type : color, go.)

                    # RGB format to BGR format
                    image_array = image_array[:, :, ::-1]
                    # channel split by transpose matrix
                    image_array = image_array.transpose((2, 0, 1))
                    # convert numpy narray to caffe datum format
                    im_dat = caffe.io.array_to_datum(image_array)
                    # write to db
                    # 这里可以为每张图片设置y值
                    im_dat.label = 1
                    # ‘{:0>10d}‘.format(index) => key, im_dat.SerializeToString() => value
                    db_txn.put({:0>10d}.format(index), im_dat.SerializeToString())
    db.close()

2,读取数据库

def read_lmdb(lmdb_path):

    #open lmdb
    lmdb_env = lmdb.open(lmdb_path)
    #begin transaction
    lmdb_txn = lmdb_env.begin()
    #get cursor
    lmdb_cursor = lmdb_txn.cursor()
    #get data object
    datum = caffe.proto.caffe_pb2.Datum()

    for key, value in lmdb_cursor:
        #parse back to datum
        datum.ParseFromString(value)
        #get y value
        label = datum.label
        print(label =  + str(label))
        data_array = caffe.io.datum_to_array(datum)
        print(data is numpy.narray :)
        for data in data_array:
            print(str(data) + \n)

pycaffe对lmdb的写入与读取

标签:

原文地址:http://www.cnblogs.com/ryukinkou/p/5339755.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!