thrift的使用介绍

一、About thrift
二、什么是thrift，怎么工作？
三、Thrift IDL
四、Thrift Demo
五、Thrift 协议栈 以及各层的使用（java 为例）
六、与protocolbuffer的区别

一、About thrift
thrift是一种可伸缩的跨语言服务的发展软件框架。它结合了功能强大的软件堆栈的代码生成引擎，以建设服务，工作效率和无缝地与C + +，C#，Java，Python和PHP和Ruby结合。thrift是facebook开发的，我们现在把它作为开源软件使用。thrift允许你定义一个简单的定义文件中的数据类型和服务接口。以作为输入文件，编译器生成代码用来方便地生成RPC客户端和服务器通信的无缝跨编程语言（来自百度百科）。
>>>最初由facebook开发用做系统内个语言之间的RPC通信 。
>>>2007年由facebook贡献到apache基金 ，现在是apache下的opensource之一 。
>>>支持多种语言之间的RPC方式的通信：php语言client可以构造一个对象，调用相应的服务方法来调用java语言的服务 ，跨越语言的C/S rpc 调用 。

二、什么是thrift，怎么工作？

java rmi的例子，代码见附件，建立一个java rmi的流程 ：
>>>定义一个服务调用接口 。
>>>server端：接口实现---impl的实例---注册该服务实现（端口）---启动服务。
>>>client端：通过ip、端口、服务名，得到服务，通过接口来调用 。
>>>rmi数据传输方式：java对象序列化 。

Thrift 服务
>>>例同rmi ，需要定义通信接口、实现、注册服务、绑定端口……
>>>如何多种语言之间通信 ？
>>>数据传输走socket（多种语言均支持），数据再以特定的格式（String ），发送，接收方语言解析 。
Object ---> String ---> Object 。

问题：编码、解析完全需要自己做 ，复杂的数据结构会编码困难 .

Thrift 服务 ：thrift的中间编码层
>>>java Object ---> Thrift Object ---> php Object
>>> 定义thrift的文件 ，由thrift文件（IDL）生成 双方语言的接口、model ，在生成的model以及接口中会有解码编码的代码 。
>>>thrift 文件例子
thrift-0.7.0.exe -r -gen java TestThrift.thrift 生成java 代码
thrift-0.7.0.exe -r -gen php TestThrift.thrift 生成php代码
thrift-0.7.0.exe -r -gen py TestThrift.thrift 生成python代码
thrift-0.7.0.exe -r -gen as3 TestThrift.thrift 生成as3代码
thrift-0.7.0.exe -r -gen cpp TestThrift.thrift 生成C++代码

三、Thrift IDL
http://www.cnblogs.com/tianhuilove/archive/2011/09/05/2167669.html http://wiki.apache.org/thrift/ http://wiki.apache.org/thrift/ThriftTypes
四、Thrift Demo
Thrift IDL 文件

Java代码


namespace java com.gemantic.analyse.thrift.index

struct NewsModel{

1:i32 id ;

2:string title;

3:string content;

4:string media_from;

5:string author;

}

service IndexNewsOperatorServices {

bool indexNews(1:NewsModel indexNews),

bool deleteArtificiallyNews(1:i32 id )

}

java server

Java代码


package com.gemantic.analyse.thrift.index;

import java.net.InetSocketAddress;

import org.apache.thrift.protocol.TBinaryProtocol;

import org.apache.thrift.server.TServer;

import org.apache.thrift.server.TThreadPoolServer;

import org.apache.thrift.server.TThreadPoolServer.Args;

import org.apache.thrift.transport.TServerSocket;

import org.apache.thrift.transport.TServerTransport;

import org.apache.thrift.transport.TTransportFactory;

public class ThriftServerTest {

/**

* @param args

*/

public static void main(String[] args) {

// TODO Auto-generated method stub

IndexNewsOperatorServices.Processor processor = new IndexNewsOperatorServices.Processor(new IndexNewsOperatorServicesImpl());

try{

TServerTransport serverTransport = new TServerSocket( new InetSocketAddress("0.0.0.0",9813));

Args trArgs=new Args(serverTransport);

trArgs.processor(processor);

//使用二进制来编码应用层的数据

trArgs.protocolFactory(new TBinaryProtocol.Factory(true, true));

//使用普通的socket来传输数据

trArgs.transportFactory(new TTransportFactory());

TServer server = new TThreadPoolServer(trArgs);

System.out.println("server begin ......................");

server.serve();

System.out.println("---------------------------------------");

server.stop();

}catch(Exception e){

throw new RuntimeException("index thrift server start failed!!"+"/n"+e.getMessage());

}

}

}

java client

Java代码


package com.gemantic.analyse.thrift.index;

import org.apache.thrift.TException;

import org.apache.thrift.protocol.TBinaryProtocol;

import org.apache.thrift.protocol.TProtocol;

import org.apache.thrift.transport.TSocket;

import org.apache.thrift.transport.TTransport;

public class ThriftClientTest {

/**

* @param args

* @throws TException

*/

public static void main(String[] args) throws TException {

// TODO Auto-generated method stub

TTransport transport = new TSocket("10.0.0.41", 9813);

long start=System.currentTimeMillis();

// TTransport transport = new TSocket("218.11.178.110",9090);

TProtocol protocol = new TBinaryProtocol(transport);

IndexNewsOperatorServices.Client client=new IndexNewsOperatorServices.Client(protocol);

transport.open();

client.deleteArtificiallyNews(123456);

NewsModel newsModel=new NewsModel();

newsModel.setId(789456);

newsModel.setTitle("this from java client");

newsModel.setContent("　世界杯比赛前，由于塞尔维亚和黑山突然宣布分裂，国际足联开会决定剔除塞黑，由世界上球迷最多的国家顶替，名额恰巧来到中国。举国上下一片欢腾，中国足协决定由“成世铎”（成龙+阎世铎）组队，进军世界杯。");

newsModel.setAuthor("ddc");

newsModel.setMedia_from("新华08");

client.indexNews(newsModel);

transport.close();

System.out.println((System.currentTimeMillis()-start));

System.out.println("client sucess!");

}

}

php client

Php代码


<?php

$GLOBALS['THRIFT_ROOT'] = '/home/tjiang/demo/thrift/lib/php/src';

require_once $GLOBALS['THRIFT_ROOT'].'/Thrift.php';

require_once $GLOBALS['THRIFT_ROOT'].'/protocol/TBinaryProtocol.php';

require_once $GLOBALS['THRIFT_ROOT'].'/transport/TSocket.php';

require_once $GLOBALS['THRIFT_ROOT'].'/transport/THttpClient.php';

require_once $GLOBALS['THRIFT_ROOT'].'/transport/TBufferedTransport.php';

include_once $GLOBALS['THRIFT_ROOT'].'/packages/TestThrift/TestThrift_types.php';

include_once $GLOBALS['THRIFT_ROOT'].'/packages/TestThrift/IndexNewsOperatorServices.php';

$data=array(

'id'=>'1',

'title'=>'demo-标题',

'content'=>'demo-内容',

'media_from'=>'hexun',

'author'=>'xiaodi667'

);

$thrif_server_url = '10.0.0.41';

$transport = new TSocket($thrif_server_url, 9813);

$transport->open();

$protocol = new TBinaryProtocol($transport);

$client= new IndexNewsOperatorServicesClient($protocol, $protocol);

$obj = new NewsModel($data);

$result = $client->indexNews($obj);

$transport->close();

?>

python client

Python代码


#!/usr/bin/env python

#

# Licensed to the Apache Software Foundation (ASF) under one

# or more contributor license agreements. See the NOTICE file

# distributed with this work for additional information

# regarding copyright ownership. The ASF licenses this file

# to you under the Apache License, Version 2.0 (the

# "License"); you may not use this file except in compliance

# with the License. You may obtain a copy of the License at

#

# http://www.apache.org/licenses/LICENSE-2.0
#

# Unless required by applicable law or agreed to in writing,

# software distributed under the License is distributed on an

# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY

# KIND, either express or implied. See the License for the

# specific language governing permissions and limitations

# under the License.

#

import sys

from TestThrift.ttypes import NewsModel

from TestThrift.IndexNewsOperatorServices import Client

from thrift import Thrift

from thrift.transport import TSocket

from thrift.transport import TTransport

from thrift.protocol import TBinaryProtocol

try:

# Make socket

transport = TSocket.TSocket('10.0.0.41', 9813)

# Buffering is critical. Raw sockets are very slow

transport = TTransport.TBufferedTransport(transport)

# Wrap in a protocol

protocol = TBinaryProtocol.TBinaryProtocol(transport)

# Create a client to use the protocol encoder

client = Client(protocol)

# Connect!

transport.open()

client.deleteArtificiallyNews(123)

newsModel=NewsModel()

newsModel.id=123456

newsModel.title="python Test"

newsModel.content="client test come from python";

newsModel.media_from="xinhua08"

client.indexNews(newsModel)

#close

transport.close()

except Thrift.TException, tx:

print '%s' % (tx.message)

Csharp client

C#代码


TTransport transport = new TSocket("10.0.0.41", 9813);

TProtocol protocol = new TBinaryProtocol(transport);

IndexNewsOperatorServices.Client client = new IndexNewsOperatorServices.Client(protocol);

transport.Open();

NewsModel model = new NewsModel();

model.Author = "jww";

model.Title = "title";

model.Content = "client Come From CSharp";

model.Id = 1;

client.deleteArtificiallyNews(123);

Console.WriteLine(client.indexNews(model));

五、Thrift 协议栈 以及各层的使用（java 为例）



1、model interface
服务的调用接口以及接口参数model、返回值model
2、Tprotocol 协议层
将数据（model）编码 、解码 。
3、Ttramsport 传输层
编码后的数据传输（简单socket、http）
5、Tserver
服务的Tserver类型，实现了几种rpc调用（单线程、多线程、非阻塞IO）

六、与protocolbuffer的区别 http://liuchangit.com/development/346.html http://stackoverflow.com/questions/69316/biggest-differences-of-thrift-vs-protocol-buffers
区别：
1、Another important difference are the languages supported by default. protobuf: Java, C++, Python Thrift: Java, C++, Python, PHP, Ruby, Erlang, Perl, Haskell, C#, Cocoa, Smalltalk, Ocaml
支持语言不同，thrift支持着更多的语言 。
2、Thrift supports ‘exceptions 。
thrift支持服务的异常 。
3、Protocol Buffers much easier to read 。Protobuf API looks cleaner, though the generated classes are all packed as an inner classes which is not so nice.
Protocol Buffers 在文档方面比thrift丰富，而且比thrift简单 。
4、Protobuf serialized objects are about 30% smaller then Thrift.
Protocol Buffers在序列化/反序列化、传输上性能更优 。
5、RPC is another key difference. Thrift generates code to implement RPC clients and servers wheres Protocol Buffers seems mostly designed as a data-interchange format alone.
thrift提供了一套完整的rpc服务实现（多线程socket、非阻塞的socket....）
6、And according to the wiki the Thrift runtime doesn't run on Windows.
thrift 对有些语言在windows上不支持：C++ .....