Technology sharing

한어Русский языкEnglishFrançaisIndonesianSanskrit日本語DeutschPortuguêsΕλληνικάespañolItalianoSuomalainenLatina

Download dataX

https://datax-opensource.oss-cn-hangzhou.aliyuncs.com/202308/datax.tar.gz

deinde

Post demptionem, unzip ad directorium locale, bin directorium intra, et officium synchronisationi currite;

$ cd  {YOUR_DATAX_HOME}/bin
$ python datax.py {YOUR_JOB.json}

Oportet te habere Pythonem, jdk1.8 et maven3 .

Primus gradus est officium configuratione file creare (json forma)

Formula genus:

#stream2stream.json
{
"officium": {
"contentus": [
      {
"lector": {
"nomen": "amicus";
"parameter": {
"sliceRecordCount": 10,
"Columna": [
              {
"genus": "longus";
"pretium": "X"
              },
              {
"genus": "chorda",
"valorem": "salve, salve, mundi-DataX"
              }
            ]
          }
        },
"scriptorem": {
"nomen": "streamwriter";
"parameter": {
"delatam": "UTF-8",
"print": verum
          }
        }
      }
    ],
"occasum": {
"celeritate": {
"canale": 5
       }
    }
  }
}

Start up

$ cd {YOUR_DATAX_DIR_BIN}
$ pythonis datax.py ./stream2stream.json

Ad sinistram github, quo lector vel scriptor vis uti?

Modo ad venam resouece et utere json quem providet.

Nihil refert, si github aperire non potes, exempla in plugins in folder quod ex te recepta sunt.

valde simplex.

exemplum

mysql legere et scribere exempla

 
{"job": {"content": [{"reader": {"name": "mysqlreader", "parameter": {"username": "root","password": "123123","column": ["*"],"splitPk": "ID","where": "ID <= 1888","connection": [{"jdbcUrl": ["jdbc:mysql://192.168.1.1:3306/xxx?useUnicode=true&characterEncoding=utf8"], "table": ["t_member"]}]}}, "writer": {"name": "mysqlwriter", "parameter": {"column": ["*"], "connection": [{"jdbcUrl": "jdbc:mysql://192.168.1.2:3306/xxx?useUnicode=true&characterEncoding=utf8","table": ["t_xxx"]}], "password": "123123","preSql": ["执行写入前执行的语句，比如删除表啊，之类的"], "session": ["set session sql_mode='ANSI'"], "username": "root", "writeMode": "insert"}}}], "setting": {"speed": {"channel": "5"}}}
}