栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 前沿技术 > 大数据 > 大数据系统

oiv 查看 Fsimage 文件和oev 查看 Edits 文件

oiv 查看 Fsimage 文件和oev 查看 Edits 文件

oiv 查看 Fsimage 文件

1、进入目的路径

[lqs@bdc112 current]$ cd /home/lqs/module/hadoop-3.1.3/data/dfs/name/current

语法:
	hdfs oiv -p 文件类型 -i 镜像文件 -o 转换后文件输出路径

2、使用命令进行转换

[lqs@bdc112 current]$ hdfs oiv -p XML -i fsimage_0000000000000000330 -o /home/lqs/module/hadoop-3.1.3/fsimage1.xml

3、导入idea进行格式化后查看,内容如下:



    
        -64
        1
        ba631c436b806728f8ec2f54ab1e289526c90579
    
    
        2086111572
        1000
        1031
        0
        1073741855
        330
    
    
        
            1
            RS-6-3-1024k
            1048576
            DISABLED
            
                rs
                6
                3
            
        

        
            2
            RS-3-2-1024k
            1048576
            DISABLED
            
                rs
                3
                2
            
        

        
            3
            RS-LEGACY-6-3-1024k
            1048576
            DISABLED
            
                rs-legacy
                6
                3
            
        

        
            4
            XOR-2-1-1024k
            1048576
            DISABLED
            
                xor
                2
                1
            
        

        
            5
            RS-10-4-1024k
            1048576
            DISABLED
            
                rs
                10
                4
            
        

    

    
        16468
        39
        
            16385
            DIRECTORY
            
            1638944340547
            lqs:supergroup:0755
            9223372036854775807
            -1
        
        
            16386
            DIRECTORY
            tmp
            1638944079685
            lqs:supergroup:0770
            -1
            -1
        
        
            16387
            DIRECTORY
            hadoop-yarn
            1638708219023
            lqs:supergroup:0770
            -1
            -1
        
        
            16388
            DIRECTORY
            staging
            1638944026810
            lqs:supergroup:0770
            -1
            -1
        
        
            16389
            DIRECTORY
            history
            1638708219062
            lqs:supergroup:0770
            -1
            -1
        
        
            16390
            DIRECTORY
            done
            1638944155423
            lqs:supergroup:0770
            -1
            -1
        
        
            16391
            DIRECTORY
            done_intermediate
            1638944083921
            lqs:supergroup:1777
            -1
            -1
        
        
            16395
            DIRECTORY
            xiyou
            1638874848565
            lqs:supergroup:0755
            -1
            -1
        
        
            16396
            DIRECTORY
            huaguoshan
            1638940862591
            lqs:supergroup:0755
            -1
            -1
        
        
            16397
            FILE
            sunwukong.txt
            2
            1638891402818
            1638891401920
            134217728
            lqs:supergroup:0644
            
                
                    1073741826
                    1002
                    42
                
            
            0
        
        
            16407
            FILE
            sunwukong.txt
            2
            1638940521097
            1638940520807
            134217728
            lqs:supergroup:0644
            
                
                    1073741829
                    1005
                    42
                
            
            0
        
        
            16408
            DIRECTORY
            lqs
            1638940730514
            lqs:supergroup:0755
            -1
            -1
        
        
            16409
            DIRECTORY
            test
            1638940862591
            lqs:supergroup:0755
            -1
            -1
        
        
            16410
            FILE
            lqs.txt
            2
            1638940748858
            1638940748204
            134217728
            lqs:supergroup:0644
            
                
                    1073741830
                    1006
                    42
                
            
            0
        
        
            16411
            DIRECTORY
            lqs
            1638944026810
            lqs:supergroup:0700
            -1
            -1
        
        
            16412
            DIRECTORY
            .staging
            1638944359932
            lqs:supergroup:0700
            -1
            -1
        
        
            16415
            DIRECTORY
            input
            1638944264244
            lqs:supergroup:0755
            -1
            -1
        
        
            16421
            DIRECTORY
            logs
            1638944079724
            lqs:lqs:1777
            -1
            -1
        
        
            16422
            DIRECTORY
            lqs
            1638944079726
            lqs:lqs:0770
            -1
            -1
        
        
            16423
            DIRECTORY
            logs-tfile
            1638944336519
            lqs:lqs:0770
            -1
            -1
        
        
            16424
            DIRECTORY
            application_1638924755371_0002
            1638944104711
            lqs:lqs:0770
            -1
            -1
        
        
            16425
            DIRECTORY
            lqs
            1638944392624
            lqs:supergroup:0770
            -1
            -1
        
        
            16438
            FILE
            
                job_1638924755371_0002-1638944077724-lqs-word+count-1638944096756-0-1-SUCCEEDED-default-1638944088259.jhist
            
            3
            1638944096890
            1638944096852
            134217728
            lqs:supergroup:0770
            
                
                    1073741839
                    1015
                    16277
                
            
            0
        
        
            16439
            FILE
            job_1638924755371_0002_conf.xml
            3
            1638944097034
            1638944096901
            134217728
            lqs:supergroup:0770
            
                
                    1073741840
                    1016
                    214600
                
            
            0
        
        
            16440
            FILE
            bdc114_38083
            3
            1638944104704
            1638944104602
            134217728
            lqs:lqs:0640
            
                
                    1073741841
                    1017
                    95203
                
            
            0
        
        
            16441
            DIRECTORY
            2021
            1638944155423
            lqs:supergroup:0770
            -1
            -1
        
        
            16442
            DIRECTORY
            12
            1638944155423
            lqs:supergroup:0770
            -1
            -1
        
        
            16443
            DIRECTORY
            08
            1638944155423
            lqs:supergroup:0770
            -1
            -1
        
        
            16444
            DIRECTORY
            000000
            1638944392624
            lqs:supergroup:0770
            -1
            -1
        
        
            16445
            FILE
            word.txt
            3
            1638944264329
            1638944264244
            134217728
            lqs:supergroup:0644
            
                
                    1073741842
                    1018
                    45
                
            
            0
        
        
            16451
            DIRECTORY
            application_1638924755371_0003
            1638944366469
            lqs:lqs:0770
            -1
            -1
        
        
            16453
            DIRECTORY
            output
            1638944358484
            lqs:supergroup:0755
            -1
            -1
        
        
            16459
            FILE
            part-r-00000
            3
            1638944358373
            1638944358229
            134217728
            lqs:supergroup:0644
            
                
                    1073741849
                    1025
                    38
                
            
            0
        
        
            16461
            FILE
            _SUCCESS
            3
            1638944358490
            1638944358484
            134217728
            lqs:supergroup:0644
            0
        
        
            16464
            FILE
            
                job_1638924755371_0003-1638944336424-lqs-word+count-1638944358494-1-1-SUCCEEDED-default-1638944340533.jhist
            
            3
            1638944358622
            1638944358589
            134217728
            lqs:supergroup:0770
            
                
                    1073741851
                    1027
                    22304
                
            
            0
        
        
            16465
            FILE
            job_1638924755371_0003_conf.xml
            3
            1638944358764
            1638944358636
            134217728
            lqs:supergroup:0770
            
                
                    1073741852
                    1028
                    214600
                
            
            0
        
        
            16466
            FILE
            bdc113_37030
            3
            1638944365783
            1638944365630
            134217728
            lqs:lqs:0640
            
                
                    1073741853
                    1029
                    33348
                
            
            0
        
        
            16467
            FILE
            bdc112_35067
            3
            1638944366122
            1638944366013
            134217728
            lqs:lqs:0640
            
                
                    1073741854
                    1030
                    35775
                
            
            0
        
        
            16468
            FILE
            bdc114_38083
            3
            1638944366465
            1638944366365
            134217728
            lqs:lqs:0640
            
                
                    1073741855
                    1031
                    68619
                
            
            0
        
    
    
    
        0
        0
    
    
        
            16385
            16415
            16408
            16453
            16397
            16386
            16395
        
        
            16386
            16387
            16421
        
        
            16387
            16388
        
        
            16388
            16389
            16411
        
        
            16389
            16390
            16391
        
        
            16390
            16441
        
        
            16391
            16425
        
        
            16395
            16396
        
        
            16408
            16409
        
        
            16409
            16410
            16407
        
        
            16411
            16412
        
        
            16415
            16445
        
        
            16421
            16422
        
        
            16422
            16423
        
        
            16423
            16424
            16451
        
        
            16424
            16440
        
        
            16441
            16442
        
        
            16442
            16443
        
        
            16443
            16444
        
        
            16444
            16438
            16439
            16464
            16465
        
        
            16451
            16467
            16466
            16468
        
        
            16453
            16461
            16459
        
    
    
    
        0
        0
        0
        0
    
    
        1
        0
        0
    


oev 查看 Edits 文件

1、进入目的路径

[lqs@bdc112 current]$ cd /home/lqs/module/hadoop-3.1.3/data/dfs/name/current

语法:
	hdfs oev -p 文件类型 -i 编辑日志 -o 转换后文件输出路径

2、使用命令进行转换

[lqs@bdc112 current]$ hdfs oev -p XML -i edits_0000000000000000045-0000000000000000055 -o /home/lqs/module/hadoop-3.1.3/edits.xml

3、导入idea进行格式化后查看,内容如下:



    -64
    
        OP_START_LOG_SEGMENT
        
            45
        
    
    
        OP_ADD
        
            46
            0
            16397
            /lqs.txt
            2
            1638891401920
            1638891401920
            134217728
            DFSClient_NONMAPREDUCE_-410590844_1
            192.168.10.15
            true
            
                lqs
                supergroup
                420
            
            0
            c5157f32-8ffb-48c3-a1e5-c1f898e156cc
            2
        
    
    
        OP_ALLOCATE_BLOCK_ID
        
            47
            1073741826
        
    
    
        OP_SET_GENSTAMP_V2
        
            48
            1002
        
    
    
        OP_ADD_BLOCK
        
            49
            /lqs.txt
            
                1073741826
                0
                1002
            
            
            -2
        
    
    
        OP_CLOSE
        
            50
            0
            0
            /lqs.txt
            2
            1638891402818
            1638891401920
            134217728
            
            
            false
            
                1073741826
                42
                1002
            
            
                lqs
                supergroup
                420
            
        
    
    
        OP_ADD
        
            51
            0
            16398
            /test/test1/lqs.txt
            2
            1638892454273
            1638892454273
            134217728
            DFSClient_NONMAPREDUCE_1886145386_1
            192.168.10.15
            true
            
                lqs
                supergroup
                420
            
            0
            de910111-6395-46f0-9fac-ee3e8911fa65
            2
        
    
    
        OP_ALLOCATE_BLOCK_ID
        
            52
            1073741827
        
    
    
        OP_SET_GENSTAMP_V2
        
            53
            1003
        
    
    
        OP_ADD_BLOCK
        
            54
            /lqs/test/lqs1.txt
            
                1073741827
                0
                1003
            
            
            -2
        
    
    
        OP_CLOSE
        
            55
            0
            0
            /test/test/lqs.txt
            2
            1638892454551
            1638892454273
            134217728
            
            
            false
            
                1073741827
                42
                1003
            
            
                lqs
                supergroup
                420
            
        
    


转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/650564.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号