首页
学习
活动
专区
圈层
工具
发布
社区首页 >问答首页 >面向NLP的中文语音如何实现我的语料库文件

问面向NLP的中文语音如何实现我的语料库文件
EN

Stack Overflow用户
提问于 2022-01-12 03:16:36
回答 1查看 87关注 0票数 0

我是Python新手,我想让这段代码从(.csv)文件中实现我的语料库,任何人都可以帮助我实现它,如下图所示。

代码语言:javascript
复制
from chinese_whispers import __version__ as cw_version
from networkx import __version__ as nx_version
from matplotlib import __version__ as plt_version
print('Chinese Whispers {}'.format(cw_version))
print('NetworkX {}'.format(nx_version))
print('matplotlib {}'.format(plt_version))
import networkx as nx
from chinese_whispers import chinese_whispers, aggregate_clusters
G = nx.karate_club_graph()
# Perform clustering of G, parameters weighting and seed can be omitted
chinese_whispers(G, weighting='top', seed=10000) 

# Print the clusters in the descending order of size
print('ID\tCluster\n')

for label, cluster in sorted(aggregate_clusters(G).items(), key=lambda e: len(e[1]), reverse=True):
    print('{}\t{}\n'.format(label, cluster))
import matplotlib.pyplot as plt
colors = [1. / G.nodes[node]['label'] for node in G.nodes()]

nx.draw_networkx(G, cmap=plt.get_cmap('jet'), node_color=colors, font_color='white')

​

​

EN

回答 1

Stack Overflow用户

发布于 2022-01-12 03:32:29

我试过了

代码语言:javascript
复制
import sys
import subprocess
from pandas import read_csv


def sort_input_sort(input_fpath):
    sorted_fpath = input_fpath + ".sort"
    df = read_csv(input_fpath, sep="\t", encoding='utf8', names=["node_i", "node_j", "sim_ij"])
    df = df.sort_values(["node_i", "sim_ij"], ascending=False)
    df.to_csv(sorted_fpath, sep="\t", header=False, index=False, encoding="utf-8")
    return sorted_fpath


def clustering(input_graph_fpath, output_clusters_fpath="", mode="global", clustering="cw", N=200, n=200, cw_option="TOP", java_xmx_gb=16):
    """
    input_graph_fpath in the 'node_i<TAB>node_j<TAB>sim_ij' format. Can be sorted in any way. 
    mode: wsi or global; clustering: cw or mcl """

    sorted_input_fpath = sort_input_sort(input_graph_fpath)

    if output_clusters_fpath == "": output_clusters_fpath = input_graph_fpath + "-%s-%s-%d-%d-%s.clusters" % (mode, clustering, N, n, cw_option)

    if mode == "wsi":
        cmd = "java -Xms1G -Xmx%dG -cp target/chinese-whispers.jar de.tudarmstadt.lt.wsi.WSI -in %s -out %s -N %d -n %d  -clustering %s -cwOption %s" % (
            java_xmx_gb, sorted_input_fpath, output_clusters_fpath, N, n, clustering, cw_option)
    else:
        cmd = "java -Xms1G -Xmx%dG -cp target/chinese-whispers.jar de.tudarmstadt.lt.cw.global.CWGlobal -in %s -out %s -N %d -cwOption %s" % (
            java_xmx_gb, sorted_input_fpath, output_clusters_fpath, N, cw_option)

    print("\nStart clustering of with the following parameters:")
    print(cmd)

    process = subprocess.Popen(cmd.split(), stdout=subprocess.PIPE)
    for line in iter(process.stdout.readline, ''):
        sys.stdout.write(line)

    print(("Output clusters:", output_clusters_fpath))
    print(("Sorted input graph:", sorted_input_fpath))
票数 0
EN
页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接:

https://stackoverflow.com/questions/70675910

复制
相关文章

相似问题

领券
问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档