LanguageIdentification 1.0.1

Install-Package LanguageIdentification -Version 1.0.1
dotnet add package LanguageIdentification --version 1.0.1
<PackageReference Include="LanguageIdentification" Version="1.0.1" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add LanguageIdentification --version 1.0.1
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
#r "nuget: LanguageIdentification, 1.0.1"
#r directive can be used in F# Interactive, C# scripting and .NET Interactive. Copy this into the interactive tool or source code of the script to reference the package.
// Install LanguageIdentification as a Cake Addin
#addin nuget:?package=LanguageIdentification&version=1.0.1

// Install LanguageIdentification as a Cake Tool
#tool nuget:?package=LanguageIdentification&version=1.0.1
The NuGet Team does not provide support for this client. Please contact its maintainers for support.

LanguageIdentification

Intro

.NET Port of Language Identification Library for langid-java

移植自langid-java的语言识别库,技术细节参见langid-javalangid.py

  • 支持.netstandard2.0+;

如何使用

安装Nuget包

Install-Package LanguageIdentification

快速使用


  1. 通过手动创建实例使用
var langIdClassifier = new LanguageIdentificationClassifier();
langIdClassifier.Append("Hello");
var result = langIdClassifier.Classify();
Console.WriteLine(result);
  • 实例不是线程安全的;
  • 实例复用进行新的检测前,需要调用Reset()方法;

  1. 通过静态方法使用
var result = LanguageIdentificationClassifier.Classify("Hello");
Console.WriteLine(result);
  • 静态方法是线程安全的,内部使用了默认的LanguageIdentificationClassifier池 - LanguageIdentificationClassifierPool.Default 进行处理;

特殊用法


  1. 只加载部分语言支持
var classifier = new LanguageIdentificationClassifier("zh", "en");
langIdClassifier.Append("Hello");
var result = langIdClassifier.Classify();
Console.WriteLine(result);
  • 速度会更快;
  • 返回的语言只会是已加载语言的其中一个;

  1. 使用自己的模型数据
var model = new LanguageIdentificationModel(langClasses, nb_ptc, nb_pc, dsa, dsaOutput);
var classifier = new LanguageIdentificationClassifier(model);
  • 具体各个参数是什么意义。。不清楚。。自行研究源项目。。。

  1. 加载默认模型时,使用更少的内存
AppContext.SetSwitch("LanguageIdentification:TryLoadModelWithLowMemory", true);
  • 在使用前设置开关;
  • 加载时会使用更少的内存,对应的会增加加载时间;
  • .NETStandard 2.0

  • net5.0

    • No dependencies.

NuGet packages

This package is not used by any NuGet packages.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last updated
1.0.1 111 9/29/2021
1.0.0 184 9/26/2021