Dommel.Bulk 2.0.0-beta

Dommel.Bulk

High performance insert data into database

Dommel.Bulk provides a convenient API for bulk insert operations using extension methods on the IDbConnection interface. The SQL queries are generated based on your POCO entities. Dommel.Bulk translates you entities to SQL expressions. Dapper is used for query execution and object mapping. Dommel is used for table and column names conventions

Installing Dommel.Bulk

Dommel.Bulk is available on NuGet.

Install using the .NET CLI:

dotnet add package Dommel.Bulk

Install using the NuGet Package Manager:

Install-Package Dommel.Bulk

Dommel.Bulk basic usage

Bulk insert using type mappers

var products = await connection.BulkInsertAsync<Product>(products);

Generate simple SQL expression using database specific type mappers. Supports MySql database. Has high performance.

Bulk insert using SQL parameters

int insertedCount = await connection.BulkInsertParametersAsync<Product>(products);

Use SQL parameters for insert values. Support for all databases. Has middle performance.

Dommel.Bulk extended usage

Transaction

All extension methods supports database transaction usage. Example:

using (IDbTransaction transaction = _connection.BeginTransaction())
{
    await _connection.BulkInsertAsync(data, transaction);
}

ExecutionFlags

Dommel.Bulk supports flags that allow additional database functionality to control bulk insertion.

Example:

await _connection.BulkInsertAsync(data, flags: ExecutionFlags.IgnoreErrors);

Properties to update

You can specify which properties to update if there are conflicts when inserting.

await _connection.BulkInsertAsync(data, null, default, null, flags: ExecutionFlags.IgnoreErrors, nameof(Person.FirstName), nameof(Person.LastName));

Type mappers

Mapping C# Types to Database Type Literals Support CLR types: bool, byte, char, double, float, int, long, sbyte, short, uint, ulong, ushort, decimal, DateTime, Guid, string, TimeSpan, byte[], enum types and nullable types.

Async and non-async

All Dommel.Bulk methods have async and non-async variants, such as as BulkInsert & BulkInsertAsync, BulkInsertParameters & BulkInsertParametersAsync.

Database adapters

Represents a concrete implementation of a database abstraction. Supports only MySql implementation

Extensibility

Type mapper

Use the AddTypeMapper() method to register the custom type mapper.

DommelBulkMapper.AddTypeMapper(typeof(MySqlConnection), new GenericTypeMapper<JsonElement>((e, tw) => tw.Write(e.ToString())));

Database adapter

Use the AddTypeMapper() method to register the custom type mapper.

DommelBulkMapper.AddDatabaseAdapter(typeof(NpgsqlConnection), new NpgDatabaseAdapter());

Performance

Performance comparison between bulk methods and InsertAll from Dommel library

BenchmarkDotNet=v0.13.1, OS=Windows 10.0.19044.1586 (21H2)
Intel Core i5-7300HQ CPU 2.50GHz (Kaby Lake), 1 CPU, 4 logical and 4 physical cores
.NET SDK=6.0.100
  [Host]     : .NET 6.0.0 (6.0.21.52210), X64 RyuJIT
  DefaultJob : .NET 6.0.0 (6.0.21.52210), X64 RyuJIT

Disclaimer

The material embodied in this software is provided to you "as-is" and without warranty of any kind, express, implied or otherwise, including without limitation, any warranty of fitness for a particular purpose. In no event shall the Centers for Disease Control and Prevention (CDC) or the United States (U.S.) government be liable to you or anyone else for any direct, special, incidental, indirect or consequential damages of any kind, or any damages whatsoever, including without limitation, loss of profit, loss of use, savings or revenue, or the claims of third parties, whether or not CDC or the U.S. government has been advised of the possibility of such loss, however caused and on any theory of liability, arising out of or in connection with the possession, use or performance of this software.