Dommel.Bulk 1.0.0

Dommel.Bulk

High performance insert data into database

Dommel.Bulk provides a convenient API for bulk insert operations using extension methods on the IDbConnection interface. The SQL queries are generated based on your POCO entities. Dommel.Bulk translates you entities to SQL expressions. Dapper is used for query execution and object mapping. Dommel is used for table and column names conventions

Installing Dommel.Bulk

Dommel.Bulk is available on NuGet.

Install using the .NET CLI:

dotnet add package Dommel.Bulk

Install using the NuGet Package Manager:

Install-Package Dommel.Bulk

Using Dommel.Bulk

Bulk insert using type mappers

var products = await connection.BulkInsertAsync<Product>(products);

Generate simple SQL expression using database specific type mappers. Supports MySql database. Has high performance.

Bulk insert using SQL parameters

int insertedCount = await connection.BulkInsertParametersAsync<Product>(products);

Use SQL parameters for insert values. Support for all databases. Has middle performance.

Type mappers

Support CLR types: bool, byte, char, double, float, int, long, sbyte, short, uint, ulong, ushort, decimal, DateTime, DateTimeOffset, Guid, string, TimeSpan, byte[], enum types and nullable types.

Async and non-async

All Dommel.Bulk methods have async and non-async variants, such as as BulkInsert & BulkInsertAsync, BulkInsertParameters & BulkInsertParametersAsync.

Extensibility

ITypeMapper

Implement this interface if you want to customize the mapping types to SQL query

public class JsonTypeMapper : ITypeMapper
{
    public LambdaExpression GetExpression()
    {
        // Map JSON type to SQL string.
        return (Expression<Func<JObject, string>>)x => $"'{x.ToString().Escape()}'";
    }
}

Use the AddTypeMapper() method to register the custom implementation:

AddTypeMapper(typeof(JObject), new JsonTypeMapper());

or

AddTypeMapper(typeof(JObject), new GenericTypeMapper<JObject>(x => $"'{x.ToString().Escape()}'"));

Performance

Performance comparison between bulk methods and InsertAll from Dommel library

BenchmarkDotNet=v0.13.1, OS=Windows 10.0.19044.1586 (21H2)
Intel Core i5-7300HQ CPU 2.50GHz (Kaby Lake), 1 CPU, 4 logical and 4 physical cores
.NET SDK=6.0.100
  [Host]     : .NET 6.0.0 (6.0.21.52210), X64 RyuJIT
  DefaultJob : .NET 6.0.0 (6.0.21.52210), X64 RyuJIT

Disclaimer

The material embodied in this software is provided to you "as-is" and without warranty of any kind, express, implied or otherwise, including without limitation, any warranty of fitness for a particular purpose. In no event shall the Centers for Disease Control and Prevention (CDC) or the United States (U.S.) government be liable to you or anyone else for any direct, special, incidental, indirect or consequential damages of any kind, or any damages whatsoever, including without limitation, loss of profit, loss of use, savings or revenue, or the claims of third parties, whether or not CDC or the U.S. government has been advised of the possibility of such loss, however caused and on any theory of liability, arising out of or in connection with the possession, use or performance of this software.