Etl.Net 1.0.88-alpha

Implementation of an ETL engine for .NET standard 2.0 that works like SSIS and that is developed like with Linq

This is a prerelease version of Etl.Net.
There is a newer prerelease version of this package available.
See the version list below for details.
Install-Package Etl.Net -Version 1.0.88-alpha
dotnet add package Etl.Net --version 1.0.88-alpha
<PackageReference Include="Etl.Net" Version="1.0.88-alpha" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add Etl.Net --version 1.0.88-alpha
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
#r "nuget: Etl.Net, 1.0.88-alpha"
#r directive can be used in F# Interactive, C# scripting and .NET Interactive. Copy this into the interactive tool or source code of the script to reference the package.
// Install Etl.Net as a Cake Addin
#addin nuget:?package=Etl.Net&version=1.0.88-alpha&prerelease

// Install Etl.Net as a Cake Tool
#tool nuget:?package=Etl.Net&version=1.0.88-alpha&prerelease
The NuGet Team does not provide support for this client. Please contact its maintainers for support.

Release Notes

ETL.net

Implementation of a multi platform reactive ETL for .net standard 2.0 working with a similar principle than SSIS, but that is used in the same way than Linq.
The reactive approach for the implementation of this engine ensures parallelized multi streams, high performances and low memory foot print even with million rows to process.

ETL Operators:
* Select Tranformation
* Where Tranformation
* Sort Tranformation
* Left Join Tranformation
* Lookup Tranformation
* Union Tranformation
* Skip Tranformation
* Top Tranformation
* Distinct Tranformation
* Pivot Tranformation
* Unpivot Tranformation
* Aggregate Tranformation
* Cross Apply Tranformation
* Ensure Sorted Tranformation
* Ensure Keyed Tranformation
* Script Tranformation
* Select keeping sorted Transformation
* Left join keeping sorted Transformation
* Lookup keeping sorted Transformation
* List folder files Data source
* Read csv file Data source
* Read excel file Data source (to be done)
* Write csv file Data destination
* Write excel file Data destinaton (to be done)
* Read from Entity framework core Data source
* Write to Entity framework core Data destination
* Read from Entity framework Data source (to be done)
* Write to Entity framework Data destination (to be done)
* Entity framework core upsert Data destination (to be done)
* Entity framework upsert Data destination (to be done)
* SQL Server bulk load Data destination (to be done)
* Read from sql server command Data source (to be done)
* Write to sql server command Data destination (to be done)
* List files from FTP Data source (to be done)
* List file from SFTP Data source (to be done)
* Read files from FTP Data source (to be done)
* Read file from SFTP Data source (to be done)
* Write files from FTP Data destination (to be done)
* Write file from SFTP Data destination (to be done)
* Read data from REST service Data source (to be done)
* Write data to REST service Data destination (to be done)
* Keep section Transformation (to be done)
* Ignore section Transformation (to be done)

Runtime features:
* Trace issued data of each node
* Trace any error
* Stop the entire process whenever an error is raised
* Trace statistic result of each node at the end of the process
* Trace time that is spent in each node at the end of the process (to be done)
* Publish a Job as a REST web service in web api core (to be done)
* Run any ETL operation on traces to permit to filter and save
* Show graphic to represent the process as a directed graph
* Show graphic to represent the process as a sankey graph
* Show graphic to represent process execution statistics as a directed graph
* Show graphic to represent process execution statistics as a sankey graph
* Show realtime process execution statistics as a directed graph (to be done)
* Show realtime process execution statistics as a sankey graph (to be done)
* Web portal to host job definitions manage their executions (to be done)
* Power shell command tool to execute a job (to be done)
* Visual studio code addon to view the process as a directed graph whenever the job definition class file is saved (to be done)
* Visual studio code addon to view the process as a sankey graph whenever the job definition class file is saved (to be done)
* Raise a warning on the risky node when a performance issue or a bad practice is detected given statistics (to be done)
* Interprets a T-SQL-like language script to build a job definition on the fly and run it (to be done)

  • .NETStandard 2.0

    • No dependencies.

NuGet packages (8)

Showing the top 5 NuGet packages that depend on Etl.Net:

Package Downloads
Etl.Net.TextFile
Text files extensions for Etl.Net
Etl.Net.ExecutionPlan
ExecutionPlan extensions for Etl.Net
Etl.Net.EntityFrameworkCore
EntityFrameworkCore extensions for Etl.Net
Etl.Net.ExcelFile
Excel files extensions for Etl.Net
Etl.Net.SqlServer
Sql Server extensions for Etl.Net

GitHub repositories

This package is not used by any popular GitHub repositories.

Version History

Version Downloads Last updated
1.0.161-alpha 731 3/7/2019
1.0.160-alpha 552 2/23/2019
1.0.159-alpha 600 2/20/2019
1.0.158-alpha 634 2/14/2019
1.0.157-alpha 599 2/9/2019
1.0.155-alpha 620 1/31/2019
1.0.152-alpha 604 1/22/2019
1.0.151-alpha 577 1/3/2019
1.0.150-alpha 591 12/30/2018
1.0.146-alpha 597 12/28/2018
1.0.144-alpha 564 12/27/2018
1.0.143-alpha 570 12/27/2018
1.0.142-alpha 522 12/26/2018
1.0.141-alpha 541 12/26/2018
1.0.140-alpha 604 11/21/2018
1.0.139-alpha 566 11/18/2018
1.0.138-alpha 580 11/18/2018
1.0.137-alpha 551 11/18/2018
1.0.136-alpha 531 11/18/2018
1.0.135-alpha 589 11/13/2018
1.0.134-alpha 588 11/12/2018
1.0.133-alpha 544 11/11/2018
1.0.132-alpha 555 11/4/2018
1.0.131-alpha 564 10/18/2018
1.0.130-alpha 590 10/16/2018
1.0.129-alpha 613 10/16/2018
1.0.128-alpha 603 10/1/2018
1.0.127-alpha 590 10/1/2018
1.0.126-alpha 571 9/30/2018
1.0.125-alpha 566 9/30/2018
1.0.124-alpha 563 9/28/2018
1.0.123-alpha 607 9/26/2018
1.0.122-alpha 583 9/25/2018
1.0.121-alpha 581 9/25/2018
1.0.120-alpha 586 9/25/2018
1.0.118-beta 572 9/25/2018
1.0.116-beta 575 9/25/2018
1.0.114-beta 580 9/25/2018
1.0.111-alpha 576 9/22/2018
1.0.109-alpha 563 9/21/2018
1.0.108-alpha 575 9/19/2018
1.0.107-alpha 584 9/16/2018
1.0.106-alpha 544 9/14/2018
1.0.105-alpha 602 9/14/2018
1.0.104-alpha 550 9/12/2018
1.0.103-alpha 564 9/12/2018
1.0.102-alpha 511 9/10/2018
1.0.101-alpha 524 9/10/2018
1.0.100-alpha 538 9/10/2018
1.0.99-alpha 542 9/10/2018
1.0.98-alpha 521 9/10/2018
1.0.97-alpha 570 9/10/2018
1.0.96-alpha 493 9/8/2018
1.0.95-alpha 494 9/6/2018
1.0.93-alpha 466 9/3/2018
1.0.88-alpha 495 9/2/2018
1.0.86-alpha 467 9/2/2018
1.0.85-alpha 393 9/2/2018
Show less