[Epic] Support SDK-type bindings for out-of-proc workers

[liliankasem]

Epic to track the work to support SDK-type bindings for out-of-proc workers, focusing on dotnet isolated implementation.

Work for this feature can be found under this tag:

• https://github.com/Azure/azure-functions-dotnet-worker/labels/feature%3A%20SDK%20bindings

General

• Investigate SDK-type binding support for OOP workers #1018
• Investigate passing a parameter through a binding  #1080
• Design a pattern for extensions to advertise the types they support #1036
• Throughput calculation for sdk type bindings #1194
• Refactor how we determine which extensions support deferred binding #1266
• Add logging and telemetry to indicate when ParameterBindingData is being used azure-functions-host#9021
• Implement detector to identify use of ParameterBindingData azure-functions-host#9022
• [SDK Binding] Refactor BlobStorageConverter.cs to remove use of reflection #1325

Bypass deferred binding

• [SDK Binding] Design the approach to bypass deferred binding  #1395
• [SDK Binding] Prototype the design approach to bypass deferred binding  #1418
• [SDK Binding] Implement the design to bypass deferred binding #1495
• [SDK Binding] Update Source Generator with bypass deferred binding #1541

Analyzers

• Analyzer to warn of scenarios where the SupportsDeferredBinding attribute cannot be used #1277
• Implement analyzer to validate what types are supported by extensions #1144
• Implement analyzer to suggest a code fix for types that are supported by extensions #1587
• Analyzer to check if a blob container is not binding to an iterable type parameter #1276

Bugs

• SDK-type blob input binding not working #1100
• [Bug] FunctionMetadataGenerator does not assign cardinality as many for IEnumerable<> scenarios #1204
• [SDK Binding - Blob] Output binding does not work with trigger binding using an SDK-type #1362

Enhancements

• [Blob] Design for enabling inference of collection binding without the IsBatched property #1333
• Update WebJobs blob extension to remove collection parameter binding data #1674
• Update worker blob extension to infer IsBatched #1675

Extensions

Blob Storage

• Implement SDK-type binding prototype using new version of ParameterBindingData #1035
• Ensure collection support works for blob storage input bindings #1156
• Investigate Managed Identity flow for sdk type bindings #1093
• Refactor blob converter to use IOptions and service factory #1278
• [SDK Binding - Blob] Add unit tests for BlobStorageConverter.cs #1324
• [SDK Binding - Blob] Binding to BlobContainerClient should not require you to provide a blob path #1337
• [SDK Binding - Blob] Improve error logging when deserialization fails for POCO scenarios #1329
• Update dotnet-isolated Blob input and trigger binding templates azure-functions-templates#1375

Cosmos DB

• Implement Cosmos DB rules and converter #1034
• CosmosDB: Expose an API to retrieve a particular version of a given document azure-webjobs-sdk-extensions#800
• CosmosDB Converter: Support POCO for the input binding #1117
• Ensure collection support works for cosmosDB input bindings #1217
• Implement managed identity for Cosmos DB converter #1259
• Make sure not to use ParameterBindingData for Cosmos DB triggers azure-functions-host#9026
• Refactor cosmos converter to use IOptions and service factory #1279
• [SDK Binding - Cosmos] Investigate CosmosDB input binding SqlQuery property #1265
• [SDK Binding - Cosmos] Finish implementation of Cosmos Converter #1371
• Bump Cosmos SDK to 3.33.0 and remove PartitionKey.None workaround #1420
• [SDK Binding - Cosmos] Improve CosmosDBInput attribute requirements #1410
• Update dotnet-isolated CosmosDB input and trigger binding templates azure-functions-templates#1378

Queue

• [SDK-Bindings - Queue] Design for enabling Queue trigger bindings #1422
• [SDK-Bindings - Queue] Implement deferred binding support in WebJobs extension #1445
• [SDK-Bindings - Queue] Implement QueueMessage converter #1444
• Update dotnet-isolated Queue trigger binding templates azure-functions-templates#1376

Tables

• [SDK-Bindings - Tables] Implement deferred binding support in WebJobs extension  #1473
• [SDK-Bindings - Tables] Implement converter in Tables worker extension to support TableClient + #1474
• Update dotnet-isolated Table input and trigger binding templates azure-functions-templates#1377

Service Bus

• [SDK-Bindings - ServiceBus] Implement deferred binding support in WebJobs Extension #1536
• [SDK-Bindings - ServiceBus] Implement ServiceBus converter to bind to SBReceivedMessage  #1535
• Enhance Service Bus binding to enable calling service APIs #1538
• Implement ServiceBus extension E2E tests #1561
• Update dotnet-isolated ServiceBus trigger binding templates azure-functions-templates#1379

EventGrid

• [SDK-Bindings - EventGrid] Implement deferred binding support in WebJobs extension  #1564
• [SDK-Bindings - EventGrid] Implement converter in EventGrid worker extension #1565
• Update dotnet-isolated EventGrid trigger binding template azure-functions-templates#1380

EventHub

• Update and release WebJobs EventHub extension with ParameterBindingData changes
• Implement EventHub worker extension converter
• Update dotnet-isolated EventHub trigger binding template azure-functions-templates#1381

[mattchenderson]

Public preview announcement for reference: https://azure.microsoft.com/updates/public-preview-sdk-type-bindings/

[SeanFeldman]

I just wanted to high-five the team on the great work done here 👏

[mattchenderson]

Closing as we are using milestones for epics now, and most of this work was GA'd already. The remaining items are assigned to https://github.com/Azure/azure-functions-dotnet-worker/milestone/62, which can be used for ongoing tracking.